Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

HEVC overview main

1,352 views

Published on

Multimedia standard

Published in: Engineering
  • Be the first to comment

HEVC overview main

  1. 1. Overview of the High Efficiency Video Coding (HEVC) Standard Guided By (Dharmendra Savaliya)14mece05 Prof. Tanish Zaveri (Hitesh Patel)14mece11
  2. 2.  HEVC Introduction  Typical HEVC  HEVC Video Coding Layer  HEVC Video Coding Technique  HEVC Application
  3. 3. Joint project between ISO/IEC/MPEG and ITU-T/VCEG • ISO/IEC: MPEG-H Part 2 (23008-2) • ITU-T: H.265 • The JCT-VC committee • Joint Collaborative Team on Video Coding • Target: roughly half the bit-rate at the same subjective quality compared to H.264/AVC • Requirements: • Progressive required for all profiles and levels • Interlaced support using field SEI message • Video resolution: sub QVGA to 8Kx4K, with more focus on higher resolution video content (1080p and up) • Color space and chroma sampling: YUV420, YUV422, YUV444, RGB444 • Bit-depth: 8-14 bits
  4. 4. Typical HEVC video encoder
  5. 5.  A picture is partitioned into CTUs.  The CTU is the basic processing unit.  It contains luma CTBs and chroma CTBs.  A luma CTB covers L ×L samples.  Two chroma CTBs cover each L/2 ×L/2 samples.  HEVC supports variable-size CTBs.  The value of L may be equal to 16, 32, or 64.  It is selected according to needs of encoders.  In terms of memory and computational requirements.  Large CTB is beneficial when encoding high-resolution video content.
  6. 6.  Coding unit (CU) and coding block (CB)  The root of quadtree is CTU.  CTU is partitioned into CUs recursively.  A CU consists of one luma CB and two chroma CB.  Each CU has an associated partitioning into prediction units (PUs) and a tree of transform units (TUs)
  7. 7.  CTBs can be used as CBs or can be partitioned into multiple CBs using quadtree structures.  The quadtree splitting process can be iterated until the size for a luma CB reaches a minimum allowed luma CB size (8 ×8 or larger).
  8. 8.  Prediction unit (PU) and prediction block (PB)  A PU partitioning structure has its root at the CU level  PB size can be from 64×64 down to 4×4  The prediction mode for CU is signed as being Intra or Inter  When it is signed as intra, the PB (prediction block) size is same as CB size for all block - CB can be spilt into four PB quadrant when CB size is equal to small CB size. - It allows mode selection for block as small as 4 x 4.
  9. 9. Intrapicture prediction Interpicture prediction Asymmetric Motion Partitioning
  10. 10.  Transform unit (TU) and transform block (TB)  A TU tree structure has its root at the CU level.  A luma CB may be identical to the luma TB or may be split into smaller luma TBs.  TB size can be 4×4, 8×8, 16×16, and 32×32
  11. 11.  Motion compensation  Quarter-sample precision is used for the MVs.  7-tap or 8-tap filters are used for interpolation of fractional-sample positions.  Intrapicture prediction  33 directional modes, planar (surface fitting), DC (flat)  Modes are encoded by deriving most probable modes (MPMs) based on those of previously decoded neighboring PBs.
  12. 12.  Quantization control  Uniform reconstruction quantization (URQ)  Entropy coding  Context adaptive binary arithmetic coding (CABAC)  In-Loop deblocking filtering  Similar to the one in H.264  More friendly to parallel processing  Sample adaptive offset (SAO)  Nonlinear amplitude mapping  For better reconstruction of amplitude by histogram analysis
  13. 13.  HEVC : block-based hybrid video coding ① Inter picture prediction  Temporal statistical dependences ② Intra picture prediction  Spatial statistical dependences ③ Transform coding  Spatial statistical dependences
  14. 14.  Planar prediction (Intra_Planar)  Amplitude surface with a horizontal and vertical slope derived from boundaries  DC prediction (Intra_DC)  Flat surface with a value matching the mean value of the boundary samples  Directional prediction (Intra_Angular)  33 different directional prediction is defined for square TB sizes from 4×4 up to 32×32
  15. 15. Fig. 6. Modes and directional orientations for intrapicture prediction
  16. 16. • HEVC supports motion vectors with units of one quarter of the distance between luma samples.  Fractional Sample Interpolation  It is used to generate the prediction samples for non integer sampling positions.
  17. 17.  For residual coding, a CB can be recursively partitioned into transform blocks.  The partitioning is signaled by a residual quadtree. • Subdivision of a CTB into CBs and TBs. • Solid lines: CB boundaries, dotted lines: TB boundaries
  18. 18.  A slice is divided into rows of CTUs.  This supports parallel processing of rows of CTUs by using several processing threads in the encoder or decoder.  Wavefront parallel processing (WPP)
  19. 19.  HEVC uses transform coding of the prediction error residual.  The residual block is partitioned into multiple square TBs.  The supported transform block sizes are 4×4, 8×8, 16×16, and 32×32. 1. Core Transform 2. Alternative integer Transform 3. Scaling and Quantization
  20. 20.  HEVC uses only CABAC for entropy coding.  Context modeling  The number of contexts used in HEVC is less than in H.264/MPEG-4 AVC.  Entropy coding design actually provides better compression.  Adaptive coefficient scanning  Coefficient scanning is performed in 4×4 subblocks for all TB sizes.  The selection of the coefficient scanning order depends on the directionalities of the intrapicture prediction.
  21. 21. • Adaptive coefficient scanning  The horizontal scan is used when the prediction direction is close to vertical.  The vertical scan is used when the prediction direction is close to horizontal.  For other prediction directions, the diagonal up-right scan is used.
  22. 22.  Two processing steps, a deblocking filter (DBF) followed by an sample adaptive offset (SAO) filter, are applied to the reconstructed samples.  The DBF is intended to reduce the blocking artifacts due to block-based coding.  The DBF is only applied to the samples located at block boundaries.  The SAO filter is applied adaptively to all samples satisfying certain conditions.  e.g. based on gradient.
  23. 23.  Deblocking Filter  It is applied to all samples adjacent to a PU or TU boundary.  HEVC only applies the deblocking filter to the edge that are aligned on an 8×8 sample grid.  This restriction reduces the worst-case computational complexity without noticeable degradation of the visual quality.  It also improves parallel-processing operation.  The processing order of the deblocking filter is defined as horizontal filtering for vertical edges for the entire picture first, followed by vertical filtering for horizontal edges.
  24. 24.  SAO (sample adaptive offset)  It is a process that modifies the decoded samples by conditionally adding an offset value to each sample after the application of the deblocking filter, based on values in look-up tables transmitted by the encoder.  It is performed on a region basis, based on filtering type selected per CTB.  sao_type_idx 0: it is not applied to the CTB.  sao_type_idx 1: band offset filtering  sao_type_idx 2: edge offset filtering
  25. 25.  SAO  In the band offset mode.  The selected offset value directly depends on the sample amplitude.  The full sample amplitude range is uniformly split into 32 segments called bands.  The sample values belonging to four of these bands are modified by adding transmitted values.  The main reason for using four consecutive bands is that in the smooth areas artifacts can appear.
  26. 26.  SAO  In the edge offset mode.  a horizontal, vertical, or one of two diagonal gradient directions is used for the edge offset classification in the CTB.  Each sample in the CTB is classified into one of five EdgeIdx categories.
  27. 27.  I_PCM mode(bits)  The prediction, transform, quantization and entropy coding are bypassed.  The samples are directly represented by a pre-defined number of bits.  Its main purpose is to avoid excessive consumption of bits when the signal characteristics are extremely unusual.
  28. 28.  Lossless mode  The transform, quantization, and other processing that affects the decoded picture are bypassed.  The residual signal from inter- or intrapicture prediction is directly fed into the entropy coder.  It allows mathematically lossless reconstruction.  SAO and deblocking filtering are not applied to this regions.
  29. 29.  Transform skipping mode  Only the transform is bypassed.  It improves compression for certain types of video content such as computer-generated images or graphics mixed with camera-view content.  It can be applied to TBs of 4×4 size only.
  30. 30.  Harmonic has announced support for HEVC within its market-leading ProMedia solution. ProMedia Live supports live streaming from Mobile to HD for real-time video to software clients on smartphones, tablets, computers, gaming and streaming-player consoles. This capability will be extended to allow ProMedia to support resolutions up- to and including Ultra HD. Promedia Xpress brings Harmonic’s quality/performance leadership to file transcoding by adding HEVC and allowing efficient handling of all types of content, including Ultra HD for on- demand streaming, again to software decode clients.
  31. 31.  A multitude of tech companies are starting to adapt the new standard and offer support. Companies such as Harmonic will be announcing support for the standard. Many others such as LG, Panasonic, Sony, Toshiba, Philips, Sharp, ARM, Intel, Nvidia, Qualcomm, Realtek Semiconductor and Mozilla have backed the codec, and even Google will support it in Chrome and hasn’t ruled out YouTube support. Apple has even moved to support HEVC on its iPads — those sold in 2012 are HEVC compliant.  Why the initial lag in adoption of the new codec?  One explanation was the uncertainty of price and what it would cost to use HEVC. Also the incorporation of HEVC playback into the iOS or Android platforms, either via an app or OS upgrade.
  32. 32. 32  IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 22, NO. 12, DECEMBER 2012 Overview of the High Efficiency Video Coding (HEVC) Standard By Gary J. Sullivan, Fellow, IEEE, Jens-Rainer Ohm, Member, IEEE, Woo-Jin Han, Member, IEEE, and Thomas Wiegand, Fellow, IEEE

×