Difference between revisions of "H.264"

Revision as of 13:00, 11 April 2008

Final References

• M. Horowitz, A. Joch, F. Kossentini, A. Hallapuro,"H.264/AVC baseline profile decoder complexity analysis", IEEE Transactions on Circuits and Systems for Video Technology, Volume 13, Issue 7, July 2003 Page(s):704 - 716

-The computational complexity of the coding algorithms directly affects the cost effectiveness of the development of a commercially viable H.264/AVC-based video solution.

• T. Wiegand, G.J. Sullivan, G. Bjntegaard, A. Luthra, "Overview of the H.264/AVC video coding standard" IEEE Transactions on Circuits and Systems for Video Technology, Volume 13, Issue 7, July 2003 Page(s):560 - 576

-However, an increasing number of services and growing popularity of high definition TV are creating greater needs for higher coding efficiency. Moreover, other transmission media such as Cable Modem, xDSL, or UMTS offer much lower data rates than broadcast channels, and enhanced coding efficiency can enable the transmission of more video channels or higher quality video representations within existing digital transmission capacities.

• Y. Huang, A. V. Tran, Y. Wang, "A workload prediction model for decoding mpeg video and its application to workload-scalable transcoding", Proceedings of the 15th international conference on Multimedia, Augsburg, Germany, pp, 952 - 961, 2007

-National University of Singapore

• J.S. Kim, J.G. Kim, K.O. Kang, J. Kim, "A distortion control scheme for allocating constant distortion in FD-CD video transcoder", IEEE International Conference on Multimedia and Expo, 2004. ICME '04. 2004 Volume 1, 27-30 June 2004 Page(s):161 - 164 Vol.1

-In Fig. 3, it is shown that the CD error of each frame propagates to next frames in an exponential decreasing form. And “sum-of-indep-l5%CD indicates the sum of CD errors and all propagation errors caused by the independent cases. The accumulated errors at each codedframe can be approximated simply by the sum of propagation errors.

• > Rui Zhang, Shankar L. Regunathan, Kenneth Rose, "Video Coding with Optimal Inter/Intra-Mode Switching for Packet Loss Resilience", IEEE Journal on Selected Areas in Communications, VOL. 18, NO. 6, JUNE 2000

-Powerpoint Presentation

• Jin-Gyeong Kim, JongWon Kim, and C.-C. Jay Ku, "Corruption Model of Loss Propagation for Relative Prioritized Packet Video", SPIE Proceeding of International Symposium on Optical Science, Engineering, and Instrumentation, Applications of Digital Image Processing XXIII, San Diego, CA, July, 2000.

Profiling/Component Breakdown

• Yen-Kuang Chen, Eric Q. Li, Xiaosong Zhou1 and Steven Ge, Implementation of H.264 encoder and decoder on personal computers, Journal of Visual Communication and Image Representation Volume 17, Issue 2, April 2006, Pages 509-532 :-Profiling Pie Chart

Tutorials

• > "H.264 / MPEG-4 Part 10 White Paper: Prediction of Inter Macroblocks in P-slices"
• > Nükhet Özbek, Turhan Tunali, "A Survey on the H.264/AVC Standard", International Computer Institute, Ege University, Turk J Elec Engin, VOL.13, NO.3 2005
• Short White Paper on encoding

Trading power for PSNR

Phase I

Modifying the Encoder

• JM12.4
• In contrast to the original proposal, we would like to look at modifying the encoder in order to make decisions about which blocks to drop. In this case, the decoder need only decide how many blocks to drop. The encoder would categorize and arrange the blocks in the stream so that the "important" blocks are sent first, enabling the decoder to drop the last n blocks without even decoding them.
• One issue to be addressed in the encoder: how do we decide which blocks are more important? Currently the idea is to look at blocks with smaller motion vectors and consider those less important. An important issue which arises is that this might prevent large slow moving objects from moving at all in the image. This might be avoided if the encoder looks at the average vector size, or vector statistics in order to avoid this situation.

Modifying the Decoder

• Enabling energy reduction functionality in the decoder without the benefit of a specialized encoder to first analyze the data poses some problems in terms of energy conservation. We want to reduce the amount of computation in order to throttle the processor, but the overhead required to make block dropping decisions might alleviate the advantage.

Phase II

Modifying the Decoder

• Hyeyoung Hwang, Taewook Oh, Hyunuk Jung, Soonhoi Ha, "Conversion of Reference C Code to Dataflow Model: H.264 Encoder Case Study", IEEE 2006

-The School of Electrical Engineering And Computer Science

-Seoul National University KOREA

Benchmarks

• Media benchmarks including H.264, not yet for SimpleScalar
• SimpleScalar benchmarks, mpeg2 only

Players and PSNR calcualtors

• VideoMeter, command line tool developed at ASU with PSNR calculations for 3 simultaneous yuv steams

-download videometer

Applicability to Bistable Displays

Articles

Survey

• Charles Krasic, Jonathan Walpole, Wu-chi Feng, "Quality-Adaptive Media Streaming by Priority Drop", Proceedings of the 13th international workshop on Network and operating systems support for digital audio and video, pp. 112 - 121, 2003

-OHSU, Beaverton, OR

• Y. Huang, A. V. Tran, Y. Wang, "A workload prediction model for decoding mpeg video and its application to workload-scalable transcoding", Proceedings of the 15th international conference on Multimedia, Augsburg, Germany, pp, 952 - 961, 2007

-National University of Singapore

• K. Seo, S. Kwon, S. K. Hong, J. Kim, "Dynamic bit-rate reduction based on frame-skipping and requantization for MPEG-1 to MPEG-4 transcoder", International Symposium on Circuits and Systems, 2003. Volume 2, 25-28 May 2003 Page(s):II-372 - II-375
• T. Liu, T. Lin, S. Wang, C. Lee, "A low-power dual-mode video decoder for mobile applications", Communications Magazine, IEEE, Volume 44, Issue 8, Aug. 2006 Page(s):119 - 126

-Good block diagram for h.264

-Good workload breakdown for decoder (pie-chart)

DVFS

• Ku He, Yibo Chen, Rong Luo, "A System Level Fine-Grained Dynamic Voltage and Frequency Scaling for portable embedded systems with multiple frequency adjustable components", IEEE, 2007

-Beijing

• >Hyekseong Kweon, Younggu Do, Jaejeong Lee, Byoungchul Ahn, [ "An Efficient Power-Aware Scheduling Algorithm in Real Time System"], IEEE PACRIM, 2007

-Seoul

-Good discussion on dynamic and static leakage and dependence on operating voltage

Corruption Model

• Jin-Gyeong Kim, JongWon Kim, and C.-C. Jay Ku, "Corruption Model of Loss Propagation for Relative Prioritized Packet Video"
• > Rui Zhang, Shankar L. Regunathan, Kenneth Rose, "Video Coding with Optimal Inter/Intra-Mode Switching for Packet Loss Resilience", IEEE Journal on Selected Areas in Communications, VOL. 18, NO. 6, JUNE 2000

-Powerpoint Presentation

• Hua Yang and Kenneth Rose, "Recursive End-to-End Distortion Estimation With Model-Based Crosscorrelation Approximation", IEEE 2003

Profiling/Component Breakdown

• Yen-Kuang Chen, Eric Q. Li, Xiaosong Zhou1 and Steven Ge, Implementation of H.264 encoder and decoder on personal computers, Journal of Visual Communication and Image Representation Volume 17, Issue 2, April 2006, Pages 509-532 :-Profiling Pie Chart

• Xiaosong Zhou†, Eric Q. Li†, and Yen-Kuang Chen, "Implementation of H.264 Decoder on General-Purpose Processors with Media Instructions"

General

• C. Lian, S. Chien, Chia-ping Lin, P. Tseng, L. Chen, "Power-Aware Multimedia: Concepts and Design Perspectives", Circuits and Systems Magazine, IEEE, 2007, Volume: 7, Issue: 2, page(s): 26-34
• T. Shih, C. Yang, and Y. Tung, "Workload Characterization of the H.264/AVC Decoder", Book Advances in Multimedia Information Processing pp. 957-966, PCM 2004.
• A. R. Iranpour and K. Kuchcinski, "Performance Improvement for H.264 Video Encoding using ILP Embedded Processor", Proceedings of the 9th EUROMICRO Conference on Digital System Design (DSD'06).
• Jin-soo Kim, Jae-Gon Kim, Kyeong-Ok Kang, Jinwoong Kim, "A Distortion Control Scheme for Allocating Constant Distortion in FD-CD Video Transcoder", IEEE International Conference on Multimedia and Expo (ICME), 2004.

-Distortion Control and Estimation

Code

• C Source code from Frauenhoefer
• Simulation Software
• Videolan.org (from Dr. Chatha)

-Documentation

Reference Software

• The Core Pocket Media Player (TCPMP)

-No linux support yet?