H.264

Tutorials

• > "H.264 / MPEG-4 Part 10 White Paper: Prediction of Inter Macroblocks in P-slices"

Trading power for PSNR

Phase I

Modifying the Encoder

• JM12.4
• In contrast to the original proposal, we would like to look at modifying the encoder in order to make decisions about which blocks to drop. In this case, the decoder need only decide how many blocks to drop. The encoder would categorize and arrange the blocks in the stream so that the "important" blocks are sent first, enabling the decoder to drop the last n blocks without even decoding them.
• One issue to be addressed in the encoder: how do we decide which blocks are more important? Currently the idea is to look at blocks with smaller motion vectors and consider those less important. An important issue which arises is that this might prevent large slow moving objects from moving at all in the image. This might be avoided if the encoder looks at the average vector size, or vector statistics in order to avoid this situation.

Modifying the Decoder

• Enabling energy reduction functionality in the decoder without the benefit of a specialized encoder to first analyze the data poses some problems in terms of energy conservation. We want to reduce the amount of computation in order to throttle the processor, but the overhead required to make block dropping decisions might alleviate the advantage.

= Modifying the Decoder

• Hyeyoung Hwang, Taewook Oh, Hyunuk Jung, Soonhoi Ha, "Conversion of Reference C Code to Dataflow Model: H.264 Encoder Case Study", IEEE 2006

-The School of Electrical Engineering And Computer Science

-Seoul National University KOREA

Benchmarks

• Media benchmarks including H.264, not yet for SimpleScalar
• SimpleScalar benchmarks, mpeg2 only

Players and PSNR calcualtors

• VideoMeter, command line tool developed at ASU with PSNR calculations for 3 simultaneous yuv steams

-download videometer

Articles

Survey

• Charles Krasic, Jonathan Walpole, Wu-chi Feng, "Quality-Adaptive Media Streaming by Priority Drop", Proceedings of the 13th international workshop on Network and operating systems support for digital audio and video, pp. 112 - 121, 2003

-OHSU, Beaverton, OR

• Y. Huang, A. V. Tran, Y. Wang, "A workload prediction model for decoding mpeg video and its application to workload-scalable transcoding", Proceedings of the 15th international conference on Multimedia, Augsburg, Germany, pp, 952 - 961, 2007

-National University of Singapore

• K. Seo, S. Kwon, S. K. Hong, J. Kim, "Dynamic bit-rate reduction based on frame-skipping and requantization for MPEG-1 to MPEG-4 transcoder", International Symposium on Circuits and Systems, 2003. Volume 2, 25-28 May 2003 Page(s):II-372 - II-375
• T. Liu, T. Lin, S. Wang, C. Lee, "A low-power dual-mode video decoder for mobile applications", Communications Magazine, IEEE, Volume 44, Issue 8, Aug. 2006 Page(s):119 - 126

-Good block diagram for h.264

-Good workload breakdown for decoder (pie-chart)

DVFS

• Ku He, Yibo Chen, Rong Luo, "A System Level Fine-Grained Dynamic Voltage and Frequency Scaling for portable embedded systems with multiple frequency adjustable components", IEEE, 2007

-Beijing

• >Hyekseong Kweon, Younggu Do, Jaejeong Lee, Byoungchul Ahn, [ "An Efficient Power-Aware Scheduling Algorithm in Real Time System"], IEEE PACRIM, 2007

-Seoul

-Good discussion on dynamic and static leakage and dependence on operating voltage

Corruption Model

• Jin-Gyeong Kim, JongWon Kim, and C.-C. Jay Ku, "Corruption Model of Loss Propagation for Relative Prioritized Packet Video"
• > Rui Zhang, Shankar L. Regunathan, Kenneth Rose, "Video Coding with Optimal Inter/Intra-Mode Switching for Packet Loss Resilience", IEEE Journal on Selected Areas in Communications, VOL. 18, NO. 6, JUNE 2000

-Powerpoint Presentation

• Hua Yang and Kenneth Rose, "Recursive End-to-End Distortion Estimation With Model-Based Crosscorrelation Approximation", IEEE 2003

Profiling/Component Breakdown

• Profiling Pie Chart
• Xiaosong Zhou†, Eric Q. Li†, and Yen-Kuang Chen, "Implementation of H.264 Decoder on General-Purpose Processors with Media Instructions"

General

• C. Lian, S. Chien, Chia-ping Lin, P. Tseng, L. Chen, "Power-Aware Multimedia: Concepts and Design Perspectives", Circuits and Systems Magazine, IEEE, 2007, Volume: 7, Issue: 2, page(s): 26-34
• T. Shih, C. Yang, and Y. Tung, "Workload Characterization of the H.264/AVC Decoder", Book Advances in Multimedia Information Processing pp. 957-966, PCM 2004.
• A. R. Iranpour and K. Kuchcinski, "Performance Improvement for H.264 Video Encoding using ILP Embedded Processor", Proceedings of the 9th EUROMICRO Conference on Digital System Design (DSD'06).
• Jin-soo Kim, Jae-Gon Kim, Kyeong-Ok Kang, Jinwoong Kim, "A Distortion Control Scheme for Allocating Constant Distortion in FD-CD Video Transcoder", IEEE International Conference on Multimedia and Expo (ICME), 2004.

-Distortion Control and Estimation

Code

• C Source code from Frauenhoefer
• Simulation Software
• Videolan.org (from Dr. Chatha)

-Documentation

Reference Software

• The Core Pocket Media Player (TCPMP)

-No linux support yet?