Video compression and communications : from basics to H.261 H.263 H.264 MPEG2 MPEG4 for DVB and HSDPA style adaptive turbo transceivers 3.9 The Gain Cost Controlled Inter Frame Codec 3.9.1 Complexity Considerations and Reduction Techniques 3.10 The Bit Allocation Strategy 3.11 Results 3.12 DCT Codec Performance under Erroneous Conditions 3.12.1 Bit Sensitivity 3.12.2 Bit Sensitivity of Codec I and II 3.13 DCT Based Low Rate Video Transceivers 3.13.1 Choice of Modem 3.13.2 Source Matched Transceiver 3.13.2.1 System 1 3.13.2.1.1 System Concept 3.13.2.1.2 Sensitivity Matched Modulation 3.13.2.1.3 Source Sensitivity 3.13.2.1.4 Forward Error Correction 3.13.2.1.5 Transmission Format 3.13.2.2 System 2 3.13.2.2.1 Automatic Repeat Request 3.13.2.3 Systems 3–5 3.14 System Performance 3.14.1 Performance of System 1 3.14.2 Performance of System 2 3.14.2.1 FER Performance 3.14.2.2 Slot Occupancy Performance 3.14.2.3 PSNR Performance 3.14.3 Performance of Systems 3–5 3.15 Summary and Conclusions 4 Low Bit Rate VQ Codecs and HSDPA Style Videophones 4.1 Introduction 4.2 The Codebook Design 4.3 The Vector Quantizer Design 4.3.1 Mean and Shape Gain Vector Quantization 4.3.2 Adaptive Vector Quantization 4.3.3 Classified Vector Quantization 4.3.4 Algorithmic Complexity 4.4 Performance under Erroneous Conditions 4.4.1 Bit Allocation Strategy 4.4.2 Bit Sensitivity 4.5 VQ Based Low Rate Video Transceivers 4.5.1 Choice of Modulation 4.5.2 Forward Error Correction 4.5.3 Architecture of System 1 4.5.4 Architecture of System 2 4.5.5 Architecture of Systems 3–6 4.6 System Performance 4.6.1 Simulation Environment 4.6.2 Performance of Systems 1 and 3 4.6.3 Performance of Systems 4 and 5 4.6.4 Performance of Systems 2 and 6 4.7 Joint Iterative Decoding of Trellis Based VQ Video and TCM 4.7.1 Introduction 4.7.2 System Overview 4.7.3 Compression 4.7.4 Vector quantization decomposition 4.7.5 Serial concatenation and iterative decoding 4.7.6 Transmission Frame Structure 8.5 H.261 Based Wireless Videophone System Performance 8.5.2 System Performance 8.6 Summary and Conclusions 9 Comparison of the H.261 and H.263 Codecs 9.1 Introduction 9.2 The H.263 Coding Algorithms 9.2.1 Source Encoder 9.2.1.1 Prediction 9.2.1.2 Motion Compensation and Transform Coding 9.2.1.3 Quantization 9.2.2 Video Multiplex Coder 9.2.2.1 Picture Layer 9.2.2.2 Group of Blocks Layer 9.2.2.3 H.261 Macroblock Layer 9.2.2.4 H.263 Macroblock Layer 9.2.2.5 Block Layer 9.2.3 Motion Compensation 9.2.3.1 H.263 Motion Vector Predictor 9.2.3.2 H.263 Subpixel Interpolation 9.2.4 H.263 Negotiable Options 9.2.4.1 Unrestricted Motion Vector Mode 9.2.4.2 Syntax Based Arithmetic Coding Mode 9.2.4.2.1 Arithmetic coding [1] 9.2.4.3 Advanced Prediction Mode 9.2.4.3.1 Four Motion Vectors per Macroblock 9.2.4.3.2 Overlapped Motion Compensation for Luminance 9.2.4.4 P B Frames Mode 9.3 Performance Results 9.3.1 Introduction 9.3.2 H.261 Performance 9.3.3 H.261 H.263 Performance Comparison 9.3.4 H.263 Codec Performance 9.3.4.1 Gray Scale versus Color Comparison 9.3.4.2 Comparison of QCIF Resolution Color Video 9.3.4.3 Coding Performance at Various Resolutions 9.4 Summary and Conclusions 10 H.263 for HSDPA Style Wireless Video Telephony 10.1 Introduction 10.2 H.263 in a Mobile Environment 10.2.1 Problems of Using H.263 in a Mobile Environment 10.2.2 Possible Solutions for Using H.263 in a Mobile Environment. 10.2.2.1 Coding Video Sequences Using Exclusively Intra Coded Frames 10.2.2.2 Automatic Repeat Requests 10.2.2.3 Multimode Modulation Schemes 10.2.2.4 Combined Source Channel Coding 10.3 Design of an Error Resilient Reconfigurable Videophone System 10.3.1 Introduction 10.3.2 Controling the Bit Rate 10.3.3 Employing FEC Codes in the Videophone System 10.3.4 Transmission Packet Structure 10.3.5 Coding Parameter History List 10.3.6 The Packetization Algorithm 14.3.4 Video Compression and Transmission Aspects 14.3.5 Comparison of Subband Adaptive OFDM and Fixed Mode OFDM Transceivers 14.3.6 Subband Adaptive OFDM Transceivers Having Different Target Bit Rates 14.3.7 Time Variant Target Bit Rate OFDM Transceivers 14.3.8 Summary and Conclusions 14.4 HSDPA Style Adaptive TCM TTCM and BICM for H.263 Video Telephony 14.4.1 Introduction 14.4.2 System Overview 14.4.2.1 System Parameters and Channel Model 14.4.3 Employing Fixed Modulation Modes 14.4.4 Employing Adaptive Modulation 14.4.4.1 Performance of TTCM AQAM 14.4.4.2 Performance of AQAMUsing TTCM TCC TCMand BICM 14.4.4.3 The Effect of Various AQAM Thresholds 14.4.5 TTCM AQAM in CDMA system 14.4.5.1 Performance of TTCM AQAM in CDMA system 14.4.6 Conclusions 14.5 Turbo Detected MPEG 4 Video Using Multi Level Coding TCM and STTC 14.5.1 Motivation and Background 14.5.2 The Turbo Transceiver 14.5.2.1 Turbo Decoding 14.5.2.2 Turbo Benchmark Scheme 14.5.3 MIMO Channel Capacity 14.5.4 Convergence Analysis 14.5.5 Simulation results 14.5.6 Conclusions 14.6 Near Capacity Irregular Variable Length Codes 14.6.1 Introduction 14.6.2 Overview of Proposed Schemes 14.6.2.1 Joint source and channel coding 14.6.2.2 Iterative decoding 14.6.3 Parameter Design for the Proposed Schemes 14.6.3.1 Scheme hypothesis and parameters 14.6.3.2 EXIT chart analysis and optimization 14.6.4 Results 14.6.4.1 Asymptotic performance following iterative decoding convergence 14.6.4.2 Performance during iterative decoding 14.6.4.3 Complexity analysis 14.6.5 Conclusions 14.7 Digital Terrestrial Video Broadcasting for Mobile Receivers 14.7.1 Background and Motivation 14.7.2 MPEG 2 Bit Error Sensitivity 14.7.3 DVB Terrestrial Scheme 14.7.4 Terrestrial Broadcast Channel Model 14.7.5 Data Partitioning Scheme 14.7.6 Performance of the Data Partitioning Scheme 14.7.7 Nonhierarchical OFDM DVBP Performance Since the publication of Wireless Video Communications five years ago the area of video compression and wireless transceivers has evolved even further. This new edition addresses a range of recent developments in these areas giving cognizance to the associated transmission aspects and issues of error resilience. Video Compression and Communications has been updated and condensed yet remains all encompassing giving a comprehensive overview of the subject. Covering compression issues coding delay implementational complexity and bitrate the book also looks at the historical perspective to video communication. . New edition of successful and informative text Wireless Video Communications. Substantial new material has been added on areas such as H.264 MPEG4 coding and transceivers. Clear presentation and broad scope make it essential for anyone interested in wireless communications. Systematically converts the lessons of Shannons information theory into design principles applicable to practical wireless systems. This book is ideal for postgraduates and researchers in communication systems but will also be a valuable reference to undergraduates development and systems engineers of video compression applications as well as industrialists managers and visual communications practitioners About the Authors Other Wiley and IEEE Press Books on Related Topics Preface Acknowledgments 1 Introduction 1.1 A Brief Introduction to Compression Theory 1.2 Introduction to Video Formats 1.3 Evolution of Video Compression Standards 1.3.1 The International Telecommunications Unions H.120 Standard 1.3.2 Joint Photographic Expert Group 1.3.3 The ITU H.261 Standard 1.3.4 The Motion Pictures Expert Group 1.3.5 The MPEG 2 Standard 1.3.6 The ITU H.263 Standard 1.3.7 The ITU H.263+ H.263++ Standards 1.3.8 The MPEG 4 Standard 1.3.9 The H.26L H.264 Standard 1.4 Video Communications 1.5 Organisation of the Monograph I Video Codecs for HSDPA Style Adaptive Videophones 2 Fractal Image Codecs 2.1 Fractal Principles 2.2 One Dimensional Fractal Coding 2.2.1 Fractal Codec Design 2.2.2 Fractal Codec Performance 2.3 Error Sensitivity and Complexity 2.4 Summary and Conclusions 3 Low Bit Rate DCT Codecs and HSDPA Style Videophones 3.1 Video Codec Outline 3.2 The Principle of Motion Compensation 3.2.1 Distance Measures 3.2.2 Motion Search Algorithms 3.2.2.1 Full or Exhaustive Motion Search 3.2.2.2 Gradient Based Motion Estimation 3.2.2.3 Hierarchical or Tree Search 3.2.2.4 Subsampling Search 3.2.2.5 Post Processing of Motion Vectors 3.2.2.6 Gain Cost Controlled Motion Compensation 3.2.3 Other Motion Estimation Techniques 3.2.3.1 Pel Recursive Displacement Estimation 3.2.3.2 Grid Interpolation Techniques 3.2.3.3 MC Using Higher Order Transformations 3.2.3.4 MC in the Transform Domain 3.2.4 Conclusion 3.3 Transform Coding 3.3.1 One Dimensional Transform Coding 3.3.2 Two Dimensional Transform Coding 3.3.3 Quantizer Training for Single Class DCT 3.3.4 Quantizer Training for Multiclass DCT 3.4 The Codec Outline 3.5 Initial Intra Frame Coding 3.6 Gain Controlled Motion Compensation 3.7 The MCER Active Passive Concept 3.8 Partial Forced Update of the Reconstructed Frame Buffers 12.4.4 Entropy Coding 12.4.4.1 Universal Variable Length Coding 12.4.4.2 Context Based Adaptive Binary Arithmetic Coding 12.4.4.3 H.264 Conclusion 12.5 Comparative Study of the MPEG 4 and H.264 Codecs 12.5.1 Introduction 12.5.2 Intra frame Coding and Prediction 12.5.3 Inter frame Prediction and Motion Compensation 12.5.4 Transform Coding and Quantisation 12.5.5 Entropy Coding 12.5.6 De blocking Filter 12.6 Performance Results 12.6.1 Introduction 12.6.2 MPEG 4 Performance 12.6.3 H.264 Performance 12.6.4 Comparative Study 12.6.5 Summary and Conclusions 13 MPEG 4 Bitstream and Bit Sensitivity Study 13.1 Motivation 13.2 Structure of Coded Visual Data 13.3 Visual Bitstream Syntax 13.3.1 Start Codes 13.4 Introduction to Error Resilient Video Encoding 13.5 Error Resilient Video Coding in MPEG 4 13.6 Error Resilience Tools in MPEG 4 13.6.1 Resynchronisation 13.6.2 Data Partitioning 13.6.3 Reversible Variable Length Codes 13.6.4 Header Extension Code 13.7 MPEG 4 Bit Sensitivity Study 13.7.1 Objectives 13.7.2 Introduction 13.7.3 Simulated Coding Statistics 13.7.4 Effects of Errors 13.8 Chapter Conclusions 14 HSDPA Like and Turbo Style Adaptive Single and Multi Carrier Video Systems 14.1 Turbo equalised H.263 based videophony for GSM GPRS 14.1.1 Motivation and Background 14.1.2 System Parameters 14.1.3 Turbo Equalization 14.1.4 Turbo equalization Performance 14.1.4.1 Video Performance 14.1.4.2 Bit Error Statistics 14.1.5 Summary and Conclusions 14.2 HSDPA Style Burst by burst Adaptive CDMA Videophony 14.2.1 Motivation and Video Transceiver Overview 14.2.2 Multimode Video System Performance 14.2.3 Burst by Burst Adaptive Videophone System 14.2.4 Summary and Conclusions 14.3 Adaptive Turbo Coded OFDM Based Videotelephony. 14.3.1 Motivation and Background 14.3.2 AOFDM Modem Mode Adaptation and Signaling 14.3.3 AOFDM Subband BER Estimation 14.7.8 Hierarchical OFDM DVB Performance 14.7.9 Summary and Conclusions 14.8 Satellite Based Video Broadcasting 14.8.1 Background and Motivation 14.8.2 DVB Satellite Scheme 14.8.3 Satellite Channel Model 14.8.4 The Blind Equalizers 14.8.5 Performance of the DVB Satellite Scheme 14.8.5.1 Transmission over the Symbol Spaced Two Path Channel 14.8.5.2 Transmission over the Two Symbol Delay Two Path Channel 14.8.5.3 Performance Summary of the DVB S System 14.8.6 Summary and Conclusions 14.9 Summary and Conclusions 14.10Wireless Video System Design Principles. Glossary Bibliography Subject Index Author Index 7.4 Inter Frame DCT Coding 7.4.1 Properties of the DCT transformed MCER 7.4.2 Joint Motion Compensation and Residual Encoding 7.5 The Proposed Codec 7.5.1 Motion Compensation 7.5.2 The Inter Intra DCT Codec 7.5.3 Frame Alignment 7.5.4 Bit Allocation 7.5.5 The Codec Performance 7.5.6 Error Sensitivity and Complexity 7.6 Summary and Conclusions III H.261 H.263 H.264 MPEG2 and MPEG 4 forHSDPA Style Wireless Video Telephony and DVB 8 H.261 for HSDPA Style Wireless Video Telephony 8.1 Introduction 8.2 The H.261 Video Coding Standard 8.2.1 Overview 8.2.2 Source Encoder 8.2.3 Coding Control 8.2.4 Video Multiplex Coder 8.2.4.1 Picture Layer 8.2.4.2 Group of Blocks Layer 8.2.4.3 Macroblock Layer 8.2.4.4 Block Layer 8.2.5 Simulated Coding Statistics 8.2.5.1 Fixed Quantizer Coding 8.2.5.2 Variable Quantizer Coding 8.3 Effect of Transmission Errors on the H.261 Codec 8.3.1 Error Mechanisms 8.3.2 Error Control Mechanisms 8.3.2.1 Background 8.3.2.2 Intra Frame Coding 8.3.2.3 Automatic Repeat Request 8.3.2.4 Reconfigurable Modulations Schemes 8.3.2.5 Combined Source Channel Coding 8.3.3 Error Recovery 8.3.4 Effects of Errors 8.3.4.1 Qualitative Effect of Errors on H.261 Parameters 8.3.4.2 Quantitative Effect of Errors on a H.261 Data Stream 8.3.4.2.1 Errors in an Intra Coded Frame 8.3.4.2.2 Errors in an Inter Coded Frame 8.3.4.2.3 Errors in Quantizer Indices 8.3.4.2.4 Errors in an Inter Coded Frame withMotion Vectors 8.3.4.2.5 Errors in an Inter Coded Frame at Low Rate 8.4 A Reconfigurable Wireless Videophone System 8.4.1 Introduction 8.4.2 Objectives 8.4.3 Bit Rate Reduction of the H.261 Codec 8.4.4 Investigation of Macroblock Size 8.4.5 Error Correction Coding 8.4.6 Packetization Algorithm 8.4.6.1 Encoding History List 8.4.6.2 Macroblock Compounding 8.4.6.3 End of Frame Effect 8.4.6.4 Packet Transmission Feedback 8.4.6.5 Packet Truncation and Compounding Algorithms 10.3.6.1 Operational Scenarios of the Packetizing Algorithm 10.4 H.263 Based Video System Performance 10.4.1 System Environment 10.4.2 Performance Results 10.4.2.1 Error Free Transmission Results 10.4.2.2 Effect of Packet Dropping on Image Quality 10.4.2.3 Image Quality versus Channel Quality without ARQ 10.4.2.4 Image Quality versus Channel Quality with ARQ 10.4.3 Comparison of H.263 and H.261 Based Systems 10.4.3.1 Performance with Antenna Diversity 10.4.3.2 Performance over DECT Channels 10.5 Transmission Feedback 10.5.1 ARQ Issues 10.5.2 Implementation of Transmission Feedback 10.5.2.1 Majority Logic Coding 10.6 Summary and Conclusions 11 MPEG 4 Video Compression 11.1 Introduction 11.2 Overview of MPEG 4 11.2.1 MPEG 4 Profiles 11.2.2 MPEG 4 Features 11.2.3 MPEG 4 Object Based Orientation 11.3 MPEG 4 : Content Based Interactivity 11.3.1 Video Object Plane Based Encoding 11.3.2 Motion and Texture Encoding 11.3.3 Shape Coding 11.3.3.1 VOP Shape Encoding 11.3.3.2 Gray Scale Shape Coding 11.4 Scalability of Video Objects 11.5 Video Quality Measures 11.5.1 Subjective Video Quality Evaluation 11.5.2 Objective Video Quality 11.6 Effect of Coding Parameters. 11.7 Summary and Conclusion 12 Comparative Study of the MPEG 4 and H.264 Codecs 12.1 Introduction 12.2 The ITU T H.264 Project 12.3 H.264 Video Coding Techniques 12.3.1 H.264 Encoder 12.3.2 H.264 Decoder 12.4 H.264 Specific Coding Algorithm 12.4.1 Intra frame Prediction 12.4.2 Inter frame Prediction 12.4.2.1 Block Sizes 12.4.2.2 Motion Estimation Accuracy 12.4.2.3 Multiple Reference Frame Selection for Motion Compensation 12.4.2.4 De blocking Filter 12.4.3 Integer Transform 12.4.3.1 Development of the 4 4 pixel Integer DCT 12.4.3.2 Quantisation 12.4.3.3 The Combined Transform Quantisation Rescaling and Inverse Transform Process 12.4.3.4 Integer Transform Example 4.7.7 Frame difference decomposition 4.7.8 VQ codebook 4.7.9 VQ induced code constraints 4.7.10 VQ trellis structure 4.7.11 VQ Encoding 4.7.12 VQ Decoding 4.7.13 Results 4.8 Summary and Conclusions 5 Low Bit Rate Quad Tree Based Codecs and HSDPA Style Videophones. 5.1 Introduction 5.2 Quad Tree Decomposition 5.3 Quad Tree Intensity Match 5.3.1 Zero Order Intensity Match 5.3.2 First Order Intensity Match 5.3.3 Decomposition Algorithmic Issues 5.4 Model Based Parametric Enhancement 5.4.1 Eye and Mouth Detection 5.4.2 Parametric Codebook Training 5.4.3 Parametric Encoding 5.5 The Enhanced QT Codec 5.6 Performance under Erroneous Conditions 5.6.1 Bit Allocation 5.6.2 Bit Sensitivity 5.7 QT Codec Based Video Transceivers 5.7.1 Channel Coding and Modulation 5.7.2 QT Based Transceiver Architectures 5.8 QT Based Video Transceiver Performance 5.9 Summary of QT Based Video Transceivers 5.10 Summary of Low Rate Codecs Transceivers II High Resolution Video Coding 6 Low Complexity Techniques 6.1 Differential Pulse Code Modulation 6.1.1 Basic Differential Pulse Code Modulation 6.1.2 Intra Inter Frame Differential Pulse Code Modulation 6.1.3 Adaptive Differential Pulse Code Modulation 6.2 Block Truncation Coding 6.2.1 The Block Truncation Algorithm 6.2.2 Block Truncation Codec Implementations 6.2.3 Intra Frame Block Truncation Coding 6.2.4 Inter Frame Block Truncation Coding 6.3 Subband Coding 6.3.1 Perfect Reconstruction Quadrature Mirror Filtering 6.3.1.1 Analysis Filtering 6.3.1.2 Synthesis Filtering 6.3.1.3 Practical QMF Design Constraints 6.3.2 Practical Quadrature Mirror Filters 6.3.3 Run Length Based Intra Frame Subband Coding. 6.3.4 Max Lloyd Based Subband Coding 6.4 Summary and Conclusions 7 High Resolution DCT Coding 7.1 Introduction 7.2 Intra Frame Quantizer Training 7.3 Motion Compensation for High Quality Images