Coding Video

Iain E. Richardson is the founder of Vcodex BV and was formerly Professor of Video Coding at the Robert Gordon University, Aberdeen, Scotland. He is the author of four other books on video coding, which include two widely-cited books on the H.264 Advanced Video Coding standard.

• About the Author xviiAcknowledgements xixAbout the Companion Website xxi1 Introduction 11.1 Why Write This Book? 11.2 What Is in the Book? 21.3 How Should You Use This Book? 3References 42 Video Coding and Video Quality 52.1 Introduction 52.2 An Overview of Video Coding 62.3 Inputs and Outputs 92.4 Structural Elements 152.5 Prediction 172.6 Transform and Quantisation 252.7 Bitstream Coding 272.8 The Coded Bitstream 302.9 Storing and Transmitting the Coded Bitstream 302.10 The Decoder 322.11 The Video Codec Model 332.12 Video Codec Performance 352.13 Conclusion 40References 413 A History of Video Coding and Video Coding Standards 433.1 Introduction 433.2 The Foundations of Video Coding, 1950–1990 443.3 Video Coding Standards and Formats: 1990–2021 533.4 Comparing Video Coding Standards 653.5 Conclusions 66References 664 Structures 694.1 Introduction 694.2 Coded Video: Sequence to Picture 724.3 Coded Video: Picture to Basic Unit 754.4 Coded Video: Basic Unit to Block 804.5 HEVC Coding Structures 824.6 Structures in Versatile Video Coding/H. 266 1114.7 Conclusion 114Reference 1145 Intra Prediction 1155.1 Introduction 1155.2 The Intra Prediction Process 1185.3 Intra Prediction Modes 1185.4 Prediction Block Sizes 1265.5 Signalling Intra Prediction Choices 1285.6 Choosing a Prediction 1295.7 HEVC Intra Prediction 1305.8 VVC Intra Prediction 1395.9 Conclusions 144References 1446 Inter Prediction 1456.1 Introduction 1456.2 Inter Prediction – the Basics 1466.3 Forward, Backward and Biprediction 1556.4 Inter Prediction Block Sizes 1596.5 Motion Vectors 1626.6 Sub-Pixel Interpolation 1676.7 Reference Pictures 1766.8 Signalling Inter Prediction Choices 1866.9 Skip Mode 1926.10 Loop Filter 1936.11 When Inter Prediction Does Not Find a Good Match 1946.12 HEVC Inter Prediction 1976.13 Inter Prediction in VVC 2196.14 Conclusions 222References 2227 Transform and Quantisation 2237.1 Introduction 2237.2 Residual Blocks 2267.3 Block Transforms 2287.4 Quantisation 2467.5 Transform and Quantisation in Practice 2537.6 HEVC Transform and Quantisation 2547.7 Transform and Quantise in H.266 Versatile Video Coding 2727.8 Conclusions 273References 2738 Entropy Coding 2758.1 Introduction 2758.2 Entropy Coding for Video Compression 2788.3 Pre-processing 2838.4 Probability Models and Context Adaptation 2858.5 Variable-Length Coding 2868.6 Arithmetic Coding 2918.7 Binary Arithmetic Coding 2948.8 Context-Adaptive Binary Arithmetic Coding (CABAC) 3098.9 Entropy Coding in HEVC 3148.10 Entropy Coding in H.266/VVC 3348.11 Conclusion 334References 3359 Coded Video Filtering 3379.1 Introduction 3379.2 Filtering and Video Coding 3399.3 Detecting and Correcting Video Coding Artefacts 3419.4 HEVC In-Loop Filtering 3479.5 VVC Filtering 3549.6 Conclusions 355References 35510 Storing and Transporting Coded Video 35710.1 Introduction 35710.2 Storing and Delivering Coded Video 35910.3 Coded Video File Formats 36110.4 Transport of Coded Video 36510.5 Video Rate Control 37410.6 Error Handling 37910.7 Conclusions 381References 38211 Implementation and Performance 38311.1 Introduction 38311.2 Implementing Video Codecs 38411.3 Software Implementation 38411.4 Hardware Implementation 38811.5 Video Codec Performance 39011.6 Getting Started with Experiments 39711.7 Conclusion 405References 40512 Conclusions 40712.1 What This Book Has and Has Not Covered 40712.2 Where Is Video Coding Going Next? 40812.3 Where Should You Go Next? 409References 409Glossary 411Index 415