Email this article 
Open Access
Subscription or Fee Access
A Survey on Video Compression using Deep Neural Networks
Abstract
The rise in video content shared over the internet demands the need for state-of-the-art video compression. A quality compression can help enable the efficient transmission of video data over limited bandwidth. Particularly during the COVID-19 pandemic, we saw that the increasing internet traffic used for video conferencing, gaming, and online learning forced Netflix, YouTube, and other streaming providers to limit their video quality in Europe and other countries as well. Standard video compression algorithms represent them as a sequence of reference frames following residual frames, and these methods lack versatility. The advent and recent advances in deep learning can solve such issues. This paper summarizes some of the Deep Video Codec (DVC) frameworks and their characteristics.
Keywords
References
Ren Yang and Fabian Mentzer and Luc Van Gool and Radu Timofte. Learning for Video Compression with Hierarchical Quality and Recurrent Enhancement. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020.7
G. J. Sullivan and J. Ohm and W. Han and T. Wiegand. Overview of the High Efficiency Video Coding (HEVC) Standard. IEEE Transactions on Circuits and Systems for Video Technology, 22(12):1649-1668. 2012.
Ahmed I. Sallam and Osama S. Faragallah and El-Sayed M. El-Rabaie. Comparative Study of Video Compression Techniques. Menoufia Journal of Electronic Engineering Research, 27(1):1-32. 2018.
Ren Yang and Fabian Mentzer and Luc Van Gool and Radu Timofte. Learning for Video Compression with Recurrent Auto-Encoder and Recurrent Probability Model. 2020.
Wu, Chao-Yuan and Nayan Singhal and Kr ä henb ü hl, Philipp. Video Compression through Image Interpolation. The European Conference on Computer Vision (ECCV). 2018.
Hu, Zhihao and Chen, Zhenghao and Xu, Dong and Lu, Guo and Ouyang, Wanli and Gu, Shuhang. Improving Deep Video Compression by Resolution-Adaptive Flow Coding. The European Conference on Computer Vision (ECCV). 2020.
Fan Zhang and Di Ma and Chen Feng and David R. Bull. Video Compression with CNN-based Post Processing. 2020.
SANGEETA and PREETI GULIA. PERFORMANCE ANALYSIS OF ADVANCEMENTS IN VIDEO COMPRESSION WITH DEEP LEARNING. International Journal of Electrical Engineering and Technology (IJEET). 11(5):137-143. 2020.
Lu, Guo and Ouyang, Wanli and Xu, Dong and Zhang, Xiaoyun and Cai, Chunlei and Gao, Zhiyong. DVC: An End-To-End Deep Video Compression Framework. arXiv preprint arXiv:1812.00101. 2019.
Djelouah, Abdelaziz and Campos, Joaquim and Schaub-Meyer, Simone and Schroers, Christopher. Neural Inter-Frame Compression for Video Coding. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). 2019.
Z. Chen and T. He and X. Jin and F. Wu. Learning for Video Compression. IEEE Transactions on Circuits and Systems for Video Technology, 30(2):566-576. 2020.
C. Ledig and L. Theis and F. Husz ́ar and J. Caballero and A. Cunningham and A. Acosta and A. Aitken and A. Tejani and J. Totz and Z. Wang and W. Shi. Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 105-114. 2017.8
A. Ranjan and M. J. Black. Optical Flow Estimation Using a Spatial Pyramid Network. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2720-2729. 2017.
A. Habibian and T. V. Rozendaal and J. Tomczak and T. Cohen. Video Compression with Rate-Distortion Autoencoders. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 7032-7041. 2019.
Haojie Liu and Han Shen and Lichao Huang and Ming Lu and Tong Chen and Zhan Ma. Learned Video Compression via Joint Spatial-Temporal Correlation Exploration. Proceedings of the AAAI Conference on Artificial Intelligence, 2020.
Bhargav Hegde, Dayananda P, Mahesh Hegde, Chetan C, “ Deep Learning Technique for Detecting NSCLC”, International Journal of Recent Technology and Engineering (IJRTE), Volume-8 Issue-3, September 2019, pp. 7841-7843. DOI: 10.35940/ijrte.C6540.098319
S. Ioffe and C. Szegedy. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on Machine Learning, 37:448–456. 2015.
Refbacks
- There are currently no refbacks.
This work is licensed under a Creative Commons Attribution 3.0 License.