CODA: Content-aware Frame Dropping Algorithm for High Frame-rate Video Streaming
Data Compression Conference (DCC)
March 22-25, 2022 | Snowbird, Utah, US
Vignesh V Menon, Hadi Amirpour, Mohammad Ghanbari, and Christian Timmerer
Christian Doppler Laboratory ATHENA, Alpen-Adria-Universität Klagenfurt
Abstract: High Framerate (HFR) video streaming enhances the viewing experience and improves visual clarity. However, it may lead to an increase of both encoding time complexity and compression artifacts at lower bitrates. To address this challenge, this paper proposes a content-aware frame dropping algorithm (CODA) to drop frames uniformly in every video (segment) according to the target bitrate and the video characteristics. The algorithm uses Discrete Cosine Transform (DCT)-energy-based low-complexity spatial and temporal features to determine the video properties and then predict the optimized framerate, yielding the highest compression efficiency. The effectiveness of CODA is evaluated with High Efficiency Video Coding (HEVC) bitstreams based on the x265 HEVC open-source encoder. Experimental results show that, on average, CODA reduces the overall Ultra High Definition (UHD) encoding time by 21.82% with bit-rate savings of 15.87% and 18.20% to maintain the same PSNR and VMAF scores, respectively compared to the original frame-rate encoding.
Acknowledgements: The financial support of the Austrian Federal Ministry for Digital and Economic Affairs, the National Foundation for Research, Technology and Development, and the Christian Doppler Research Association, is gratefully acknowledged. Christian Doppler Laboratory ATHENA: https://athena.itec.aau.at/.