Video Complexity Analyzer (VCA) v1.0

Release of Video Complexity Analyzer (VCA) version 1.0 open-source software.

The primary objective of VCA is to become the best spatial (E) and temporal (h) complexity predictor for every frame/video segment/video sequence, which aids in predicting encoding parameters for applications like scene-cut detection and online per-title encoding. VCA leverages x86 SIMD and multi-threading optimizations for effective performance. While VCA is primarily designed as a video complexity analyzer library, a command-line executable is provided to facilitate testing and development. We expect VCA to be utilized in many leading video encoding solutions in the coming years.

VCA is available as an open-source library, published under the GPLv3 license. For more details, please visit the online software documentation here. The source code can be found here.

A heatmap of the spatial (E) and temporal (h) complexity is shown below.

Heatmap of spatial complexity (E)

Heatmap of temporal complexity (h)

 

 

 

 

 

 

 

 

 

A performance comparison (fps) of VCA (with different levels of threading enabled) compared to Spatial Information/Temporal Information (SITI) is shown below.

Further information about possible VCA applications can be found at https://athena.itec.aau.at/, e.g. (list to-be-continued;),

• Live-PSTR: Live Per-title Encoding for Ultra HD Adaptive Streaming
• OPTE: Online Per-title Encoding for Live Video Streaming
• CODA: Content-aware Frame Dropping Algorithm for High Frame-rate Video Streaming
• VQEG NORM talk on Video Quality Analyzer
• INCEPT: INTRA CU Depth Prediction for HEVC
• Efficient Content-Adaptive Feature-based Shot Detection for HTTP Adaptive Streaming