We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Image and Video Processing

Title: Differentiable bit-rate estimation for neural-based video codec enhancement

Abstract: Neural networks (NN) can improve standard video compression by pre- and post-processing the encoded video. For optimal NN training, the standard codec needs to be replaced with a codec proxy that can provide derivatives of estimated bit-rate and distortion, which are used for gradient back-propagation. Since entropy coding of standard codecs is designed to take into account non-linear dependencies between transform coefficients, bit-rates cannot be well approximated with simple per-coefficient estimators. This paper presents a new approach for bit-rate estimation that is similar to the type employed in training end-to-end neural codecs, and able to efficiently take into account those statistical dependencies. It is defined from a mathematical model that provides closed-form formulas for the estimates and their gradients, reducing the computational complexity. Experimental results demonstrate the method's accuracy in estimating HEVC/H.265 codec bit-rates.
Subjects: Image and Video Processing (eess.IV); Information Theory (cs.IT); Machine Learning (cs.LG); Multimedia (cs.MM)
Journal reference: Picture Coding Symposium (PCS), San Jose, CA, USA, 2022, pp. 379-383
DOI: 10.1109/PCS56426.2022.10018001
Cite as: arXiv:2301.09776 [eess.IV]
  (or arXiv:2301.09776v1 [eess.IV] for this version)

Submission history

From: Amir Said [view email]
[v1] Tue, 24 Jan 2023 01:36:07 GMT (210kb)

Link back to: arXiv, form interface, contact.