12.5.7 : Video Compression



Monday, Mar 17 5:00 PM - 5:40 PM CET : The Future of Video Compression is AI-Driven [S72840]
  • Sharon Carmel : CEO, Beamr
  • Slides
  • 1B camera in the world, but this is boring to watch
  • from 2022 : 82 years of video uploaded on YouTube Every day
  • Now videos and images are structured data (this was no the case before
  • 1Mh to train a model to drive a car (multiple resolution, different FPS)
  • Vidéo are a large data type, so heavy to compute
  • VPU : Video Processing Unit (Decode, encode video)
  • The encoder knows how much action is at which place in the frame
  • THe model will give hints to the encoder to have better compression
  • NVENC : some compromise compare to Software encoding because the silicon is limited
  • Quanlity & Performance 1080p : AV1 previous standard
  • The same NVENC can now improve quality with Driver update (3 years of work)
  • CABR : Content Adaptive Bit Rate
  • Since CUDA 12.1 and 12.2 (even on T4, L40, L40s, RTX 4000)
  • The model integrity in kept when training autonomous cars with CABR
  • Need to develop a lot of Guardrails for software enconding (for difficult frames)
  • The mathematical efficency of the current encoders is very high, but we can make it better