It's sadly not currently possible to create CMS video backgrounds. But I stiched together a custom piece of code for this that works great, but takes a little more effort.
Cloneable CMS video backgrounds
Clone the project and use either your Vimeo videos or Webflow's upload function to serve your videos as backgrounds through the CMS system
See the dashboard here