The creation of high-quality clips in which the characters are on an unusual, changing, or simply a monochrome background requires studio conditions: everyone has heard about the green (sometimes blue) screen.
Programmers from Google decided to simplify the life of videobloggers who want to make beautiful videos with minimal investment. Now in the mobile service “YouTube Stories” you can change the background “on the fly”. With the help of machine learning, developers have created a lightweight and fast neural network that allows you to change the background as easily as applying filters to Instagram.
So far, the service has only been launched in test mode for a limited number of users. The algorithm still does not work perfectly, but the recognition accuracy will increase with the build-up of its base and the gradual learning algorithm. The neural network of “YouTube” has learned to distinguish common features of the head and shoulders using a minimal set of data. The video segmentation algorithm is capable of processing more than 30 frames per second. So far, only ready-made versions of the background are available to users and you can not insert your own image.
Video segmentation is a widely used method that allows you to separate the foreground of the scene from the background and treat them as two different visual layers. The development of artificial intelligence allows you to highlight the foreground without using a green screen or frame-by-frame processing of video material.
Developers announced the “YouTube Stories” service in the fall of 2017. It is very similar to the available features on Snapchat, Instagram, and Facebook. Google’s solution differed at first only in that 30 second videos from their “Stories” do not disappear in one day. Now the developers have added another small feature which should attract users and increase the competitiveness of the service.