Gazprom-Media Holding announces the launch of Video Tagging System, an automatic video content recognition and tagging service. It was developed by the Friday! TV channel and GPM Data company, the unified big data management center for Gazprom-Media Holding’s assets.
Video Tagging System was created on the basis of Computer Vision technologies and neural networks. The service helps recognize faces, speech*, inscriptions and the number of people in shot, people’s movements, detect animals and objects. It classifies shots, reads the beginning of opening sequences and titles, and determines the prevailing palette of the scene.
All of this enables speeding up the search for the right shots in the production of promotional materials and the launch of contextual video advertising. The product automates the search for suitable scenes, moderation, subtitling and video content analysis. The system is able of automatic marking the most relevant moments for showing commercials (midrolls) as well as marking logical pauses in serial content.
The first users of the service were Friday! and Saturday! TV channels as well as PREMIER online cinema. As a result of using VTS, the time for selecting video materials in creating promotional videos was reduced by more than 20 times, and the time for content subtitling by 4 times. VTS use reduces labor costs when working with content and allows users to reallocate resources from routine operations to creative tasks.
Friday! TV channel actively uses the technology to create promotional videos.
In March, the Saturday! TV channel was the first to test the technology in contextual video advertising. Advertising of the new confectionery show with Klava Koka Hello, Sweety was integrated into the show Confectioner on Friday!. Advertising appeared on the air automatically after the words “sweety” and “try”. So while watching the Friday! audience saw a relevant promo for another confectionery project.
*speech recognition is performed using Tinkoff VoiceKit technologies