The Campaign

Real-time Video News Generation by Realistic Lip Sync Tech. Fake news has become a serious problem not only in politics, but in many other fields as well. “d magazine”, one of Japan?s leading magazine subscription app, decided to try to prevent the spread of fake news by spreading reliable information before anyone else could. We challenged to create video news right after ‘d magazine’ received latest articles. First, we decided to use Japan’s No.1 influencer as a newscaster to reach our audience. Since she is extremely busy, it wouldn’t be possible to create videos promptly if we shoot her every time. Therefore, we developed a system that enables to create videos without shooting using data extracted from her. This real time video generation system made it possible to reach our audience with the latest real time news.

Creative Execution

We extracted the talent’s 3D scanning data, texture, facial expression patterns, and voice data, and integrated these with the latest lip sync technology to enable production of headline news videos anytime, in real time, even without shooting. Every day we got headlines before anyone else and produced the videos within 48 hours. These were shared on social media and promoted as banners. In order to make the computer generated newscaster to speak more natural and human like, we used one of the highest quality speech synthesis technology AITalk®, and a 3D scanning system which exists only a few in Japan. This technology of creating videos using celebrity without shooting has widen the possibilities of what we can do with online ad and celebrities.