VIDEO LYRICS

TitleVIDEO LYRICS
ClientEAT KANAZAWA
Product / ServicePRODUCT
CategoryE03. Innovative Use of Technology
EntrantDENTSU INC. Tokyo, JAPAN
Idea Creation DENTSU INC. Tokyo, JAPAN
Idea Creation 2 QOSMO Tokyo, JAPAN
Production DENTSU CREATIVE X Tokyo, JAPAN
Production 2 QOSMO Tokyo, JAPAN

The Campaign

Karaoke videos were originally created as loosely-organized stories that would serve as a common base upon which to create wide variety of interpretations. By “showing” these videos to a computer and creating new lyrics that call to mind completely new stories, we aimed to give karaoke an entertaining new twist. And by perfectly syncing the lyrics and the visuals, we wanted to create a more immersive experience that would maximize people’s enjoyment of karaoke.

Creative Execution

A convolutional neural network learns from numerous combinations of photos and their descriptions. We then conduct a video scene analysis. A programmed AI creates captions for an unknown karaoke video frame. It repeats this process to quickly write more captions for the video. The system extracts distinctive words from the captions. It searches for related words and synonyms, then selects words for the lyrics. The system calculates the number of characters in the original lyrics, then replaces them with entirely new lyrics it has generated.

Credits

Name Company Position
Kaoru Sugano Dentsu Lab Tokyo Creative Director
Nao Tokui Qosmo, Inc. Executive
Kouki Yamada Freelance Natural language processing programmer
Kazuyoshi Ochi Dentsu Lab Tokyo Film Planner/ Copy Writer
Ryosuke Sone Dentsu Lab Tokyo Film Planner/Director
Jun Kato Dentsu Lab Tokyo Creative Producer
Masafumi Fujioka Dentsu Creative X. inc, Producer
Hiromi Nakamura Dentsu Creative X. inc, Production Manager
Kiyonori Higuchi Office Higuchi Music Producer
Ken Katsuno Startline. inc, Cameraman
Mayumi Matsuzawa Freelance Hair & Make Up
Tetsuro Isshi Freelance Animator
Links
Website URL   |   Additional URL