The Campaign

Recent developments for high-resolution image transfer and immersive systems using head mounted display (HMD)s are aggressively making their ways into technology markets. However, we questioned the mere pursuit of high-resolution, and we have been exploring the possibility to develop a system to transmit an entire space with mind-blowing telepresence. Of course, without the use of HMDs. NTT, developed a way to transfer a HMD-less immersive experience, as if the whole space was 'teleported' through a real-time live speed transfer link from distant locations through tangible spatial display technology.

Creative Execution

Spatial layout of 9 transparent screens, including 1 double-sided screen, to create an engaging and immersive experience made possible through a powerful communication infrastructure. Ultra low latency multimedia synchronized transmission technology over high-speed networks Transfer distance 6,543 miles Zero packet loss 2K x 5 feeds with 600ms latency (from Tokyo to Austin, including 75ms network latency, during the event) 4K x 13 feeds (tested on maximum transfer size on previous trials) Next generation real-time image extraction technology from any background Without using conventional green screen technology, our technology, in 80ms, conducted human shape extractions of the artists in Tokyo from a background of choice, under various stage lighting conditions, then transmitted these isolated images. World debut of a double-sided transparent screen projection to display human form image extractions (double-sided screen provided by Polid Screen)

With our transfer technology, processing time of 80ms for image extraction without the use of green screen, under various stage lighting environments experienced zero packet loss at ultra low latency of 600ms. This made the state of live synchronicity between Austin and Tokyo virtually none, surprising not only the guests at the live show, but, also performers, DJ starRo, and technical experts of Internet2, who provided the high-speed NW architecture in the U.S. At the present moment, tests have been successfully conducted using 13 feeds of video at 4K resolution. With this technology, the foreseeable future in the ability to cater links to Tokyo from distant locations through an immersive telepresence experience during the Olympic Games at Tokyo in 2020 are very promising.

Ultra low latency technology, high transfer capability NW, next generation human-form image extraction technology, and the world debut of a double-sided transparent display for human-form projection. Our development of this revolutionary three-dimensional spatial immersive telepresence experience was our basis on making entry into the INNOVATION category.