Describe the creative idea

“ANOTHER LIVE” offers an interactive, browser-based experience to view the latest live performance by YAKUSHIMA TREASURE in the virgin banyan forests of Yakushima. Unlike a spectacle you would view with the naked eye, and unlike a video recorded with a regular camera, the experience provided by this work is an entirely new way to take in a concert. It is a live performance reconstructed from a combination of different perspectives on the world: a space scanned as 360-degree 3D point group data with infrared light, colors captured with photogrammetry, movements recorded with depth sensors and audio image from the concert recorded in surround sound from all directions with 360-degree microphones.

Describe the execution

We recorded their live performance in Yakushima using a variety of technologies. Space: 360° LiDAR Scan The entire forest was scanned as 3D point cloud data with a LiDAR sensor. Colors and textures: Photogrammetry Photogrammetry employing over 1,500 high-resolution photographs enabled expression of colors and texture as though from a painting. Motion: Volumetric Video Nine depth cameras were used. They recorded 3D data that captured absolutely all of the movement and expression from a one-time-only performance. Sound Field: Spatial Audio 360° microphones in a surround sound system using eight speakers recorded the audio. The live performance, reconstructed from the recorded data, is exported with color/depth/camera information and can be viewed on the website. In this way, there are no physical constraints on camera angles, and viewers can get so close to the artist that the distance between them disappears, fly around in the forest, and watch the performance from any perspective. Furthermore, by using WebGL to process the data of color, depth, camera information, and other viewers' perspectives, real-time data can be synthesized into the pre-rendered video space without any sense of discomfort, making it possible to experience the live performance while feeling the presence of other viewers. On the website, the dynamic camera work of PointCloud, the gothic typography that reminds us of people's historical years, and the fine lines that constantly change shape and waver express the reincarnation of life and the dynamism of life felt from the nature of Yakushima.