Ryuichi Sakamoto, a world-renowned composer and musician, captivates his audience as he sits at a grand piano. Donning his signature tortoiseshell eyeglasses, dressed in a black suit, he exudes elegance and artistry. The room surrounding him is engulfed in darkness, highlighting only the freckles on his face and the glossy finish of the Yamaha piano. With grace and precision, Sakamoto’s hands lift and fall onto the keys, unleashing a sublime melody that resonates with the souls of those fortunate enough to witness this musical spectacle.
The performance spans 45 minutes, during which Sakamoto showcases ten of his own compositions. At the conclusion of each piece, the audience erupts in applause. Initially, I find myself unable to join in the clapping, as tears well up in my throat and stream down my cheeks. This profound emotional response reflects the immense beauty and depth emanating from Sakamoto’s performance. As the concert concludes, Sakamoto’s presence slowly fades into black, leaving me in awe as I remove the headset, returning to reality.
Titled “Kagami,” meaning “mirror” in Japanese, this extraordinary mixed-reality show is currently on display at The Shed in Manhattan and Factory International in Manchester, with upcoming runs at the Sydney Opera House and the Big Ears Festival in Knoxville, Tennessee. The concert begins by seating 80 individuals in a circle surrounding seemingly nothingness. Each concertgoer is equipped with a Magic Leap 2 headset. Once the audience members wear their headsets, a virtual Sakamoto materializes at the center of the circle, enabling attendees to move around him with caution to avoid bumping into both the non-existent piano and their fellow viewers.
The creation of Kagami involved the collaboration of Ryuichi Sakamoto and the production studio, Tin Drum. Their innovative design merges a 3D model of Sakamoto with the real world, resulting in an experience that harmonizes the tangible and the ethereal. This mesmerizing venture serves as a testament to the ever-expanding realm of musical experimentation with augmented reality (AR) and virtual reality (VR).
Notably, amidst the thick of the pandemic in 2020, Billie Eilish astounded audiences with a livestreamed concert enhanced by extended reality effects that transformed the stage into a melancholic ocean floor and a star-studded sky. In 2022, Gorillaz utilized AR technology to bring their animated characters to life on enormous screens, captivating audiences in both New York’s Times Square and London’s Piccadilly Circus. Artists such as Ariana Grande, Justin Bieber, and Travis Scott also delved into mixed-reality performances during the pandemic, paving the way for this fusion of music and technology.
Returning to Kagami’s origins, the creative journey began when Todd Eckert, the founder of Tin Drum, and Sakamoto brainstormed a mixed-reality project in early 2020. However, at that time, Sakamoto was unaware that the cancer he had previously battled had resurfaced. Perhaps his decision to embark on this venture stemmed from the two years he had lost to cancer treatment, longing to reconnect with his passion for performing. Alternatively, Sakamoto’s fascination with technology and its artistic possibilities may have motivated him to embrace this endeavor.
In November 2020, both Eckert and Sakamoto traveled from their base in New York City to Tokyo, the only city equipped with the necessary infrastructure to capture Sakamoto in 3D. Through the utilization of volumetric and motion capture technology, Sakamoto’s performances were meticulously recorded over three days. The setup comprised 48 cameras, various microphones, and lightboxes, which intricately captured his compositions, preserving his artistry in a virtual model.
Ryuichi Sakamoto’s legacy lives on through Kagami, a multi-sensory experience that melds the realms of reality and imagination. This innovative concert series encapsulates the boundless potential of augmented and virtual reality in the realm of music. As technology continues to advance, we can anticipate even more extraordinary collaborations between musicians and creators, redefining the possibilities of live performances and pushing the boundaries of artistic expression. Kagami serves as a fitting tribute to Sakamoto’s unparalleled talent and unwavering devotion to his craft, leaving audiences awestruck and profoundly moved.