Researchers at Cornell University have recently developed a groundbreaking wearable device that utilizes sonar technology to improve upper-body tracking in virtual reality and other applications. The innovative device, dubbed PoseSonic, uses a small sonar system fitted onto a pair of eyeglasses, allowing it to capture the body’s movement using acoustic signals instead of traditional cameras.
One of the key advantages of using sonar technology is its efficiency in terms of battery consumption, which makes it more practical for everyday use. Additionally, the use of sonar eliminates the privacy risks associated with headsets’ externally facing cameras, making it a more secure option for users. The PoseSonic system consists of two pairs of microphones and speakers that send and receive acoustic signals. These signals are then processed using a deep learning model to estimate 3D poses at nine different points on the upper body, including the shoulders, elbows, wrists, hips, and nose.
The researchers conducted tests in both laboratory and real-world settings, and found that the system was not significantly affected by environmental noise, indicating its robustness in varied conditions. Senior author Cheng Zhang stated that the use of less instrumentation on the body makes the system more practical, and its battery performance is significantly better for everyday use. This highlights the potential for PoseSonic to be seamlessly integrated into daily activities, making it a highly accessible technology for a wide range of users.
In addition to its applications in augmented and virtual reality, the researchers believe that sonar technology has the potential to enhance health tracking by capturing more detailed information on the body’s movements. This could have significant implications for various health and fitness applications, providing users with a more comprehensive understanding of their physical activity and performance.
Related Post
Despite its numerous benefits, the current iteration of PoseSonic only covers upper-body tracking, leaving “VR legs” as a challenge for future development. The researchers are actively exploring ways to expand the technology to encompass lower-body tracking, with the ultimate goal of creating a complete and seamless virtual reality experience.
The development of PoseSonic represents a significant advancement in wearable technology, showcasing the potential of sonar technology to revolutionize the way body movements are tracked and interpreted. By leveraging acoustic signals in place of traditional camera-based systems, the researchers have overcome several limitations and paved the way for a new era of immersive and secure virtual reality experiences.
Looking ahead, the team is focused on further enhancing the capabilities of PoseSonic, with ongoing efforts to optimize the system’s performance, expand its range of applications, and develop new features to meet the evolving needs of users. With its potential to transform virtual reality, health tracking, and beyond, PoseSonic has the promise to reshape the future of wearable technology and its impact on daily life.
