Screen Shot 2021-12-03 at 6.14.58 AM.png

     Entanglement (ongoing) is an XR installation and media experiment exploring the entangled relationships between space, listening and body. The viewers will be immersed in an entangled space consisting of 3D virtual objects and photogrammetric models from the physical world, using their body movements to compose and redefine relations of sounds in space. In the 3D space, there are three main assemblages composed of colored cubical objects. These cubical objects are represented as different musical clusters consisting of complex partials. Each partial in the clusters can be controlled and modulated by the viewer's body movements. By moving their bodies in space, listening also become an act of performing at the same time. 

         The ultimate goal of this project is to build a cross-platform and collaborative music listening and performing space in VR, AR and Physical environment. This project is working in progress. The initial prototype was implemented using Oculus Quest2 and Kinect camera. Multiplayer and AR features will be added in the next prototypes. The system is developed in Unity (3D environment), Maxmsp and ICST (interactive soundscape and spatialization), and TouchDesigner (motion tracking). 

diagram1.png
System diagram
Screen Shot 2021-12-29 at 6.32.47 PM.png
APP view
Screen Shot 2021-12-29 at 6.33.10 PM.png
VR prototype demo