Groove Pilot is a prototype interactive spatial music mixing “experience” for both desktop and VR.
Update 2018-01-09: Selected by Microsoft for the Windows Mixed Reality Developer Program .
As part of my continuing series of explorations around spatial music I threw together this prototype to play with some ideas about:
- Spatial music
- Real time mixing
VR version: Video of prototype VR app version (please use headphones to hear spatial audio effects).
How to play?
- You must use headphones or earbuds to experience the spatial music
- Collect all 14 sound orbs to complete the level.
- Collect each sound orb before you run out of fuel.
- Each one collected will give you a bonus fuel boost as well
- As you collect each sound orb it enables another layer of the downtempo chill music track to play.
- Each layer of music is located in 3D space so is mixed relative to all the others as you move around, dynamically changing the music mix and experience on the fly.
- In a sense it’s a generative music piece controlled by the players movement through 3D space.
- Each sound orb/music track/stem is also visualized procedurally in different ways with real time signal processing to drive reactive graphics.
- Note: Sound visualization currently only works on desktop version, working on a fix for the WebGL browser version.
- Best used with an XBox360 type controller to fly.
- Left Stick: Pitch/Yaw
- Triggers: Roll
- Button A: Start/Brakes
Try it out: https://groovepilot.netlify.com Note: This is WebGL and best used in Chrome/Firefox with minimal tabs open.
Research and Development
I did a talk about the development approach at VR Hub Tokyo Year-End Meetup Vol.4 | Health & Fitness with VR and AR titled “Design Framework for a Therapeutic VR app”.
Related projects are:
Built in Unity 3D.
Desktop only as Unity WebGL is currently not supported on mobiles.