SOUND//SPACE
Sound becomes space: the microphone builds a luminous structure, while a pinch freezes a phrase, music or a clap into a 3D sculpture.
- Type
- Art experience
- Platforms
- Headsets · mobile · desktop
- Capabilities
- Sound
- Technology
- Google XR Blocks · three.js · Web Audio API
The experience
Sound stops disappearing and becomes space. After microphone permission, a live FFT draws a luminous ribbon: speech becomes a nervous relief, music a spectral fabric, and a clap a short shock with an expanding ring. A chosen moment remains as a 3D sculpture; together they make a history of the last minutes.
Interaction
- MIC requests the microphone.
- Tap, click, pinch or FREEZE saves the current sound moment.
- Drag moves or turns a selected sculpture; hold or squeeze removes it. Clear removes the entire history.
Data and limits
The microphone stream stays inside Web Audio API: it is neither recorded nor sent to a server. This is an FFT heuristic, not speech recognition or AI. If microphone permission is unavailable, an example generator demonstrates speech, music and a clap without claiming they are live input.
Google XR Blocks depends on WebXR. Required browser capabilities can be absent on iOS, including Safari, so this experiment may not start there. Quest 3 is the target platform; the desktop simulator is for testing the mechanics.