01 / Why
A small instrument with an immediate invitation
Most music software begins with a panel of controls. Gesture Synth begins with a physical question: what would a sound do if you lifted one hand, crossed the frame, or pinched the air?
The project is designed for quick exploration, not for replacing a studio instrument. You can open it, choose Camera or Mouse Mode, make a note, and record a short performance without creating an account or installing software.
02 / How
Movement becomes pitch, tone, and expression
In Camera Mode, hand landmarks are detected in your browser. The instrument maps position and pinch gestures to musical controls, while the Web Audio engine produces the sound in real time. Mouse Mode offers the same core idea without camera access.
A built-in performance demonstrates the musical range before you grant any permission. The current arrangement is an original Gesture Synth recording of the public-domain melody “Twinkle, Twinkle, Little Star.”
03 / Privacy
Camera input stays on the device
Camera frames are processed in browser memory for live hand tracking. Gesture Synth does not upload or store those frames, and it does not request microphone access. The camera opens only after you press Start Camera and stops when you press Stop or close the page.
Short performance clips are assembled locally from the visualizer and synthesized audio. They remain in your browser unless you choose Download or a system share option.
The full data and advertising disclosure is available in the Privacy Policy.
04 / Technology
Built on open web capabilities
Gesture Synth uses MediaPipe Tasks Vision for hand tracking, Tone.js and the Web Audio API for synthesis, and browser media APIs for local recording. The project is not sponsored by or affiliated with Google, browser vendors, or social platforms.
Questions, accessibility feedback, and bug reports are welcome at support@gesture-synth.com.