Live browser instrument · Free to play

Gesture Synth — free online hand-gesture music synthesizer.

Pinch to play a note. Move your hand to shape it. This free online gesture synthesizer runs in your browser—no app, download, installation, or account needed to play.

Your first sound: a 30-second start

  1. Start Melody. Choose Start Camera, or Use Mouse Mode / Play without camera.
  2. Make a note. Pinch thumb + index, or hold the playing area with your pointer.
  3. Move to play. Left/right: notes. Up/down: tone. Release to stop.

Start Camera asks permission; allow it to play with hands. Live tracking stays on your device. No microphone needed. Camera blocked or loading? Play without camera.

See the hand controls ↘

Play, record and preview for free. Video export is paid. See recording and export details.

Input
2 hands / pointer
Engine
Local Web Audio
Output
15s / 120s recording

Loading the gesture engine…

RECORDED WITH THIS PAGE

Hear one pointer shape a melody.

This is a continuous 15-second take of the public-domain opening from “Twinkle, Twinkle, Little Star,” performed at 68 BPM in Mouse Mode with a C major scale and warm triangle voice. The picture and synthesized audio came from the same local recorder you can use above—no microphone, upload, or hidden production layer.

  1. 01 Open Mouse Mode
  2. 02 Play the opening phrase in C major
  3. 03 Record, preview, download, or share
Make your own 15s take

01 / HOW IT WORKS

How to use Gesture Synth in three steps.

Start with Melody for single notes. Camera setup may take longer on your first visit; Mouse Mode is ready without camera permission.

  1. 01

    Start the instrument

    Press Start Camera and allow access. Wait for hand tracking to be ready, or choose Mouse Mode to play without a webcam.

  2. 02

    Pinch to make a note

    Pinch thumb and index together to sound a note. Separate them to stop. Keep your full hand visible in even lighting.

  3. 03

    Move to shape the sound

    Move left/right for notes and up/down for brightness. Add a second hand for two-note harmony.

02 / GESTURE MAP

Your camera becomes a playable two-dimensional surface.

In Melody, each hand controls one voice. Position selects a scale note and its brightness; a pinch starts or stops the sound.

X / horizontal
Selects one of the visible notes. Because notes are locked to the chosen scale, broad movement stays musical instead of landing between pitches.
Y / vertical
Opens or closes a low-pass filter. Higher hands produce a clear, present tone; lower hands soften the upper harmonics.
Pinch distance
Bring your thumb and index finger together to sound a note; separate them to stop. Move horizontally to choose notes, rather than counting raised fingers or turning your wrist.

03 / MAKE IT YOURS

Useful musical choices, not a cockpit full of tiny knobs.

Choose Melody for scale notes, Easy Jam for four chords, or Beat Jam for a guided four-bar performance with beat and bass. Pinch or hold to play, then release to stop. See the mode and control guide for this instrument.

SCALE

Stay melodic from the first gesture.

Start with pentatonic for forgiving melodies, major for seven-note movement, or minor for a darker sound. Changing the root transposes the note field while keeping familiar gestures.

VOICE

Choose the edge of the instrument.

Sine is soft; triangle adds definition. Sawtooth makes filter movement obvious, while square has a hollow, game-like sound. Try quick pinches and sustained notes.

FALLBACK

No camera does not mean no instrument.

Mouse Mode uses the same audio engine. Move to choose a position, hold to play, and drag through scale steps before trying camera controls.

04 / CAMERA PRIVACY

Local hand tracking. You choose what to upload.

Hand tracking runs locally after you press Start Camera. The instrument reads landmark coordinates rather than sending your live camera feed to a server. Stop releases the camera; Mouse Mode needs none.

Recording and preview are free. Sing & Play can mix an optional microphone into your clip without speaker monitoring. Only after you confirm saving for purchase do we upload that recording privately. A browser recovery copy may survive a refresh for up to 24 hours, but can be cleared by your browser. Paid files are available for 30 days; see our privacy policy for storage details.

  • Hand detection runs on your device with WebAssembly.
  • Audio synthesis runs locally through the Web Audio API.
  • Microphone is optional in Sing & Play, with no speaker monitoring.
  • Only your chosen recording is uploaded after you confirm, for a paid video export.

05 / FAQ

Before you put your hands in frame.

Silent playback? Fix Gesture Synth no sound with a quick Mouse Mode check.

Is Gesture Synth a hand-tracking vocoder?

No. Gesture Synth generates musical sounds controlled by hands, mouse or touch; it does not process your voice. See how gestures become synth sounds.

Can Gesture Synth change my voice with hand gestures?

No. Hand gestures control synth notes and tone, not your microphone voice. Gesture Synth is not a voice changer.

What does the microphone do in Sing & Play?

The optional microphone records your singing alongside the synth, without live speaker monitoring. It does not apply vocoder, robotic voice or voice-changing effects. Learn how Sing & Play recording works.

What is Gesture Synth?

Gesture Synth is the free online hand-gesture music synthesizer at gesture-synth.com. Webcam hand tracking, mouse or touch controls notes and tone in your browser. Play, record and preview without an account; video export is paid.

Gesture synth vs gesture sync: which one is this?

This is Gesture Synth at gesture-synth.com. Synth means synthesizer: an instrument that creates sound. Gesture sync is a different spelling and may refer to synchronization or another product. This site makes music with hands, a mouse or touch; it is not a gesture-sync service. Follow this site’s controls, as similarly named products may work differently.

Is my camera video uploaded?

Live camera analysis, the camera stream and hand landmarks stay on your device. An optional microphone is requested separately and mixed only into the recording, without speaker monitoring. Only after you confirm the purchase upload does the selected recording go to private storage before payment, including your voice if you enabled the microphone.

Can I play without a webcam?

Yes. Choose Mouse Mode. Horizontal movement controls pitch, vertical movement controls brightness, and pressing the pointer gates the note. Mouse Mode uses the same scales, waveforms, and synthesis engine as the camera experience.

Do I need to download an app to use Gesture Synth?

No. Gesture Synth is a free online browser instrument. Play, record and preview without installation or sign-in. Video export requires sign-in and payment; see details below. Beat Jam MIDI note export remains free.

Which browser works best?

A current desktop version of Chrome or Edge offers the most consistent combination of webcam access, WebAssembly acceleration, and low-latency Web Audio. Safari and Firefox support many of the required APIs, but camera and audio behavior can vary between versions and devices.

Why do I have to press Start?

Browsers block pages from playing sound or opening a camera without a deliberate user action. Pressing Start Camera both resumes the audio context and opens the permission prompt. Gesture Synth never attempts to activate either capability on page load.

Does Gesture Synth work on mobile?

The interface is responsive, but this first release is tuned for laptops and desktops. Mobile devices differ widely in camera orientation, sustained hand-tracking performance, heat, and audio latency. For the most reliable session, use a desktop browser with a front-facing webcam and even lighting.

How can I make hand tracking more stable?

Face the camera with light on your hands rather than behind them. Keep your full hand visible, leave some space around your fingers, and avoid a background that closely matches your skin tone. Slow, intentional movement is easier to track and usually sounds more musical than fast waving.

Can I record or export a performance?

Sing & Play offers four configurable chords selected with 1–4 left-hand fingers while the thumb is folded. Right-hand height controls volume and wrist tilt controls tone; both hands must be valid to sound. It records 15 or 120 seconds, defaulting to 120. Melody, Easy Jam and Beat Jam keep their 15-second recordings. Record and preview for free. To keep the video, choose Download / share video and sign in with Google or email and password. Review the US$9.99 single-recording price or an optional pack and its included recordings before paying. Confirm the private upload of the selected recording for single purchase or pack unlock. Find your recording in My downloads for 30 days from single payment or pack unlock. Preview the take before buying; downloading a purchased file again does not charge for a new recording.

Can Gesture Synth control a DAW live?

No. Free Beat Jam MIDI export contains loop notes for editing in another music app, not a live DAW connection, video or the same audio.

LEARN / MAKE A TAKE

From a first note to a song.

Practise Little Star and Ode to Joy, then record a take or save a Beat Jam MIDI loop.

READY SIGNAL

Stop reading. Make the air audible.

Return to Gesture Synth