Gesture Synth

BROWSER MUSIC / MOBILE

Gesture Synth mobile: play on phone or tablet.

Start free in your browser with touch controls. No app download, account or camera permission needed for touch. Try camera gestures after your first audible note.

Open instrument ↗

Free to play, record and preview without an account or app. Optional microphone in Sing & Play. Single-recording video export costs US$9.99; optional packs show their price and included recordings before payment. Google or email/password sign-in is required, with no subscription.

01 / BROWSER → TOUCH → SOUND

Start Gesture Synth mobile with touch

You can try Gesture Synth for free on a phone or tablet in the browser, without downloading an app or creating an account. Start with Play without camera. Touch and hold the playing area to sound a note, drag horizontally to change pitch, and move vertically to change brightness. Release your finger to end the note.

Touch lets you check sound and note control without camera permission or AI tracking. Try an ordinary Safari or Chrome tab on your device. Camera mode is an optional next experiment; its performance and browser capabilities need checking on that device.

  1. Open the instrument in a normal browser tab

    Open Gesture Synth. Use your device's regular browser rather than relying on a social app's embedded browser. Keep the tab open while you practise and save anything you want to keep before leaving.

  2. Set a comfortable listening volume

    Start at a moderate device volume. Check where sound is routed, especially if headphones or a Bluetooth speaker are connected. Raise volume gradually after your first audible note.

  3. Choose Play without camera

    This opens the touch path. You do not need to approve a camera request for it. Begin in Melody with the current musical settings and focus on one sound.

  4. Hold inside the playing area

    Keep one finger down on the stage. Listen for the note, then lift your finger to stop it. Try another hold before dragging so you can separate the start gesture from movement.

  5. Move in one direction at a time

    Hold and drag left or right for pitch. Next, hold near one horizontal position and move up or down for brightness. Select Stop when you finish the session.

No sound on iPhone or Android?

Tap Play without camera, then hold one finger inside the stage. Raise media volume, check silent-mode settings (including the iPhone silent switch where present), and confirm your speaker or headphone output. Bluetooth may route sound elsewhere. Microphone permission is not needed for synth playback. Browser behavior varies by device; follow the full audio troubleshooting checklist if it stays silent.

02 / ONE FINGER, THREE SMALL EXERCISES

Make touch control predictable

First practise hold and release: make a short sound, lift your finger, pause and repeat. The silence between notes is part of your performance. A long uninterrupted drag can make it harder to hear where one note ends and the next begins. Deliberate pauses help you learn the stage before adding a melody.

Explore pitch with a slow horizontal drag through discrete scale notes. Settle and listen before moving again. Then move vertically near the same horizontal position to hear brightness change. Up and down are not a volume gesture.

Use one active touch pointer for this path. Do not expect a phone's multi-finger touches to become the two independent hands available in camera Melody. A short, controlled phrase is a better starting task. The songs page offers practice ideas when you are ready, and the complete tutorial explains the modes.

Desktop Chromium touch emulation at 390px — not a physical phone test. This short Pentatonic example holds at three positions; it is not a named song or a camera performance.

03 / HANDS IN THE AIR, DEVICE AT REST

Try camera mode after touch works

Choose Start Camera if you want to try hand gestures. Allow camera access when the browser asks. Put the device somewhere stable, keep the full hand in view and use enough light to see the fingers clearly. Trying to hold the phone and perform with the same hand makes framing unnecessarily difficult.

In camera Melody, pinch your thumb and index finger to start a note. Move horizontally for pitch and vertically for brightness, then separate the fingers to stop. The AI and sound explanation describes why hand recognition and musical controls are different steps. Camera mode does not require your voice or a microphone.

Tracking can vary with hardware, browser, lighting and framing. If touch sounds correctly but camera playing is hesitant, work on the camera view before changing musical settings. Mobile camera performance has not been verified across physical devices here. You can keep using touch while deciding whether the camera experience suits your setup.

04 / CHOOSE A COMFORTABLE SETUP

Phone and tablet tasks are different

A phone is convenient for a quick touch phrase: keep it secure, make room for a slow drag and avoid starting at the very edge of the screen, where device gestures may interrupt you. Pause between exercises to check whether your touch is still inside the playing area. Moving beyond it is different from the synth choosing a wrong note.

A tablet offers more touch space and can be easier to position for camera experiments. Choose by your task, rather than assuming a larger screen guarantees faster tracking or native sharing support.

Narrow-screen Gesture Synth touch-emulation interface showing the playing area, Record 15s control and Stop session button.
The playing area and recording controls in a 390px desktop touch simulation. This view is not a phone-camera test.

Settle on the orientation before recording. Narrow screens use portrait automatically; desktop layouts use landscape. There is no frame picker. Test in your intended orientation, then check the saved picture.

05 / A PREVIEW IS NOT A SAVED FILE

Record a mobile performance and keep it

Sing & Play can record your singing with the synthesizer if you choose to enable the microphone. It does not change your voice or provide vocoder effects. Free MIDI export contains loop notes rather than a video or the same audio, and is not a live DAW connection. Sing & Play offers four configurable chords selected with 1–4 left-hand fingers while the thumb is folded. Right-hand height controls volume and wrist tilt controls tone; both hands must be valid to sound. It records 15 or 120 seconds, defaulting to 120. Melody, Easy Jam and Beat Jam keep their 15-second recordings.

Try Share clip when offered, but complete the destination's flow yourself. A canceled or failed share does not publish anything. If native sharing is unavailable, download the video, copy the caption and link when available, then manually upload and paste them in your chosen app. System sharing has not been checked on physical mobile devices in this verification.

The browser attempts to keep a local preview for recovery for up to 24 hours; this is a recovery window, not guaranteed physical deletion or a backup. Browser storage may be cleared. Uploaded unpaid recordings are retained for up to 30 days. Recordings are available for 30 days from single payment or pack unlock, then removed through scheduled cleanup. Downloading again does not extend that period. Purchased files are accessible after signing in with the same Google or email/password account used for purchase through My downloads. Saved Beat Jam loops remain tab-only.

06 / CHECK ONE LAYER AT A TIME

Find the next useful action

Separate input, audio, camera and saving problems. If touching the stage changes the view but makes no sound, first check audio output and volume. If touch works and camera does not, focus on camera permission and framing. A black camera preview is not a reason to enable a microphone.

Scroll sideways on a small screen. Keyboard users can focus this region and use the arrow keys.

Mobile checks by task
TaskWhat to checkNext action
Touch playingA hold inside the stage starts sound; release ends itTest a stationary hold before dragging; check audio output if silent
Camera playingPermission, visible full hand, stable device and lightCheck browser site permissions and system camera settings; return to touch if needed
RecordingThe preview has synth audio and the expected frameDownload a short test and open the actual saved file
SharingA destination accepts the file and completes its flowKeep the download; upload manually if the share sheet fails or is absent

Change one thing at a time. Keep a working download before retrying. For help, contact Gesture Synth with your device, browser and the step that failed.

QUESTIONS / CLEAR ANSWERS

Frequently asked questions

Can I use Gesture Synth mobile without downloading an app?

Yes. Open Gesture Synth in your phone or tablet browser and choose Play without camera to start with touch. It is free and needs no account. You do not need to install an app or enable a camera to try the touch instrument.

Does touchscreen playing use AI or camera permission?

No. Touch supplies hold and position input directly. Hold the stage to play, drag horizontally for pitch, move vertically for brightness and release to stop. Camera mode is a separate optional path that uses AI hand tracking.

Will it work on every iPhone, iPad or Android device?

That is not verified. You can try a normal Safari or Chrome tab, starting with touch. The narrow-screen example uses desktop Chromium touch emulation at 390px, not a physical phone. Camera performance and native system sharing still require checks on your device.

Why is touch silent or the camera preview black?

For silent touch, hold inside the stage and check device volume and audio output. For camera problems, check camera permission, framing and light. Review browser site permissions and system camera settings if needed. No microphone permission is required; touch remains an alternative.

Can I record a portrait video on my phone?

Narrow screens use a 9:16 portrait recording frame. The singing mode offers four configurable chords selected with 1–4 left-hand fingers while the thumb is folded. Right-hand height controls volume and wrist tilt controls tone; both hands must be valid to sound. It records 15 or 120 seconds, defaulting to 120. Melody, Easy Jam and Beat Jam keep their 15-second recordings. Record and preview for free. To keep the video, choose Download / share video and sign in with Google or email and password. Review the US$9.99 single-recording price or an optional pack and its included recordings before paying. Confirm the private upload of the selected recording for single purchase or pack unlock. Find your recording in My downloads for 30 days from single payment or pack unlock. Preview the take before buying; downloading a purchased file again does not charge for a new recording.

What if sharing fails or I close the tab?

The browser attempts to keep a local preview for recovery for up to 24 hours; this is a recovery window, not guaranteed physical deletion or a backup. Browser storage may be cleared. Uploaded unpaid recordings are retained for up to 30 days. Recordings are available for 30 days from single payment or pack unlock, then removed through scheduled cleanup. Downloading again does not extend that period. After purchase, download the video and upload it yourself if system sharing fails; the site never posts automatically.

Make one audible note before trying the camera or recording. Open Gesture Synth and start with a short practice.