Controls
Piano Roll
Zoom
Ready — Press Play or Space 0 notes
LIVE Mode (L)
Synth FX (1)
Loop FX (2)
Focus (B)
Mute (M)
Voice Loop
Mapping
Camera Feed Inactive
Raise
Tilt
Glide
Slide
Flex
Grasp
Dimensions of Air
Raise (Y)
Tilt (Angle)
Glide (X)
Slide (Depth)
Flex (Fingers)
Grasp (Pinch)
Output Waveform
Camera inactive — Click "Start Camera" 0 FPS
MIDI AI — Hand Gesture Music Controller
Recording & Playback
R (hold)Record new loop
Hold R key to record your voice. Release to stop. Loop auto-plays after recording.
T (hold)Overdub layer
Record additional layer on top of existing loop. Same volume as original.
SpacePlay / Stop loop
XClear loop
EExport session (WAV)
Modes & FX Toggles
LLIVE Mode
Real-time voice modulation with hand. Your voice passes through filter controlled by gestures. No synth sound — pure voice processing.
1Synth FX toggle
When ON, hand gestures affect the synthesizer (pitch, filter, etc.)
2Loop FX toggle
When ON, hand gestures affect the loop (speed, filter). Enable both for combined control.
BFocus Mode
Visual effect — blurs and darkens background, keeping only hand in focus.
MMute Synth
Mutes the hand-controlled synthesizer sound. Loop playback continues.
System Audio (Spotify, etc.)
To modulate system audio from Spotify/YouTube:
1. Install BlackHole (free virtual audio driver)
2. In macOS Audio MIDI Setup → Create Multi-Output Device (BlackHole + Speakers)
3. Set Multi-Output as system output
4. Select "BlackHole" in Audio Input dropdown
5. Enable Live Mode (L) to hear modulated audio
6 Dimensions of Air (Synth Mode)
RaiseHand Y position
Move hand up/down → Pitch or Filter frequency (configurable)
TiltWrist angle
Rotate wrist → Filter resonance or detune
GlideHand X position
Move hand left/right → Stereo pan or delay amount
SlideHand depth (size)
Move hand closer/further from camera
FlexFinger curl
Curl fingers toward palm
GraspPinch gesture
Pinch thumb to index → Volume control
Live Mode Voice Control
RaiseFilter frequency (200-8000 Hz)
TiltFilter resonance (Q)
GraspVoice volume
Open hand = full volume, pinch = mute