HAND TRACKING · SCOREFLIP
Play it in the air.
Open your camera, hold up your fingers, and play chords on piano, guitar, violin or cello. Strum with your other hand, sing along, and record a video to share. It runs on your device; nothing is uploaded.
Camera frames are processed in your browser and never leave your device.
Record a video for Reels, TikTok or Shorts. Sing along: headphones give the cleanest sound.
Pick an instrument and key
Grand piano, electric piano, organ, guitar, violin or cello. Choose the key of your song and a chord set.
Fingers pick the chord
One to five fingers choose the chord. A fist stops the sound. On piano, ScoreFlip’s 3D hands play each chord on the keyboard.
Play it, then post it
Strum with your other hand and sing along. Press Record to make a video of your performance for Reels, TikTok or Shorts.
A FEW NOTES BEFORE YOU PLAY
Four chords, a thousand songs.
Most pop songs move between the same few chords: the I, IV, V and vi of their key. In C major those are C, F, G and Am. Put them on four fingers and you can accompany yourself on a huge number of songs without learning a single shape.
A small place to start
Choose the key of C and the pop set. Count four slow beats on each chord: one finger (C), four fingers (Am), two fingers (F), three fingers (G). Loop it and hum a melody over the top. Then try the ballad set, or switch to guitar and strum with your other hand.
Good to know.
Is my camera video uploaded anywhere?
No. Hand tracking runs inside your browser with Google’s MediaPipe hand model. Camera frames are read on your device, turned into hand positions, and thrown away. Nothing is uploaded to ScoreFlip or anyone else. A video is only made when you press Record; it is created in your browser and stays on your device until you save or share it. The tracking model (about 8 MB) is downloaded once, like any other part of the page.
How do I change chords?
With Finger count, hold up one to five fingers on your chord hand: one finger plays the first chord, two the second, and so on. Make a fist to stop. With Hand position, move your hand across the four zones of the camera picture. The chord pads under the camera show which gesture plays which chord.
How does strumming work?
Set Play on to Strum. Your chord hand holds the shape, and you flick your other hand down or up in front of the camera to strum, like a guitar. A faster flick plays louder. With Chord change, the chord sounds as soon as you change your hand shape, which leaves you free to sing.
Which chords can I play?
Pick any of eight keys and a chord set: pop (I–IV–V–vi), ballad (I–vi–IV–V), minor (i–iv–v–VI–VII) or blues (I7–IV7–V7). These progressions cover thousands of songs, so you can play along and sing most pop songs with four chords.
Why doesn’t it see my hand?
Keep your hand 40–80 cm from the camera with your palm facing it, in good light and with a plain background if you can. Spread your fingers clearly. Keep both hands in the picture when strumming. If the camera is blocked, use your browser’s site settings to allow it and press Try the camera again.
Can I record a video and share it?
Yes. Press Record video, play, then press Stop. Your video shows your hands, the instrument playing each chord and the chord names, with the instrument’s sound and, if Voice is on, your singing from the microphone. Use headphones for the cleanest mix. Choose 9:16 for Reels, TikTok and Shorts, or 16:9 for YouTube. Recording and watching it back are free; saving or sharing uses one of your three free ScoreFlip exports each month, or a credit, or is unlimited with ScoreFlip Plus or Pro.
Can I play without a camera?
Yes. Tap the chord pads, or use keys 1–5 to pick chords, Space to strum and 0 to stop. The sound and the on-screen instrument work the same way.
FROM CHORDS TO A WHOLE SONG
Learn the real thing with ScoreFlip.
Turn any song into sheet music, play along on the piano with the same 3D hands, and practise at your own pace.
Hand tracking by MediaPipe (Apache 2.0), running on your device. Piano and string sounds from the ScoreFlip online instruments (Splendid Grand Piano, FluidR3 GM). 3D hand model: “Rigged Hand” by J-Toastie, CC-BY 3.0. Online piano · Online guitar