
Most people who say "I can't play an instrument" mean something specific: they never learned where to put their fingers. Chord shapes, fingerings and years of scales stand between them and the music they already hum.
We wanted to remove that step completely. The new ScoreFlip Air Instrument turns your laptop or phone camera into an instrument. Hold up one finger and a chord plays. Hold up two and the next one plays. Flick your other hand to strum. No piano, no guitar, nothing to install.
It's free, it runs in your browser, and you can try it right now at roovemusic.com/scoreflip/tools/air-instrument.
A ScoreFlip Air Instrument video: the player holds up fingers to pick chords and strums with the other hand, while the 3D hands play the keyboard.
---
1. Open the page and allow your camera. 2. Hold up your chord hand. The number of fingers you show picks the chord: one finger plays the first chord, two fingers the second, all the way up to an open hand. A fist stops the sound. 3. Strum with your other hand (optional). Flick it down or up in front of the camera, like a guitar. A faster flick plays louder.
That's it. Change your hand shape and the music changes with you.
---
Here's the secret the tool is built on: most popular songs use the same handful of chords. Musicians call them the I, IV, V and vi of a key. In C major, that's C, F, G and A minor.
Put those four chords on four fingers and you can accompany yourself on a huge number of songs without learning a single chord shape. The Air Instrument comes with four ready-made chord sets:
Pick any of eight keys (C, G, D, A, E, F, B♭ and E♭) so the chords match the song you want to sing. The chord pads under the camera always show which finger plays which chord, so you never have to memorise anything.
The chord pads: one finger to an open hand, each mapped to a chord, plus a fist to stop.
Choose the key of C and the Pop set. Count four slow beats on each chord: one finger (C), four fingers (Am), two fingers (F), three fingers (G). Loop it and hum over the top. You've just played one of the most famous chord progressions in music.
---
Switch instruments at the top of the player:
On piano, ScoreFlip's 3D hands play each chord on the keyboard so you can see the notes.
---
Play on: Chord change. The chord sounds the moment your hand shape changes. Your strumming hand is free, so this is the best mode for singing along.
Play on: Strum. Your chord hand holds the shape and your other hand does the rhythm. Flick down, flick up. It feels surprisingly like playing a real guitar.
You can also choose Pick by: Position instead of finger count. Then the camera picture is split into four zones and you move your hand from zone to zone to change chords. Some people find this easier, especially with small children.
Left-handed? Switch Chord hand to Left.
---
The Air Instrument is made to be shared. Press Record video, play your song, then press Stop. ScoreFlip builds a branded video right in your browser. It shows your camera with the hand tracking, the instrument playing each chord, and the chord names as you go.
Worship leaders, music teachers and anyone who loves a sing-along: this is a fun way to make a quick video without carrying an instrument around.
---
We know that "allow camera" is a big ask, so we built the tool to keep your camera to itself.
Hand tracking runs inside your browser using Google's open-source MediaPipe hand model. Each camera frame is turned into hand positions on your device and then thrown away. No camera frames and no hand data are uploaded to ScoreFlip or anyone else. The tracking model (about 8 MB) downloads once, like any other part of a web page.
A video is only made when you press Record. It's created on your device and stays there until you choose to save or share it.
---
It works best in Chrome, Edge or Safari on a laptop or phone.
---
Once you've got the hang of it, test yourself:
Record your best take and tag us @scoreflip. We'd love to see it.
---
The Air Instrument is the fastest way to feel music in your hands. When you're ready for the real notes, the ScoreFlip app turns any song, audio file or photo of sheet music into a playable score. You can play along on the piano with the same 3D hands and practise at your own pace.
Explore more articles on notation scanning, electric keyboards, and gamified music practice in our journal.
Explore All Articles