Hi everyone! Building Orfeo — a live sheet music app that follows pianists directly through the microphone. Live
Travelby Fizbo2026-09-16
Hi everyone!
Building Orfeo — a live sheet music app that follows pianists directly through the microphone.
Live acoustic score following is notoriously noisy: room acoustics, mic placement, and physical dynamics create an unpredictable audio signal where traditional DSP struggles with edge cases (taking repeats, skipping bars, restarting). While standard LLMs could help arbitrate these messy ambiguities, they are far too slow and costly to run inside a live 50 ms loop.
I want to plug Jev into my automated testing harness. Because I play on an acoustic Yamaha Silent piano, my bench captures the exact real-world acoustic environment alongside the mechanical ground truth:
Raw iPad mic audio (the noisy acoustic reality in the room)
Yamaha Silent optical MIDI strip (ground truth of physical keys pressed on the acoustic action)
MusicXML score (ground truth of written notation)
Benchmarking fast, typed decisions against these three
Links