u/Usual-Emphasis-1950

Hey guys, I've been working on an app and one of It's features is to detect piano chords and notes through the mic. I tried a couple of things, but they all resulted in some drawback that could affect performance. The two things I am aiming for is speed and accuracy. Here's what I tried and why It's didn't feel satisfied with it.

I won't mention the app to respect the No Marketing rule, but will provide context if I felt it was necessary.

1. Spotify's Basic Pitch Open Source detector: While the accuracy was very high, it took around half a second to detect notes.

Here's some context for the next thing I tried. My app is basically a sheet music practice app, in which notes are displayed from an uploaded score or the score repository. Target notes must be played to move on to the next notes.

2. Probabilities + FFT and YIN:

Basically, I set the chances for the right notes to be played to a high degree, and matched it with FFT inputs if multiple notes were played, and YIN if a single note was played (For accuracy). However, while the speed was heavily increased, the accuracy diminished, however, it was still pretty accurate. Most commonly, if an expected note is played, the detector sometimes recognizes the correct note being played, as well as the note an octave under it.

I want some advice about what I could try next to build this detector. I'm aiming for a lag of under 200ms.

I am okay with starting from scratch, or trying a new method.

Hey guys, I created an app that helps users learn songs with either synthesis style falling notes or sheet music called Pianly ( Pianly.org ). I know it's been done before, but usually they turned out to be paid. I'm planning to keep this project open source.

it currently has around 500 classic sheet music already imported, and Im planning on adding more open source music. You can also import your own sheet music too.

Right now it uses MIDI and your microphone (You can choose but it will go to midi once plugged in). Midi is definitely in a better state right now, but I am working on creating a mic detection ML. However, to do so costs money. I'm still debating whether I want to ask for donations or just self fund it. If you guys have any resource recommendations please let me know.

If you guys want to download the app, you can find it at Pianly.org

Feedback will be much appreciated.

Hey guys,

I've been learning piano for about 5 years now (Although I consider it 3.5 years as I took a yearlong break on the second year). While I got through learning theory, fingering, scales, and playing both hands in around 1 year, I feel that progress has significantly slowed. I feel like I'm stuck in the stage where I can play two hands comfortably with single notes, and occasional chords at slower tempos. I currently find myself struggling with chord jumps, finger mobility and speed, however.

What are some tips and strategies to overcome this wall and what are some walls ahead of me?