AR Piano Game

Consider the differences between learning to play a rhythm game (such as osu!) and learning to play a traditional instruments. In my experience, the major differences are that:

  1. the visual and audio stimulus and general juiciness of osu! makes it more satisfying to play.
  2. the instant feedback in osu! telling me when I play right or wrong, as well as the overall performance metrics telling me if I am improving overtime, motivates me to improve and rewards me when I do.
  3. in osu!, it's easy to pick up a new song and play it well since most players learn to sight read by nature of how the game is learned. This makes exploring different songs and genres in osu! a lot easier than in piano. I lack good sightreading skills in piano. So, the process of trying out new pieces is tedius because it often takes more time to learn the piece than what I am willing to put in.

To address #3, I can simply learn to sightread piano better, but I kind of don't want to. Wouldn't it be more fun to turn sheet music into something more like a rhythm game?

The idea is by no means new. This video on music notation by Tantacrul touches on many attempts people have made on changing and improving Western musical notation. However, that is not what I want to do. I am not looking to make something better than what we have now. Instead, I am thinking about something that is probably worse, probably very stupid, but is fun enough of an experience that it makes me want to learn and play a bunch of pieces with it.