Industry

AI / Creative Tools

Client

Prototype

AI-Augmented Piano

An experimental playable instrument involving a piano augemented with a musical AI.

The focus of this project was in creating an AI-assisted (in this case, a musical MIDI-based LLM) instrument that was actually playable. Many instruments that attempt to use AI use it in a very non-interactive and hard-to-play way: either giving the user not enough control, with only a couple of buttons, or providing a non-realtime and unplayable "prompt -> completion" type experience. Our project, on the other hand, keeps the full-spectrum of piano inputs open to the player, and instead attempts to augment what the user plays in realtime (via, amongst other mechanisms, predicting what notes the user will play next, to reduce latency to 0), thus creating an instrument that is both familiar (in it's inputs) and foreign (in the way it adds on to what one would expect from a traditional piano).