AI Piano App RollTab Generates Continuations From MIDI Input
RollTab's approach differs from typical audio generation AI by processing MIDI event data directly, which the developer says allows fast, live-performance-speed responses on an iPhone.
Reporting from 1 source: GIGAZINE.
Developer Simon Edwardson launched RollTab, a free iPhone and iPad app that uses a Transformer-based AI model with 125 million parameters to generate continuations of piano performances. The app records MIDI keyboard input, then produces a continuation in under two seconds. Edwardson trained the model on public domain classical music.
RollTab is available free on the App Store for iPhone and iPad. To use it, a MIDI keyboard connects to the smartphone, and the performance is recorded on screen. When the player stops, the AI generates a continuation from the recorded melody, taking less than two seconds in the demo Edwardson released.
Edwardson trained the model himself. The system handles MIDI files, which store music as a series of events such as key presses, releases, sustain pedal state, and instrument changes, rather than recorded sounds. The project focused on piano, so other materials were removed or reduced.
The adopted representation, called NOTE(pitch, delta_onset, duration, velocity), advances the music one note at a time. Edwardson reports a processing speed of about 108 notes per second for a large model even on an iPhone, exceeding the speed needed for live human performance. The sustain pedal was folded into note duration to simplify the model.
Synthesized by Yomimono from the 1 cited source below, including Japanese-language reporting where cited, then editorially reviewed before publishing.
Sources
- GIGAZINE ピアノ演奏の続きをAIで自動生成できるアプリ「RollTab」が登場