Hum to Song measures generated backing tracks instead of trusting the prompt
The Hum to Song project aims to ensure a hummed melody appears unchanged in the final song. Its pipeline transcribes the hum into notes, tempo, key and chords, then asks Google's Lyria text-to-music model for a matching backing band. Testing showed the model often ignored the requested tempo, key, chords and intro length. The team therefore stopped relying on the prompt and instead analyzes the returned audio in the browser. The analysis estimates tempo and downbeat positions, detects where the intro ends, and measures the backing's chords to determine any needed transposition, so the melody can be aligned with the band.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in