The pairs are added to a prompt that is used as input into GPT-3, running as a commercial service. Google’s Universal Sentence Encoder is used to find closely matching pairs of old lyrics and new lyrics from the target songwriter, for example, Bob Marley. The system starts by preprocessing lyrics from a database on Kaggle and an olde-time song, for example, “Yes, Sir, That’s My Baby” by Gus Kahn from 1925. Here are the components of the system with an example of how it works.

The heavy lifting for this project is done by GPT-3 to generate the lyrics and Google’s Universal Sentence Encoder to help with pre and post-processing the text. You can join the waitlist to get access to their beta program here. Note that you need an account from OpenAI to run the code. The source code for this project is available on GitHub, and you can experiment with the code using this Google Colab. In the appendix, I will show longer examples of three different songs with three different styles. Next, I’ll walk through the process that I used to transfer the style of lyrics and show the sample output of one song with three different lyrical styles. I’ll start by showing how the main system components are connected together and then go over what GPT-3 is and how it works. I chose to highlight these three recording artists to show a range of styles: Bob Marley’s smooth melodic lines over vintage reggae rhythms, Thom Yorke’s angst-filled ramblings over complex alt-rock patterns, and Megan Thee Stallion’s clever and sexually explicit rapping over sweet hip hop beats. I wanted to see if I could prompt the system to adopt the writing style from one writer and transfer it to another writer’s work.įor this experiment, which I call VoxMorphia, I chos e to transform songs that are in the public domain, including classic tunes like “Yes Sir, That’s My Baby.” Using GPT-3 and some additional open-source projects, I adapted the words of classic songs to be in the lyrical style of Bob Marley, Thom Yorke from Radiohead, Megan Thee Stallion, and 43 other songwriters.

It can create high-quality text given only a few examples. OpenAI’s third-generation transformer, GPT-3, is currently the state-of-the-art model for generating text.

Send it on song