Collaborating on a Composition with AI

Generative Models can be helpful for writing code. Can they also be part of a creative composition process? In this post I will document my experience using NotaGen as a compositional collaborator.

Generative Experiments

The NotaGen Model is a transformer-based model that generates scores in ABC notation. It accepts three parameters to condition score generation: Title, Period, and Composer. First I experimented with the model inputs to generate the scores below.

TODO: Update the element below, per your initial experiment.

Generation Experiment 1

Model Prompt:
  • Period: Fill this in
  • Composer: Fill this in
  • Instrumentation: Fill this in

My Observations

Fill this in. Did the model do what you expected? Document your observations about its performance.

TODO: Generate two (or more) additional scores. Copy/Paste your observations above to document your second and third generative experiments.

My Original Composition

TODO: Find at least one section or part of the generated music that you like. Export the MIDI and use it as source material for an original composition. The exceprt can be as long or short as you want.

TODO: Add your audio file here. Be VERY careful about how you add your audio file to git! You will need to put your audio file in the /website/public/students/your-name/ directory and then update the src attribute of the audioelement to below point to your file. Note that this is NOT in theapp/ directory with the rest of your code.

TODO: Describe your process of creating the original composition. How did using the model help, hinder, or affect your process? Do you think these kinds of models can be helpful for creative endevors?