AI Hype is everywhere! Major tech companies are betting on AI and offering annual salaries in the hundreds of millions to AI researchers.
AI Scorn is everywhere too. Detractors point to the environmental costs, ethical implications, and technical limitations of generative AI.
So which is it? Over-hyped purveyor of AI Slop? Or impending economic revolution posing a real threat to artists, musicians, and anyone not poised to benefit from the success of major tech companies? Can it be both?
Generative models can be very helpful for writing code, especially for beginners who want to learn fast. Can they also be useful for other artistic practices? Will they be useful in the future? Learn to see through the hype and make your own informed opinions about the utility, trajectory, and ethics of modern generative AI.
In this class, you will:
- Build understanding by studying how the generative models work "under the hood"
- Contrast the strengths and weaknesses of different modalities: Image, Music, and Code to understand where these technologies are headed and what they are likely to mean for artists in the future.
- Explore research and criticism of Generative AI
- Build a portfolio of content and reflections that expose AI strengths and weaknesses
- Learn to identify pitfalls in Generative AI
- Develop an informed critical take on the utility and ethics of generative AI
Topics We will Cover
Students will start with code generation and learn to write better code faster using AI tools. We will use the efficacy of coding tools as a benchmark to evaluate the value and trajectory of generative AI for music and image modalities.
Each week will introduce a new topic, and work on an introductory lab exercise. Each lab and assignment is a possible starting point to expand on in the mid-term and final projects.
- Hands on: Tools for agentic code generation
- Hands on: Symbolic Music Generation
- Research Review: Can models "reason"?
- Ethics: TESCREAL
- Ethics: AI and the Environment
- Mid-term project!
- Theory: Transformers
- Theory and Practice: Music Generation
- Theory: Diffusion
- Theory and practice: Model internals and Comfy-UI
- Theory and practice: Image Gen – On-device and in the cloud
- Hands on: Video Games
- Final project!
AI is changing fast! The exact make-up of this list may change subtly to keep up with important developments in the field.