Difference between revisions of "COS597b Fall2012"

From CSWiki
Jump to: navigation, search
(General Research Resources)
(General Research Resources)
Line 271: Line 271:
** [http://www.zotero.org/ Zotero] (free)
** [http://www.zotero.org/ Zotero] (free)
** [http://www.mekentosj.com/papers/ Papers]
** [http://www.mekentosj.com/papers/ Papers]
== Resources for Topics Discussed in Class ==
* Recommended books on related topics
** [http://www.amazon.com/Digital-Signal-Processing-Primer-Applications/dp/0805316841 A Digital Signal Processing Primer: With Applications to Digital Audio and Computer Music] by Ken Steiglitz
** [http://www.amazon.com/Music-Cognition-Computerized-Sound-Psychoacoustics/dp/0262531909/ Music, Cognition, and Computerized Sound: An Introduction to Psychoacoustics] by Perry Cook
** [http://www.amazon.com/Electric-Sound-Promise-Electronic-Music/dp/0133032310/ Electric Sound: The Past and Promise of Electronic Music] by Joel Chadabe
* Online resources for sound synthesis
** Students: Add your tutorial links here
* Online resources for music programming environments
* Other?

Revision as of 10:57, 21 September 2012


Welcome to COS 597B, Interactive Music Systems.

The homepage for the course is http://www.cs.princeton.edu/courses/archive/fall12/cos597B/index.php.

We will be using this Wiki to manage the course schedule and readings, and sign up for presentation/discussion leader slots.

Course participants

Add your name here, with link to your webpage if you want:

  • Rebecca Fiebrink, instructor
  • Edward Zhang '13
  • Jeff Snyder '13
  • Avneesh Sarwate '14
  • Joe Tylka, first year grad student
  • Reid Oda, second year grad student
  • Rahulram Sridhar, G1
  • Katie Wolf, second year grad student
  • Sasha Koruga, G2
  • Ohad Fried, first year grad
  • Abu Saparov '13
  • Danielle Bragg, second year grad student
  • Daniel Ryan '13
  • Alejandro Van Zandt-Escobar, CS '14
  • Zeerak Ahmed '13
  • Nikitas Tampakis '14
  • Jennifer Guo, first year grad
  • Tobe Nwanna, G2


  • 13 September: First day!
    • Course overview & introduction
    • A brief history of computers in music composition, performance, listening, and scholarship
    • Assignment 0, due 9/18:
      • Sign up for Piazza
      • If there are any other course management tools for blogging, discussion, Q&A, etc. that you would like to use, say so! (e.g., using a Piazza post)
      • Read through the course syllabus and get in touch with any questions you have.
      • Get a Princeton CS Wiki account by e-mailing csstaff@cs.princeton.edu (CC fiebrink@cs.princeton.edu); say you're requesting an account to use to edit the course Wiki site.
      • Add your name (and possibly homepage) to the list of participants above.
      • Familiarize yourself with research paper reading & discussion leading resources at the bottom of the wiki.
      • Sign up for at least one or two discussion leader slots, for one tutorial slot for 9/20, and possibly also for slots for 5-minute lightning presentations for "System/Work of the Day."
      • And, of course, do the reading & response for the next class! Readings will be discussed the day they show up on the schedule. Reading responses are due at 8am that day.
  • 18 September: Introduction to digital sound and music
    • Tutorial: Physics, perception, and digital representations of sound and music
      • Leader: Rebecca
    • Reading: Music and Computers, Chapters 1 and 2
    • Assignment 1, due 9/20: Post on Piazza one example of interactive computer/technology used in live performance (could be a software program, a digital instrument or controller, a performance, ...). Choose something you find exciting or inspiring. Provide a URL and/or citation. Describe how the technology works (at a high level) and how the human(s) interact with the technology. What do you find exciting about it? Any problems you see with it, or criticisms you might offer (including aesthetic or technical concerns)? How does the technology impact or constrain the type of interaction that is possible, and the type of music that is possible or easy to make?
      • (Post publicly on Piazza, use hashtag #assignment1.)
  • 20 September: Synthesis algorithms & brief history of live electronic music
    • Tutorials: 5-minute lightning tutorials on synthesis methods
      • Tutorial leaders: sign up below. You can use slides, chalkboard, whatever you want. Please provide some URLs/references for people to find more information. Please also play some sound examples in your presentation.
      • Additive synthesis: Katie Wolf
      • Subtractive synthesis: Jeff Snyder
      • Granular synthesis: Alejandro Van Zandt-Escobar
      • Wavetable synthesis: Rahulram Sridhar
      • Physical modeling synthesis: Ohad
      • Waveshaping synthesis: Reid Oda
    • Reading: Nicolas Collins, "Live electronic music" (Chapter 3 of The Cambridge Companion to Electronic Music, 2011)
    • If time permits, in-class discussion of Assignment 1
    • Assignment 2, due 10/2: Choose two or more synthesis methods to experiment within a music programming environment of your choosing. (Suggestions: Max/MSP, pd (a free Max/MSP-like environment), ChucK, SuperCollider, ???). Post a thoughtful critique of the methods to Piazza, considering the quality of sounds that you can produce with a given method, the ease with which you can control the method, and any other characteristics that might influence someone's choice of whether to use the method in a performance or composition.
      • If you've never used an audio programming environment before and want some tips, just post to Piazza. Feel free to start with existing code & tutorials on the internet. Feel free to share code and programming tips with one another, but do the experimentation and response individually.
  • 25 September: Music synthesis and programming environments
    • Tutorials: 5-minute lightning tutorials on music programming environments
      • Max/MSP: Joe Tylka
      • pd: Edward
      • chuck: Sasha
      • supercollider: Danielle
    • Reading 1: Chris Chafe, "A Short History of Digital Sound Synthesis by Composers in the United States"
      • Response link: TODO
      • Discussion leader: Alejandro Van Zandt-Escobar
    • Reading 2: Ge Wang, "A history of programming and music"
      • This is another chapter of The Cambridge Companion to Electronic Music. See online access instructions above.
      • Discussion leader: Daniel Ryan
      • Response link: TODO
  • 27 September: Introduction to Gestural Control of Sound
    • System/Work of the day: Alejandro Van Zandt-Escobar - Serato Live
    • Read: Bert Bongers, "Physical Interfaces in the Electronic Arts"
      • Discussion leader: Nikitas Tampakis
      • Response link: TODO
    • Read: Wanderley and Depalle, "Gestural Control of Sound Synthesis".
      • Discussion leader: Rahulram Sridhar
      • Response link: TODO
    • Assignment 3, due 10/9: Create a gesturally-controlled "instrument" that allows you to interactively control sound in real-time. Use an explicit mapping strategy that you program in whatever environment(s) you choose to use (i.e., no machine learning). Reflect on what was easy and hard to do in creating the mapping, what you found rewarding or frustrating about the process, and the process by which you chose the mapping you did. Submit your response on Piazza.
      • Feel free to build on any of your previous assignments. Easy-to-use controllers include the built-in laptop inputs (see http://www.smelt.cs.princeton.edu), the Wiimote (OSCulator is recommended if you're on a Mac), or joysticks (we have some you can borrow).
      • OpenSoundControl (TODO) is a good tool for patching together code in different environments, e.g. if you want to use Smelt to capture motion sensor input and send it to pd, or if you want a ChucK program to receive Wiimote messages from OSCulator. Google for OSC examples for the languages you're using, and or post to piazza and get others to share their code with you.
  • 2 October: Musicology crash-course on Fauvel
    • Assignment 2 due
    • System/Work of the day: Sasha
    • Guest lecturer: Anna Zayaruznaya (Music @ Princeton)
    • Reading: TBA
      • No discussion leader needed
      • Response: TBA
  • 4 October: Meeting with Fauvel seminar: Mise en Page

Tentative further schedule

Schedule from this point on is still tentative!

  • 9 October: Mappings for digital musical instruments
    • Brief discussion on Fauvel
    • Read: Wanderley on evaluation of mappings
      • Discussion leader: Katie Wolf
    •  ? Read: Tanaka?
      •  ? Discussion leader: ???
    • Tutorial: 5-to-10-minute overviews of computational methods for mapping creation
      • Neural networks (Lee, Freed, and Wessel?)
      • MnM toolkit?
      • Mapping n-dimensional to...
      • DTW (Merril)
    • Tutorial/demo on Wekinator
      • Leader: Rebecca
    • Supplemental material:
    • System/Work of the day:
    • Assignment: Due 10/18: Build at least one gesturally-controlled instrument using Wekinator, with the controller(s) and synthesis method of your choosing. Reflect on what was easy, what was difficult, and how you might improve the software. Also reflect on how the experience of building with Wekinator compared to your previous assignment of building a mapping explicitly using programming.</b>
  • 11 October: Computational methods for gesture analysis
    • Read: Gesture Follower (TODO: Add link)
      • Discussion leader: Rahulram Sridhar
    • Supplemental material:
    • System/Work of the day:
  • 16 October: Composers on instrument building
    • Read: ?? Composing the instrument?
    • Read: Chadabe on mapping
    • Read: Wessel: Problems and prospects
      • Discussion leader: Alejandro Van Zandt-Escobar
    • Supplemental material:
    • System/Work of the day: ???
  • 18 October: Wekinator
    • Read: Wekinator papers (NIME + composers)
      • Discussion leader: Jennifer Guo
    • System/Work of the day: ???
  • 23 October
    • Read:
    • Read:
    • Discussion leader: Sasha Koruga
    • Supplemental material:
    • System/Work of the day: Rahulram Sridhar
  • 30 October and 1 November: Fall break
  • 4 November: Written project proposals due
  • Week of 5 November: Schedule a 30-minute meeting to discuss your project proposal
  • 6 November: Either live coding or networked performance?
    • Read:
    • Read:
    • Discussion leader:
    • Supplemental material:
    • System/Work of the day:
  • 8 November:
    • Read:
    • Read:
    • Discussion leader:
    • Supplemental material:
    • System/Work of the day:
  • 13 November:
    • Read:
    • Read:
    • Discussion leader:
    • Supplemental material:
    • System/Work of the day:
  • 15 November: Laptop orchestras
      • Leaders: ??? (Could be 1-3 people)
    • Read: Why a laptop orchestra?
      • Discussion leader:???
    • Read: Wicked problems for laptop orchestras
      • Discussion leader: ???
    • Supplemental material:
    • System/Work of the day:
  • 20 November (May merge with another class or two?): Other collaborative / social systems
    • Tutorial: Overview of music production process and tools
    • Essl?
    • Networked performance?
    • Robots?
    • Smule apps?
    • Collaborative instruments?
    • System/Work of the day:
  • 22 November: Thanksgiving, no class
  • 27 November: Music production
    • Read: Pardo
      • Discussion leader: ???
    • Read: Duignan
      • Discussion leader: Joe Tylka
    • System/Work of the day:
  • 29 November: Interaction with music recommendation systems
    • Read: Kulesza
      • Discussion leader: ???
    • Read: ???
    • System/Work of the day:
  • Week of 3 December: Schedule a 30-minute meeting to discuss your project progress
  • 4 December: Revisiting interactive systems in music scholarship
    • Read: ???
      • Discussion leader: ???
    • Supplemental material:
    • System/Work of the day:
  • 6 December: "Creativity support tools" in HCI
    • Read: Shneiderman, Resnick, et al. on creativity support tools
      • Discussion leader: Danielle
    • Read: Latulipe et al
      • Discussion leader: ???
    • Supplemental material:
    • System/Work of the day:
  • 11 December: Grab bag topics ???
    • Read:
    • Read:
    • Discussion leader:
    • Supplemental material:
    • System/Work of the day:
  • 13 December: Grab bag topics ???, wrap-up discussion
    • Read:
    • Read:
    • Discussion leader:
    • Supplemental material:
    • System/Work of the day:

  • 8 January
    • Final project presentations
  • 10 January
    • Final project presentations
  • 15 January: Dean's date, final paper due (+ code, presentation slides, other materials)

Tutorial topics

  • Possible topic overviews:
    • Programming tools (Max/MSP, ChucK, SuperCollider, ?)
    • Music production / studio tools & practices (e.g., Logic demo; overview of editing, mixing, mastering processes)
    • BCIs & biosignals for music
    • ML tools (e.g., Marsyas, Wekinator, Gesture Follower)
    • Sound synthesis methods (e.g., additive, wavetable, waveshaping?, subtractive?, physical modeling, FM, granular) (high-level overview)
    • Summarize the state-of-the-art regarding gesture analysis for conducting analysis, dance (e.g., Laban analysis), or ancillary gestures of instrumentalists.
    • Kinect basics (how it works, how to program for it)
    • Basic real-time audio processing methods (not synthesis) (e.g., vocoders, Autotune, other live effects) ?
    • Summarize state-of-the-art regarding audio analysis of some sort (e.g., onset detection, beat tracking, pitch tracking)
    • Summarize state-of-the-art regarding MIR topics (e.g., recommendation, tagging, playlist generation, collection visualization)
  • Possible technical overviews:
    • Digital audio (representation of audio in a computer, sampling & quantizing, Nyquist's theorem)
    • Audio feature extraction
    • Machine learning topics: classification, neural networks, graphical models
    • HMMs, DTW
    •  ??

Possible "cool systems" to highlight

  • Reactable
  • Theremin
  • Ondes Martenot
  • The Hands
  • George Lewis' Voyager
  • Monome
  • The Continuator
  •  ???

General Research Resources

Resources for Topics Discussed in Class