Research

12-channel array with dodecahedral symmetry120-channel array with icosahedral symmetry The CNMAT research team brings scientific and engineering tools and resources bear on musical problems and issues. Our particular emphasis is new performance technology and performance-related research issues and problems such as real-time synthesis and control.

Areas of Research

  • Sound analysis for event detection, pitch and noise estimation and auditory perceptual models
  • New sensor technologies including sensor fusion, inertial sensing, conductive/resistive fibre and malleable media
  • Digitizing tablets, multitouch and manytouch surfaces
  • High-bandwidth high-precision and low-latency connectivity for audio and gesture data over ethernet using custom FPGA-based connectivity processors
  • Machine learning applications in audio synthesis and musical control
  • Parallel computing in real-time contexts
  • Theoretical and applied spatial acoustics of loudspeaker and microphone arrays, especially in spherical configurations
  • Auditory psychophysics and music cognition
  • Hearing augmentation and restoration for music listening
  • Semantics, requirements and cognitive models of music performance and their implications for software design patterns
  • Development of software tools including Open Sound World, MaxMSP.
  • Protocol and format development including Open Sound Control (OSC) and the Sound Description Interchange Format (SDIF)

Research Publications

The following is a comprehensive bibliography of CNMAT publications. For many of our publications full-text and PDF formats are provided, as well as links to automatically find the publication in your local library.

2007
CNMAT Information Infrastructure, Schmeder, Andrew; Wright, Matthew; Freed, Adrian; Campion, Edmund; Wessel, David , International Computer Music Conference, 27/09/2007, Volume 1, Copenhagen, Denmark, p.325-328, (2007)   Abstract | PDF
Real-time Analysis of Sensory Dissonance, MacCallum, John; Einbond, Aaron , International Computer Music Conference, 27/08/2007, Copenhagen, Denmark, (2007)   Abstract
Harmonic Expectation and Affect in Western Music: Effects of Attention and Training, Loui, Psyche; Wessel, David , Perception & Psychophysics, 10/2007, Volume 69, Issue 7, p.1084-1092, (2007)   Abstract | PDF
Modal Parameter Tracking for Shape-Changing Geometric Objects, Maxwell, C. B.; Bindel, D. , Proc. of the 10th Int. Conference on Digital Audio Effects (DAFx-07), 10/09/2007, Bordeaux, France, (2007)   Abstract | PDF
A Force Sensitive Multi-touch Array Supporting Multiple 2-D Musical Control Structures, David Wessel; Rimas Avizienis; Adrian Freed; Matthew Wright , New Interfaces for Musical Expression, 07/06/2007, New York, p.41-45, (2007)   Abstract | PDF
Ten Years of Tablet Musical Interfaces at CNMAT, Michael Zbyszynski; Matthew Wright; Ali Momeni; Daniel Cullen , New Interfaces for Musical Expression, 07/06/2007, New York, p.100-105, (2007)   Abstract | PDF
Optimizing Hearing Aids for Music Listening, Wessel, David; Fitz, Kelly; Battenberg, Eric; Schmeder, Andrew; Edwards, Brent , 19th International Congress on Acoustics, 02/09/2007, Madrid, Spain, (2007)   Abstract | PDF
Perceiving new music recruits flexible neural mechanisms, Loui, Psyche; Wessel, David; Wu, E.H.; Knight, R.T. , Cognitive Neuroscience Society, p.48, (2007)
2006
Active Damping Of A Vibrating String, Berdahl, Edgar J.; Smith III, Julius O.; Freed, Adrian , 6th International Symposium on Active Noise and Vibration Control, 2006/09/18, Adelaide, Australia, (2006)   Abstract | PDF
Timbre as a Psychoacoustic Parameter for Harmonic Analysis, MacCallum, John; Einbond, Aaron , Rocky Mountain Society for Music Theory, 2006/03/31, Denver, CO, p.N/A, (2006)   Abstract
Convergent Voices: Perception in Lutoslawski, Berio, Boulez, Einbond, Aaron , 6th annual GAMMA-UT conference, 2006/03/25, University of Texas at Austin, p.no publication, (2006)   Abstract
An Enactive Approach to Computer Music Performance, Wessel, David , Le Feedback dans la Creation Musical, Lyon, France, p.93-98, (2006)   Abstract | PDF
Attentional Fluctuations Across Frequency and Amplitude: a Dual-Task Study, Loui, Psyche; Wessel, David , Cognitive Neuroscience Society (Poster Presentaton), San Francisco, California, p.84, (2006)   Abstract
Acquiring New Musical Grammars: a Statistical Learning Approach, Loui, Psyche; Wessel, David , 9th International Conference for Music Perception and Cognition, Bologna, Italy, p.1009-1017, (2006)   Abstract | PDF
Acquiring New Musical Grammars: a Statistical Learning Approach, Loui, Psyche; Wessel, David; Kam, Carla Hudson , 28th Annual Conference of the Cognitive Science Society, Vancouver, Canada, p.1711-1716, (2006)   Abstract | PDF
A Compact 120 Independent Element Spherical Loudspeaker Array with Programmable Radiation Patterns, Avizienis, Rimas; Freed, Adrian; Kassakian, Peter; Wessel, David , Audio Engineering Society 120th Convention, Paris, France, p.Convention Paper No. 6783, (2006)   Abstract | Full-Text
Augmenting the Cello, Freed, Adrian; Uitti, Frances-Marie; Wessel, David; Zbyszynski, Michael F. , International Conference on New Interfaces for Musical Expression, Paris, France, p.409-413, (2006)   Abstract | Full-Text
Beyond 0-5V: Expanding Sensor Integration Architectures, Freed, Adrian; Avizienis, Rimas; Wright, Matthew , International Conference on New Interfaces for Musical Expression, Paris, France, p.97-100, (2006)   Abstract | Full-Text | PDF
Convex Approximation with Applications in Magnitude Filter Design and Beamforming, Kassakian, Peter , EECS, Berkeley, CA, (2006)
Music MetaData Quality: a multiyear Case Study using the Music of Skip James, Freed, Adrian , AES 121, San Francisco, CA, (2006)   Abstract | Full-Text
Shape Changing Symmetric Objects for Sound Synthesis, Bruyns, Cynthia; Bindel, David , AES 121, San Francisco, CA, (2006)   Abstract
2005
Open Sound Control: an enabling technology for musical networking, Wright, Matthew , Organised Sound, 2005/12/01, Volume 10, Issue 3, p.193-200, (2005)   Abstract | PDF
Timbre as a Psychoacoustic Parameter for Harmonic Analysis and Composition, MacCallum, John; Hunt, Jeremy; Einbond, Aaron , International Computer Music Conference, 2005/09/05, Barcelona, Spain, p.825-828, (2005)   Abstract
Automated Music Analysis Using Dynamic Graphical Models, Vogel, Brian K. , EECS, Berkeley, CA, p.131, (2005)   Abstract | PDF
Combining Audio And Gestures For A Real-Time Improviser, Morales-Mazanares, Roberto; Morales, Eduardo F.; Wessel, David , International Computer Music Conference, Barcelona, Spain, p.813-816, (2005)   Abstract | PDF
Control of VST Plug-ins Using OSC, Zbyszynski, Michael F.; Freed, Adrian , International Computer Music Conference, Barcelona, Spain, p.263-266, (2005)   Abstract | Full-Text
Harmonic Expectation, Selective Attention, and Affect in Music, Loui, Psyche; Wessel, David , Neuroscience and Music Conference, Leipzig, Germany, (2005)   Abstract
Magnitude Least--Squares Fitting via Semidefinite Programming with Applications to Beamforming and Multidimensional Filter Design, Kassakian, Peter , IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, Pennsylvania, (2005)   Abstract | PDF
Multi-Instrument Musical Transcription Using Dynamic Graphical Model, Vogel, Brian K.; Jordan, Michael I.; Wessel, David , IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, PA, USA, p.493-496, (2005)   Abstract | PDF
Optimal Positioning in Low-dimensional Control Spaces using Convex Optimization, Kassakian, Peter; Wessel, David , International Computer Music Conference, Barcelona, Spain, p.379-382, (2005)   Abstract | PDF
Open-Source Matlab Tools for Interpolation of SDIF Sinusoidal Synthesis Parameters, Wright, Matthew; Smith III, Julius O. , International Computer Music Conference, Barcelona, p.632-635, (2005)   Abstract | PDF
Structuring timbre in an octatonic context: the music of Bohuslav Martinu, Ho, Hubert , Music Theory Society of New York State, New York, NY, (2005)   Abstract
Structuring timbre in an octatonic context: the music of Bohuslav Martinu, Ho, Hubert , Music Theory Southeast, Miami, FL, (2005)
2004
A Query System for Open Sound Control, Schmeder, Andrew W.; Wright, Matthew , OpenSoundControl Conference, 2004/07/30, Berkeley, CA, (2004)   Abstract | PDF
Brief overview of OSC and its application areas, Wright, Matthew , OpenSoundControl Conference, 2004/07/30, Berkeley, CA, (2004)
OSC Design Space, Freed, Adrian , Open Sound Control Conference, 2004/07/30, Berkeley, CA, (2004)
OSC Control of VST Plug-ins, Freed, Adrian; Zbyszynski, Michael F. , Open Sound Control Conference, 2004/07/30, Berkeley, CA, (2004)   Abstract | PDF
Towards a More Effective OSC Time Tag Scheme, Freed, Adrian , Open Sound Control Conference, 2004/07/30, (2004)
Audio and Gesture Latency Measurements on Linux and OSX, Wright, Matthew; Cassidy, Ryan J.; Zbyszynski, Michael F. , International Computer Music Conference, Miami, FL, p.423-429, (2004)   Abstract | PDF
Characterization of Spherical Loudspeaker Arrays, Kassakian, Peter; Wessel, David , 117th Audio Engineering Society Convention, San Francisco, CA, p.Convention paper #1430, (2004)   Abstract | PDF
Mapping Spectral Frames to Pitch with the Support Vector Machine, Schmeder, Andrew W. , International Computer Music Conference, Miami, FL, p.664-667, (2004)   Abstract | PDF
Max/MSP Programming Practice with OSC, Wessel, David , Open Sound Control Conference, Berkeley, CA, (2004)
Music Perception and Cognition Experiments in a Classroom Setting: Temporally Precise Hardware and Software., Wessel, David; Loui, Psyche; Jacobs, Benjamin; Avizienis, Rimas , 8th International Conference on Music Perception and Cognition, Evanston, Illinois, p.642, (2004)
OSC and Gesture features of CNMAT's Connectivity Processor, Avizienis, Rimas; Freed, Adrian , Open Sound Control Conference, Berkeley, CA, (2004)
Panel: Standards from the Computer Music Community, Wright, Matthew; Dannenberg, Roger; Pope, Stephen; Rodet, Xavier; Serra, Xavier; Wessel, David , International Computer Music Conference, Miami, FL, p.711-714, (2004)   Abstract | PDF
2003
Characterizing and Controlling Musical Material Intuitively with Geometric Models, Momeni, Ali; Wessel, David , Proceedings of the 2003 Conference on New interfaces for Musical Expression, Montreal, Canada, p.54-62, (2003)   Abstract | PDF
Design of Low-Order Filters for Radiation Synthesis, Kassakian, Peter; Wessel, David , 115th Audio Engineering Society Conventtion, New York, NY, p.Convention Paper 5925, (2003)   Abstract | PDF
Open Sound Control: State of the Art 2003, Wright, Matthew; Freed, Adrian; Momeni, Ali , International Conference on New Interfaces for Musical Expression, Montreal, p.153-159, (2003)   Abstract | PDF
2002
Synopsis of reverberation enhancement systems, Warusfel, Olivier; Blauert, Jens; Wessel, David , Proceedings of the 3rd European Congress on Acoustics, 2002/09/16, Sevilla, Spain, (2002)   Abstract | PDF
Problems and Prospects for intimate and satisfying sensor-based control of computer sound, Wright, Matthew , Symposium on Sensing and Input for Media-Centric Systems (SIMS), 2002/06/20, Santa Barbara, CA, p.1-6, (2002)   Abstract | PDF
Center for New Music and Audio Technologies (CNMAT): Studio Report, Andrews, Richard , International Computer Music Conference, Göteborg, Sweden, p.440-443, (2002)
Intimate Musical Control of Computers with a Variety of Controllers and Gesture Mapping Metaphors, Wessel, David; Wright, Matthew; Schott, John , International Conference on New Interfaces for Musical Expression (NIME), Dublin, Ireland, p.171-173, (2002)   Abstract | PDF
Live interactive computer music and performance practice, Wessel, David , Journal of the Acoustical Society of America, Volume 3, Issue 5, p.2348-2348, (2002)   PDF
Open Sound World, Chaudhary, Amar , (2002)
OpenSound Control Specification, Wright, Matthew , (2002)
Problems and Prospects for Intimate Musical Control of Computers, Wessel, David; Wright, Matthew , Computer Music Journal, Volume 26, Issue 3, p.11-22, (2002)   Abstract | PDF
Situated Trio: An Interactive Live Performance for a Hexaphonic Guitarist and Two Computer Musicians with Expressive Controllers, Wessel, David; Wright, Matthew; Schott, John , International Conference on New Interfaces for Musical Expression (NIME), Dublin, Ireland, p.171-173, (2002)   Abstract | Full-Text | PDF
2001
CNMAT Studio Report, Andrews, Richard , International Computer Music Conference, Habana, Cuba, p.393-396, (2001)   Full-Text | PDF
Controlling Loudspeaker Array Radiation in Three Dimensions, Baird, Justin; Meyer, John; Meyer, Perrin; Kassakian, Peter; Wessel, David , 111th Audio Engineering Society Convention, New York, NY, p.Convention Paper, (2001)
Listener Evaluation of Reduction Strategies for Sinusoidal and Resonance Models, Chaudhary, Amar; Wessel, David; Rowe, Lawrence A. , International Computer Music Conference, Habana, Cuba, p.227-230, (2001)
Managing Complexity with Explicit Mapping of Gestures to Sound Control with OSC, Wright, Matthew; Freed, Adrian; Lee, Ahm; Madden, Timothy; Momeni, Ali , International Computer Music Conference, Habana, Cuba, p.314-317, (2001)   Full-Text | PDF
Preparation for Interactive Live Computer Performance in Collaboration with a Symphony Orchestra, Madden, Timothy; Smith, Ronald Bruce; Wright, Matthew; Wessel, David , International Computer Music Conference, Habana, Cuba, p.310-313, (2001)   Full-Text | PDF
Problems and Prospects for Intimate Musical Control of Computers, Wessel, David; Wright, Matthew , ACM Computer-Human Interaction Workshop on New Interfaces for Musical Expression, Seattle, WA, (2001)   Abstract | PDF
2000
Analysis/Synthesis Comparison, Wright, Matthew; Beauchamp, James; Fitz, Kelly; Rodet, Xavier; Röbel, Axel; Serra, Xavier; Wakefield, Gregory , Organised Sound, 2000/12/01, Volume 5, Issue 3, p.173-189, (2000)   Abstract | PDF
An Open Architecture for Real-time Music Software, Chaudhary, Amar; Freed, Adrian; Wright, Matthew , International Computer Music Conference, Berlin, Germany, p.492-495, (2000)   Abstract | PDF
A New Music Keyboard featuring Continuous Key-position Sensing and High-speed Communication Options, Freed, Adrian; Avizienis, Rimas , International Computer Music Conference, Berlin, Germany, p.515-516, (2000)   Abstract | PDF
An XML-based SDIF Stream Relationships Language, Wright, Matthew; Chaudhary, Amar; Freed, Adrian; Khoury, Sami; Wessel, David; Momeni, Ali , International Computer Music Conference, Berlin, Germany, p.186-189, (2000)   Abstract | PDF
Center for New Music and Audio Technologies (CNMAT): Studio Report, Andrews, Richard , International Computer Music Conference, Berlin, Germany, p.417-420, (2000)   Abstract | PDF
Extensions and Applications of the SDIF Sound Description Interchange Format, Schwarz, Diemo; Wright, Matthew , International Computer Music Conference, Berlin, Germany, p.481-484, (2000)   Abstract | PDF
Generic Panning Tools for MAX/MSP, Pulkki, Ville , International Computer Music Conference, Berlin, Germany, (2000)   PDF
Musical Applications of New, Multi-axis Guitar String Sensors, Freed, Adrian; Isvan, Osman , International Computer Music Conference, Berlin, Germany, p.543-546, (2000)   Abstract | PDF
Music as HandWerk, the middle way between Vorhandenheit and Zuhandenheit, Richard, Dominique , International Computer Music Conference, Berlin, Germany, p.5-7, (2000)   Abstract | PDF
Scalable Connectivity Processor for Computer Music Performance Systems, Avizienis, Rimas; Freed, Adrian; Suzuki, Takahiko; Wessel, David , International Computer Music Conference, Berlin, Germany, p.523-526, (2000)   Abstract | PDF
1999
A Fixed-Point Recursive Digital Oscillator for Additive Synthesis of Audio, Hodes, Todd; Hauser, J.; Freed, Adrian; Wawrzynek, John; Wessel, David , IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 1999/03/01, Phoenix, AZ, (1999)   Abstract | PDF
An Open Architecture for Real-Time Audio Processing Software, Chaudhary, Amar; Freed, Adrian; Wright, Matthew , Audio Engineering Society 107th Convention,, New York, NY, p.preprint #5031, (1999)   Abstract | PDF
Audio Applications of the Sound Description Interchange Format Standard, Wright, Matthew; Chaudhary, Amar; Freed, Adrian; Khoury, Sami; Wessel, David , Audio Engineering Society 107th Convention, p.preprint #5032, (1999)   Abstract | PDF
Application of FPGA's to Musical Gesture Communication and Processing, Lindlbauer, Norbert , (1999)
Bidirectional AES/EBU Digital Audio and Remote Power over a Single Cable, Freed, Adrian , Audio Engineering Society 107th Convention, New York, NY, (1999)   Abstract | Full-Text
Cross-Coding SDIF into MPEG-4 Structured Audio, Wright, Matthew; Scheirer, Eric , International Computer Music Conference, Beijing, China, p.589-596, (1999)   Abstract | Full-Text
Exploration of Timbre by Analysis Synthesis, Risset, Jean-Claude; Wessel, David , The Psychology of Music, San Diego, p.113-169, (1999)
Gestural Control of a Real-Time Physical Model of a Bowed String Instrument, Serafin, Stefania; Dudas, Richard; Wanderley, Marcelo M.; Rodet, Xavier , International Computer Music Conference, Beijing, China, p.375-378, (1999)   PDF
Musical Applications of New Filter Extensions to Max/MSP, Jehan, Tristan; Freed, Adrian; Dudas, Richard , International Computer Music Conference, Beijing, China, p.504-507, (1999)   Abstract | Full-Text
Spectral Line Broadening with Transform Domain Additive Synthesis, Freed, Adrian , International Computer Music Conference, Beijing, China, p.78-81, (1999)   Abstract | Full-Text
Second-order recursive oscillators for musical additive synthesis, Hodes, Todd; Freed, Adrian , International Computer Music Conference, Beijing, China, p.74-77, (1999)   Abstract | Full-Text
Supporting the Sound Description Interchange Format in the Max/MSP Environment, Wright, Matthew; Khoury, Sami; Wang, Raymond; Zicarelli, David , International Computer Music Conference, Beijing, China, p.182-185, (1999)   Abstract | PDF
SDIF (Sound Description Interchange Format) Specification, Wright, Matthew , (1999)
The Center for New Music and Audio Technologies (CNMAT): Studio Report, Andrews, Richard , International Computer Music Conference, Beijing, China, p.569-572, (1999)   Abstract | Full-Text
Visualization, Editing and Spatialization of Timbral Resources using the OSE Framework, Chaudhary, Amar; Freed, Adrian , Audio Engineering Society 107th Convention, New York, NY, p.preprint #5027, (1999)   Abstract | PDF
Volumetric Modeling of Acoustic Fields for Musical Sound Design in a New Sound Spatialization Theatre, Kaup, Arnold; Freed, Adrian; Khoury, Sami; Wessel, David , International Computer Music Conference, Beijing, China, p.488-491, (1999)   Abstract | Full-Text
1998
A 3D Graphical User Interface for Resonance Modeling, Chaudhary, Amar; Freed, Adrian; Khoury, Sami; Wessel, David , International Computer Music Conference, Ann Arbor, Michigan, (1998)   Abstract | PDF
A Direct Adaptive Window Size Estimation Procedure for Parametric Sinusoidal Modeling, Irizarry, Rafael , International Computer Music Conference, University of Michigan, Ann Arbor, (1998)   Abstract | PDF
An Improvisation Environment for Generating Rhythmic Structures Based on North Indian "Tal" Patterns, Wright, Matthew; Wessel, David , International Computer Music Conference, Ann Arbor, Michigan, p.125-128, (1998)   Abstract | Full-Text
Band-Limited Simulation of Analog Synthesizer Modules by Additive Synthesis, Chaudhary, Amar , Audio Engineering Society 104th Convention, San Francisco, CA, (1998)
Communication of Musical Gesture using the AES/EBU Digital Audio Standard, Freed, Adrian; Wessel, David , International Computer Music Conference, Ann Arbor, Michigan, p.220-223, (1998)   Abstract | Full-Text
CAST: CNMAT's Additive Synthesis Tools, Freed, Adrian; Wright, Matthew , (1998)
Implementation and Performance Issues with OpenSound Control, Wright, Matthew , International Computer Music Conference, Ann Arbor, Michigan, p.224-227, (1998)   Abstract | Full-Text
Music Programming with the new Features of Standard C++, Freed, Adrian; Chaudhary, Amar , International Computer Music Conference, Ann, Arbor, Michigan, p.244-247, (1998)   Abstract | Full-Text
Microstructures of Feel, Macrostructures of Sound: Embodied Cognition in West African and African-American Musics, Iyer, Vijay , Technology and the Arts in the Graduate Division, Berkeley, (1998)
New Applications of the Sound Description Interchange Format, Wright, Matthew; Chaudhary, Amar; Freed, Adrian; Wessel, David; Rodet, Xavier; Virolle, Dominique; Woehrmann, Rolf; Serra, Xavier , International Computer Music Conference, Ann Arbor, Michigan, p.276-279, (1998)   Abstract | Full-Text
OpenSoundEdit: An Interactive Visualization and Editing Framework for Timbral Resources, Chaudhary, Amar; Freed, Adrian; Rowe, Lawrence A. , International Computer Music Conference, Ann, Arbor, Michigan, (1998)   Abstract | PDF