Research

The CNMAT research team brings scientific and engineering tools and resources bear on musical problems and issues. Our particular emphasis is new performance technology and performance-related research issues and problems such as real-time synthesis and control.
Areas of Research
- Sound analysis for event detection, pitch and noise estimation and auditory perceptual models
- New sensor technologies including sensor fusion, inertial sensing, conductive/resistive fibre and malleable media
- Digitizing tablets, multitouch and manytouch surfaces
- High-bandwidth high-precision and low-latency connectivity for audio and gesture data over ethernet using custom FPGA-based connectivity processors
- Machine learning applications in audio synthesis and musical control
- Parallel computing in real-time contexts
- Theoretical and applied spatial acoustics of loudspeaker and microphone arrays, especially in spherical configurations
- Auditory psychophysics and music cognition
- Hearing augmentation and restoration for music listening
- Semantics, requirements and cognitive models of music performance and their implications for software design patterns
- Development of software tools including Open Sound World, MaxMSP.
- Protocol and format development including Open Sound Control (OSC) and the Sound Description Interchange Format (SDIF)
Projects and Resources
Research Publications
The following is a comprehensive bibliography of CNMAT publications. For many of our publications full-text and PDF formats are provided, as well as links to automatically find the publication in your local library.
2007
CNMAT Information Infrastructure,
, International Computer Music Conference, 27/09/2007, Volume 1, Copenhagen, Denmark, p.325-328, (2007)
Abstract | PDF
Real-time Analysis of Sensory Dissonance,
, International Computer Music Conference, 27/08/2007, Copenhagen, Denmark, (2007)
Abstract
Harmonic Expectation and Affect in Western Music: Effects of Attention and Training,
, Perception & Psychophysics, 10/2007, Volume 69, Issue 7, p.1084-1092, (2007)
Abstract | PDF
Modal Parameter Tracking for Shape-Changing Geometric Objects,
, Proc. of the 10th Int. Conference on Digital Audio Effects (DAFx-07), 10/09/2007, Bordeaux, France, (2007)
Abstract | PDF
A Force Sensitive Multi-touch Array Supporting Multiple 2-D Musical Control Structures,
, New Interfaces for Musical Expression, 07/06/2007, New York, p.41-45, (2007)
Abstract | PDF
Ten Years of Tablet Musical Interfaces at CNMAT,
, New Interfaces for Musical Expression, 07/06/2007, New York, p.100-105, (2007)
Abstract | PDF
Optimizing Hearing Aids for Music Listening,
, 19th International Congress on Acoustics, 02/09/2007, Madrid, Spain, (2007)
Abstract | PDF
Perceiving new music recruits flexible neural mechanisms,
, Cognitive Neuroscience Society, p.48, (2007)
2006
Active Damping Of A Vibrating String,
, 6th International Symposium on Active Noise and Vibration Control, 2006/09/18, Adelaide, Australia, (2006)
Abstract | PDF
Timbre as a Psychoacoustic Parameter for Harmonic Analysis,
, Rocky Mountain Society for Music Theory, 2006/03/31, Denver, CO, p.N/A, (2006)
Abstract
Convergent Voices: Perception in Lutoslawski, Berio, Boulez,
, 6th annual GAMMA-UT conference, 2006/03/25, University of Texas at Austin, p.no publication, (2006)
Abstract
An Enactive Approach to Computer Music Performance,
, Le Feedback dans la Creation Musical, Lyon, France, p.93-98, (2006)
Abstract | PDF
Attentional Fluctuations Across Frequency and Amplitude: a Dual-Task Study,
, Cognitive Neuroscience Society (Poster Presentaton), San Francisco, California, p.84, (2006)
Abstract
Acquiring New Musical Grammars: a Statistical Learning Approach,
, 9th International Conference for Music Perception and Cognition, Bologna, Italy, p.1009-1017, (2006)
Abstract | PDF
Acquiring New Musical Grammars: a Statistical Learning Approach,
, 28th Annual Conference of the Cognitive Science Society, Vancouver, Canada, p.1711-1716, (2006)
Abstract | PDF
A Compact 120 Independent Element Spherical Loudspeaker Array with Programmable Radiation Patterns,
, Audio Engineering Society 120th Convention, Paris, France, p.Convention Paper No. 6783, (2006)
Abstract | Full-Text
Augmenting the Cello,
, International Conference on New Interfaces for Musical Expression, Paris, France, p.409-413, (2006)
Abstract | Full-Text
Beyond 0-5V: Expanding Sensor Integration Architectures,
, International Conference on New Interfaces for Musical Expression, Paris, France, p.97-100, (2006)
Abstract | Full-Text | PDF
Convex Approximation with Applications in Magnitude Filter Design and Beamforming,
, EECS, Berkeley, CA, (2006)
Music MetaData Quality: a multiyear Case Study using the Music of Skip James,
, AES 121, San Francisco, CA, (2006)
Abstract | Full-Text
Shape Changing Symmetric Objects for Sound Synthesis,
, AES 121, San Francisco, CA, (2006)
Abstract
2005
Open Sound Control: an enabling technology for musical networking,
, Organised Sound, 2005/12/01, Volume 10, Issue 3, p.193-200, (2005)
Abstract | PDF
Timbre as a Psychoacoustic Parameter for Harmonic Analysis and Composition,
, International Computer Music Conference, 2005/09/05, Barcelona, Spain, p.825-828, (2005)
Abstract
Automated Music Analysis Using Dynamic Graphical Models,
, EECS, Berkeley, CA, p.131, (2005)
Abstract | PDF
Combining Audio And Gestures For A Real-Time Improviser,
, International Computer Music Conference, Barcelona, Spain, p.813-816, (2005)
Abstract | PDF
Control of VST Plug-ins Using OSC,
, International Computer Music Conference, Barcelona, Spain, p.263-266, (2005)
Abstract | Full-Text
Harmonic Expectation, Selective Attention, and Affect in Music,
, Neuroscience and Music Conference, Leipzig, Germany, (2005)
Abstract
Magnitude Least--Squares Fitting via Semidefinite Programming with Applications to Beamforming and Multidimensional Filter Design,
, IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, Pennsylvania, (2005)
Abstract | PDF
Multi-Instrument Musical Transcription Using Dynamic Graphical Model,
, IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, PA, USA, p.493-496, (2005)
Abstract | PDF
Optimal Positioning in Low-dimensional Control Spaces using Convex Optimization,
, International Computer Music Conference, Barcelona, Spain, p.379-382, (2005)
Abstract | PDF
Open-Source Matlab Tools for Interpolation of SDIF Sinusoidal Synthesis Parameters,
, International Computer Music Conference, Barcelona, p.632-635, (2005)
Abstract | PDF
Structuring timbre in an octatonic context: the music of Bohuslav Martinu,
, Music Theory Society of New York State, New York, NY, (2005)
Abstract
Structuring timbre in an octatonic context: the music of Bohuslav Martinu,
, Music Theory Southeast, Miami, FL, (2005)
2004
A Query System for Open Sound Control,
, OpenSoundControl Conference, 2004/07/30, Berkeley, CA, (2004)
Abstract | PDF
Brief overview of OSC and its application areas,
, OpenSoundControl Conference, 2004/07/30, Berkeley, CA, (2004)
OSC Design Space,
, Open Sound Control Conference, 2004/07/30, Berkeley, CA, (2004)
OSC Control of VST Plug-ins,
, Open Sound Control Conference, 2004/07/30, Berkeley, CA, (2004)
Abstract | PDF
Towards a More Effective OSC Time Tag Scheme,
, Open Sound Control Conference, 2004/07/30, (2004)
Audio and Gesture Latency Measurements on Linux and OSX,
, International Computer Music Conference, Miami, FL, p.423-429, (2004)
Abstract | PDF
Characterization of Spherical Loudspeaker Arrays,
, 117th Audio Engineering Society Convention, San Francisco, CA, p.Convention paper #1430, (2004)
Abstract | PDF
Mapping Spectral Frames to Pitch with the Support Vector Machine,
, International Computer Music Conference, Miami, FL, p.664-667, (2004)
Abstract | PDF
Max/MSP Programming Practice with OSC,
, Open Sound Control Conference, Berkeley, CA, (2004)
Music Perception and Cognition Experiments in a Classroom Setting: Temporally Precise Hardware and Software.,
, 8th International Conference on Music Perception and Cognition, Evanston, Illinois, p.642, (2004)
OSC and Gesture features of CNMAT's Connectivity Processor,
, Open Sound Control Conference, Berkeley, CA, (2004)
Panel: Standards from the Computer Music Community,
, International Computer Music Conference, Miami, FL, p.711-714, (2004)
Abstract | PDF
2003
Characterizing and Controlling Musical Material Intuitively with Geometric Models,
, Proceedings of the 2003 Conference on New interfaces for Musical Expression, Montreal, Canada, p.54-62, (2003)
Abstract | PDF
Design of Low-Order Filters for Radiation Synthesis,
, 115th Audio Engineering Society Conventtion, New York, NY, p.Convention Paper 5925, (2003)
Abstract | PDF
Open Sound Control: State of the Art 2003,
, International Conference on New Interfaces for Musical Expression, Montreal, p.153-159, (2003)
Abstract | PDF
2002
Synopsis of reverberation enhancement systems,
, Proceedings of the 3rd European Congress on Acoustics, 2002/09/16, Sevilla, Spain, (2002)
Abstract | PDF
Problems and Prospects for intimate and satisfying sensor-based control of computer sound,
, Symposium on Sensing and Input for Media-Centric Systems (SIMS), 2002/06/20, Santa Barbara, CA, p.1-6, (2002)
Abstract | PDF
Center for New Music and Audio Technologies (CNMAT): Studio Report,
, International Computer Music Conference, Göteborg, Sweden, p.440-443, (2002)
Intimate Musical Control of Computers with a Variety of Controllers and Gesture Mapping Metaphors,
, International Conference on New Interfaces for Musical Expression (NIME), Dublin, Ireland, p.171-173, (2002)
Abstract | PDF
Live interactive computer music and performance practice,
, Journal of the Acoustical Society of America, Volume 3, Issue 5, p.2348-2348, (2002)
PDF
Open Sound World,
, (2002)
OpenSound Control Specification,
, (2002)
Problems and Prospects for Intimate Musical Control of Computers,
, Computer Music Journal, Volume 26, Issue 3, p.11-22, (2002)
Abstract | PDF
Situated Trio: An Interactive Live Performance for a Hexaphonic Guitarist and Two Computer Musicians with Expressive Controllers,
, International Conference on New Interfaces for Musical Expression (NIME), Dublin, Ireland, p.171-173, (2002)
Abstract | Full-Text | PDF
2001
CNMAT Studio Report,
, International Computer Music Conference, Habana, Cuba, p.393-396, (2001)
Full-Text | PDF
Controlling Loudspeaker Array Radiation in Three Dimensions,
, 111th Audio Engineering Society Convention, New York, NY, p.Convention Paper, (2001)
Listener Evaluation of Reduction Strategies for Sinusoidal and Resonance Models,
, International Computer Music Conference, Habana, Cuba, p.227-230, (2001)
Managing Complexity with Explicit Mapping of Gestures to Sound Control with OSC,
, International Computer Music Conference, Habana, Cuba, p.314-317, (2001)
Full-Text | PDF
Preparation for Interactive Live Computer Performance in Collaboration with a Symphony Orchestra,
, International Computer Music Conference, Habana, Cuba, p.310-313, (2001)
Full-Text | PDF
Problems and Prospects for Intimate Musical Control of Computers,
, ACM Computer-Human Interaction Workshop on New Interfaces for Musical Expression, Seattle, WA, (2001)
Abstract | PDF
2000
Analysis/Synthesis Comparison,
, Organised Sound, 2000/12/01, Volume 5, Issue 3, p.173-189, (2000)
Abstract | PDF
An Open Architecture for Real-time Music Software,
, International Computer Music Conference, Berlin, Germany, p.492-495, (2000)
Abstract | PDF
A New Music Keyboard featuring Continuous Key-position Sensing and High-speed Communication Options,
, International Computer Music Conference, Berlin, Germany, p.515-516, (2000)
Abstract | PDF
An XML-based SDIF Stream Relationships Language,
, International Computer Music Conference, Berlin, Germany, p.186-189, (2000)
Abstract | PDF
Center for New Music and Audio Technologies (CNMAT): Studio Report,
, International Computer Music Conference, Berlin, Germany, p.417-420, (2000)
Abstract | PDF
Extensions and Applications of the SDIF Sound Description Interchange Format,
, International Computer Music Conference, Berlin, Germany, p.481-484, (2000)
Abstract | PDF
Generic Panning Tools for MAX/MSP,
, International Computer Music Conference, Berlin, Germany, (2000)
PDF
Musical Applications of New, Multi-axis Guitar String Sensors,
, International Computer Music Conference, Berlin, Germany, p.543-546, (2000)
Abstract | PDF
Music as HandWerk, the middle way between Vorhandenheit and Zuhandenheit,
, International Computer Music Conference, Berlin, Germany, p.5-7, (2000)
Abstract | PDF
Scalable Connectivity Processor for Computer Music Performance Systems,
, International Computer Music Conference, Berlin, Germany, p.523-526, (2000)
Abstract | PDF
1999
A Fixed-Point Recursive Digital Oscillator for Additive Synthesis of Audio,
, IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 1999/03/01, Phoenix, AZ, (1999)
Abstract | PDF
An Open Architecture for Real-Time Audio Processing Software,
, Audio Engineering Society 107th Convention,, New York, NY, p.preprint #5031, (1999)
Abstract | PDF
Audio Applications of the Sound Description Interchange Format Standard,
, Audio Engineering Society 107th Convention, p.preprint #5032, (1999)
Abstract | PDF
Bidirectional AES/EBU Digital Audio and Remote Power over a Single Cable,
, Audio Engineering Society 107th Convention, New York, NY, (1999)
Abstract | Full-Text
Cross-Coding SDIF into MPEG-4 Structured Audio,
, International Computer Music Conference, Beijing, China, p.589-596, (1999)
Abstract | Full-Text
Exploration of Timbre by Analysis Synthesis,
, The Psychology of Music, San Diego, p.113-169, (1999)
Gestural Control of a Real-Time Physical Model of a Bowed String Instrument,
, International Computer Music Conference, Beijing, China, p.375-378, (1999)
PDF
Musical Applications of New Filter Extensions to Max/MSP,
, International Computer Music Conference, Beijing, China, p.504-507, (1999)
Abstract | Full-Text
Spectral Line Broadening with Transform Domain Additive Synthesis,
, International Computer Music Conference, Beijing, China, p.78-81, (1999)
Abstract | Full-Text
Second-order recursive oscillators for musical additive synthesis,
, International Computer Music Conference, Beijing, China, p.74-77, (1999)
Abstract | Full-Text
Supporting the Sound Description Interchange Format in the Max/MSP Environment,
, International Computer Music Conference, Beijing, China, p.182-185, (1999)
Abstract | PDF
The Center for New Music and Audio Technologies (CNMAT): Studio Report,
, International Computer Music Conference, Beijing, China, p.569-572, (1999)
Abstract | Full-Text
Visualization, Editing and Spatialization of Timbral Resources using the OSE Framework,
, Audio Engineering Society 107th Convention, New York, NY, p.preprint #5027, (1999)
Abstract | PDF
Volumetric Modeling of Acoustic Fields for Musical Sound Design in a New Sound Spatialization Theatre,
, International Computer Music Conference, Beijing, China, p.488-491, (1999)
Abstract | Full-Text
1998
A 3D Graphical User Interface for Resonance Modeling,
, International Computer Music Conference, Ann Arbor, Michigan, (1998)
Abstract | PDF
A Direct Adaptive Window Size Estimation Procedure for Parametric Sinusoidal Modeling,
, International Computer Music Conference, University of Michigan, Ann Arbor, (1998)
Abstract | PDF
An Improvisation Environment for Generating Rhythmic Structures Based on North Indian "Tal" Patterns,
, International Computer Music Conference, Ann Arbor, Michigan, p.125-128, (1998)
Abstract | Full-Text
Band-Limited Simulation of Analog Synthesizer Modules by Additive Synthesis,
, Audio Engineering Society 104th Convention, San Francisco, CA, (1998)
Communication of Musical Gesture using the AES/EBU Digital Audio Standard,
, International Computer Music Conference, Ann Arbor, Michigan, p.220-223, (1998)
Abstract | Full-Text
CAST: CNMAT's Additive Synthesis Tools,
, (1998)
Implementation and Performance Issues with OpenSound Control,
, International Computer Music Conference, Ann Arbor, Michigan, p.224-227, (1998)
Abstract | Full-Text
Music Programming with the new Features of Standard C++,
, International Computer Music Conference, Ann, Arbor, Michigan, p.244-247, (1998)
Abstract | Full-Text
Microstructures of Feel, Macrostructures of Sound: Embodied Cognition in West African and African-American Musics,
, Technology and the Arts in the Graduate Division, Berkeley, (1998)
New Applications of the Sound Description Interchange Format,
, International Computer Music Conference, Ann Arbor, Michigan, p.276-279, (1998)
Abstract | Full-Text
OpenSoundEdit: An Interactive Visualization and Editing Framework for Timbral Resources,
, International Computer Music Conference, Ann, Arbor, Michigan, (1998)
Abstract | PDF

