Selected Research Publications from CNMAT from 1989 to the Present

Areas of Research include:

  • Protocol and encoding development including Open Sound Control (OSC) (http://opensoundcontrol.org/introduction-osc) and the Sound Description Interchange Format (SDIF) (http://www.cnmat.berkeley.edu/content/sdif-specification).
  • New sensor technologies and interface modalities: sensor fusion, integration.
  • New sense-enabled media: conductive/resistive fibre, malleable media.
  • eTextile, conductive paper and other materials for the New Lutherie
  • Many-channel digital audio interfaces; hundreds of channels over common ethernet. FPGA-based audio systems development.
  • Parallel computing theory in music/audio computing; algorithms, requirements.
  • Musical interactivity tools including digitizing tablets, multitouch and manytouch surfaces.
  • New user-interfaces for interaction with expressive musical/auditory environments, e.g. spatial mapping with dimensionality reduction.
  • Theoretical and applied spatial acoustics of loudspeaker and microphone arrays, especially in spherical configurations
  • Musical quality; metrics, augmentation, compression, hearing loss.
  • Signal-theory for musical gestures; requirements on jitter and latency, expressive bandwidth estimation
  • Semantics, requirements and cognitive models of music performance and their implications for software design patterns
  • Sound analysis for event detection, pitch and noise estimation and auditory perceptual models
  • Machine learning applications in audio synthesis and musical control
  • Auditory psychophysics and music cognition and perception
  • Curation and Development of real-time music and audio software tools.
Wright M. SDIF (Sound Description Interchange Format) Specification [Internet]. 1999 . http://cnmat.berkeley.edu/publications/sdif_sound_description_interchange_format_specification Chaudhary A, Freed A, Khoury S, Wessel D. A 3D Graphical User Interface for Resonance Modeling. In International Computer Music Conference [Internet]. Ann Arbor, Michigan: International Computer Music Association; 1998. http://cnmat.berkeley.edu/publications/3d_graphical_user_interface_resonance_modeling Chaudhary A, Freed A, Rowe LA. OpenSoundEdit: An Interactive Visualization and Editing Framework for Timbral Resources. In International Computer Music Conference [Internet]. Ann, Arbor, Michigan: International Computer Music Association; 1998. http://cnmat.berkeley.edu/publications/opensoundedit_interactive_visualization_and_editing_framework_timbral_resources_0 Chaudhary A. OpenSoundEdit: An Interactive Visualization and Editing Framework for Timbral Resources [Internet]. Wessel D. Electrical Engeneering and Computer Science. [Berkeley, CA]: UC Berkeley; 1998. http://cnmat.berkeley.edu/publications/opensoundedit_interactive_visualization_and_editing_framework_timbral_resources Chaudhary A. Band-Limited Simulation of Analog Synthesizer Modules by Additive Synthesis. In Audio Engineering Society 104th Convention [Internet]. San Francisco, CA: Audio Engineering Society; 1998. http://cnmat.berkeley.edu/publications/band_limited_simulation_analog_synthesizer_modules_additive_synthesis Freed A, Wessel D. Communication of Musical Gesture using the AES/EBU Digital Audio Standard. In International Computer Music Conference. Ann Arbor, Michigan: International Computer Music Association; 1998. pp. 220-223. Freed A. Real-Time Inverse Transform Additive Synthesis for Additive and Pitch Synchronous Noise and Sound Spatialization. In Audio Engineering Society 104th Convention. San Francisco, CA: Audio Engineering Society; 1998. Freed A, Chaudhary A. Music Programming with the new Features of Standard C++. In International Computer Music Conference. Ann, Arbor, Michigan: International Computer Music Association; 1998. pp. 244-247. Freed A, Wright M. CAST: CNMAT's Additive Synthesis Tools [Internet]. CNMAT; 1998 . http://cnmat.berkeley.edu/publications/cast_cnmats_additive_synthesis_tools Irizarry R. Statistics and Music: Fitting a Local Harmonic Model to Musical Sound Signals. Statistics. [Berkeley, CA]: UC Berkeley; 1998. p. 137. Irizarry R. A Direct Adaptive Window Size Estimation Procedure for Parametric Sinusoidal Modeling. In International Computer Music Conference. University of Michigan, Ann Arbor: International Computer Music Association; 1998. Iyer V. Microstructures of Feel, Macrostructures of Sound: Embodied Cognition in West African and African-American Musics. Technology and the Arts in the Graduate Division. [Berkeley]: University of California at Berkeley; 1998. Khoury S, Freed A, Wessel D. Volumetric Modeling of Acoustic Fields in CNMAT's Sound Spatialization Theatre. In Audio Engineering Society 104th Convention [Internet]. San Francisco, CA: Audio Engineering Society; 1998. http://cnmat.berkeley.edu/publications/volumetric_modeling_acoustic_fields_cnmats_sound_spatialization_theatre Khoury S, Freed A, Wessel D. Volumetric Visualization of Acoustic Fields in CNMAT's Sound Spatialization Theatre. In Institute of Electrical and Electronics Engineers Visualization 98. Research Triangle Park, NC: Institute of Electrical and Electronics Engineers; 1998. pp. 439-442 and 562. Wessel D, Drame C, Wright M. Removing the Time Axis from Spectral Model Analysis-Based Additive Synthesis: Neural Networks versus Memory-Based Machine Learning. In International Computer Music Conference [Internet]. Ann Arbor, Michigan: International Computer Music Association; 1998. pp. 62-65. http://cnmat.berkeley.edu/publications/removing_time_axis_spectral_model_analysis_based_additive_synthesis_neural_networks_versus_memory_ba Wessel D, Wright M, Khan SAli. Preparation for Improvised Performance in Collaboration with a Khyal Singer. In International Computer Music Conference [Internet]. Ann Arbor, Michigan: International Computer Music Association; 1998. pp. 497-503. http://cnmat.berkeley.edu/publications/preparation_improvised_performance_collaboration_khyal_singer Wright M, Chaudhary A, Freed A, Wessel D, Rodet X, Virolle D, et al.. New Applications of the Sound Description Interchange Format. In International Computer Music Conference [Internet]. Ann Arbor, Michigan: International Computer Music Association; 1998. pp. 276-279. http://cnmat.berkeley.edu/publications/new_applications_sound_description_interchange_format Wright M. Implementation and Performance Issues with OpenSound Control. In International Computer Music Conference. Ann Arbor, Michigan: International Computer Music Association; 1998. pp. 224-227. Wright M, Wessel D. An Improvisation Environment for Generating Rhythmic Structures Based on North Indian "Tal" Patterns. In International Computer Music Conference [Internet]. Ann Arbor, Michigan: International Computer Music Association; 1998. pp. 125-128. http://cnmat.berkeley.edu/publications/improvisation_environment_generating_rhythmic_structures_based_north_indian_tal_patterns Wright M, Chaudhary A, Freed A, Wessel D, Rodet X. New Applications of the Sound Description Interchange Format. In Proc. ICMC. 1998. Freed A, Jehan T. Database of Challenging Musical Sounds for Evaluation and Refinement of Pitch Estimators. In ICMC. Thessaloniki, Hellas: ICMA; 1997. p. [not published]. Freed A. Inverse Transform Narrow Band/Broad Band Sound Synthesis [Internet]. The Regents of the University of California; 1997. https://patents.google.com/patent/US5686683 Freed A, Chaudhary A, Davila B. Operating Systems Latency Measurement and Analysis for Sound Synthesis and Processing Applications. In International Computer Music Conference [Internet]. Thessaloniki, Hellas: International Computer Music Association; 1997. pp. 479-481. http://cnmat.berkeley.edu/node/2204 Goodwin M, Vetterli M. Atomic decompositions of audio signals. In Applications of Signal Processing to Audio and Acoustics, 1997. 1997 IEEE ASSP Workshop on. New Paltz, NY; 1997. pp. 4-7. Goodwin M. Matching pursuit with damped sinusoids. In ICASSP IEEE International Conference on Acoustics, Speech, and Signal Processing. 1997. pp. 2037-2040. Goodwin M. Adaptive Signal Models: Theory, Algorithms, and Audio Applications. Electrical Engineering Computer Science. UNIVERSITY of CALIFORNIA; 1997. p. 273. Iyer V, Bilmes J, Wessel D, Wright M. A Novel Representation for Rhythmic Structure. In International Computer Music Conference [Internet]. Thessaloniki, Hellas: International Computer Music Association; 1997. pp. 97-100. http://cnmat.berkeley.edu/publications/novel_representation_rhythmic_structure Rovan JButch, Wanderley MM, Dubnov S, Depalle P. Instrumental Gestural Mapping Strategies as Expressivity Determinants in Computer Music Performance. In KANSEI - The Technology of Emotion. 1997. Wright M, Wessel D, Freed A. New Musical Control Structures from Standard Gestural Controllers. In International Computer Music Conference. Thessaloniki, Hellas: International Computer Music Association; 1997. pp. 387-390. Wright M, Freed A. Open Sound Control: A New Protocol for Communicating with Sound Synthesizers. In International Computer Music Conference [Internet]. Thessaloniki, Hellas: International Computer Music Association; 1997. pp. 101-104. http://cnmat.berkeley.edu/publications/open_sound_control_new_protocol_communicating_sound_synthesizers Freed A. Music And Audio Technology Projects To Stir Your Imagination. Computer Music Journal [Internet]. 1996;20:4-4. http://www.mitpressjournals.org/loi/comj Goodwin M. Residual modeling in music analysis-synthesis. In Acoustics, Speech, and Signal Processing, 1996. ICASSP-96. Conference Proceedings., 1996 IEEE International Conference on. 1996. pp. 1005-1008. Kartadinata S. Algorithms for Combined Sound Analysis andSynthesis and their Implementation in a Multi-Processor Environment. Universitt Karlsruhe; 1996. McMillen K, Simon D, Wright M. Communications network interface, and adapter and method therefor. United States: Zeta Music Partners; 1996. Brecht B, Garnett G. Conductor Follower. In International Computer Music Conference. Banff, Canada: International Computer Music Association; 1995. pp. 185-186. Freed A. Improving Graphical User Interfaces For Computer Music Applications. Computer Music Journal [Internet]. 1995;19:4-5. http://www.mitpressjournals.org/loi/comj Freed A. Bring Your Own Control Additive Synthesis. In International Computer Music Conference. Banff, Canada: International Computer Music Association; 1995. pp. 303-306. Goodwin M, Kogon A. Overlap-add synthesis of nonstationary sinusoids. In Proceedings of the 1995 International Computer Music Conference [Internet]. 1995. pp. 355-356. http://citeseer.ist.psu.edu/goodwin95overlapadd.html Lee MA, Wessel D. Soft computing for real-time control of musical processes. In 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century (Cat. No.95CH3576-7) 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century. Vancouver, BC, Canada: Ieee; 1995. pp. 2748-53 vol.3. Wright M. A Hierarchy of Perceptually Meaningful Controls in ZIPI's Music Parameter Description Language (MPDL). In: Wessel D. Society for Music Perception and Cognition. Berkeley, CA: CNMAT; 1995. p. 14. Freed A, Goldstein M, Goodwin M, Lee MA, McMillen K, Rodet X, et al.. Real-Time Additive Synthesis Controlled by a Mixture of Neural-Networks and Direct Manipulation of Physical and Perceptual Attributes. In International Computer Music Conference. Aarhus, Denmark: International Computer Music Association; 1994. pp. 362-363. Freed A. Codevelopment of user interface, control and digital signal processing with the HTM environment. In 5th International Conference on Signal Processing Applications and Technology. Dallas, TX, USA: DSP Associates; 1994. pp. 1179-83. Freed A. The Rebirth of Computer Music by Analog Signal Processing. In International Computer Music Conference. Aarhus, Denmark: International Computer Music Association; 1994. pp. 435-442. Goodwin M, Rodet X. Efficient Fourier synthesis of nonstationary sinusoids. In Proceedings of the 1994 International Computer Music Conference [Internet]. 1994. pp. 333-334. http://citeseer.ist.psu.edu/goodwin94efficient.html Leroy A, Muller G, Garnett G. The Design of a Pen-Based Music Notation System. In International Computer Music Conference. Aarhus, Denmark: International Computer Music Association; 1994. pp. 286-292. McMillen K, Simon D, Wright M. A Summary of the ZIPI Network. Computer Music Journal. 1994;18:74-80. McMillen K, Wessel D, Wright M. The ZIPI music parameter description language. Computer Music Journal [Internet]. 1994;18:52-73. http://www.mitpressjournals.org/loi/comj McMillen K, Simon D, Wessel D, Wright M. A New Network and Communications Protocol for Electronic Musical Devices. In International Computer Music Conference. Aarhus, Denmark: International Computer Music Association; 1994. pp. 443-446. McMillen K, Wright M, Simon D, Wessel D. ZIPIAn Inexpensive, Deterministic, Moderate-Speed Computer Network for Music and Other Media. In Audio Engineering Society 13th International Conference: Computer-Controlled Sound Systems. Dallas, TX: Audio Engineering Society; 1994. pp. 145-151. Peevers A. A Real-Time 3D Signal Analysis/Synthesis Tool Based on the Overlap-Add Short-Time Fourier Transform. EECS. [Berkeley, CA]: UC Berkeley; 1994. Rodet X. Stability/Instability of Periodic Solutions and Chaos in Physical Models of Musical Instruments. In International Computer Music Conference. Aarhus, Denmark: International Computer Music Association; 1994. pp. 386-393. Wright M. Examples of ZIPI applications. Computer Music Journal [Internet]. 1994;18:81-5. http://www.mitpressjournals.org/loi/comj Wright M. A comparison of MIDI and ZIPI. Computer Music Journal [Internet]. 1994;18:86-91. http://www.mitpressjournals.org/loi/comj Wright M. Answers to frequently asked questions about ZIPI. Computer Music Journal [Internet]. 1994;18:92-6. http://www.mitpressjournals.org/loi/comj Freed A. Guidelines for signal processing applications in C. C Users Journal. 1993;:85(9). Freed A, Rodet X, Depalle P. Synthesis and control of hundreds of sinusoidal partials on a desktop computer without custom hardware. In Fourth International Conference on Signal Processing Applications and Technology. Santa Clara, CA: DSP Associates; 1993. pp. 1024-30. Freed A, Rodet X, Depalle P. Performance, Synthesis and Control of Additive Synthesis on a Desktop Computer Using FFT-1. In International Computer Music Conference [Internet]. Waseda University: International Computer Music Association; 1993. pp. 98-101. http://cnmat.berkeley.edu/publications/performance_synthesis_and_control_additive_synthesis_desktop_computer_using_fft_1 Hajdu G. Low Energy and Equal Spacing: the Multifactorial Evolution of Tuning Systems. Interface. 1993;22:319-333. Lee MA, Wessel D. Real-time neuro-fuzzy systems for adaptive control of musical processes. In Applications of Fuzzy Logic Technology. Boston, MA; 1993. pp. 464-75. Rodet X. Models of musical instruments from Chua's circuit with time delay. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing [Internet]. 1993;40:696-701. http://cnmat.berkeley.edu/publications/models_musical_instruments_chuas_circuit_time_delay Rodet X. Sound and music from Chua's circuit. Journal of Circuits, Systems and Computers [Internet]. 1993;3:49-61. http://cnmat.berkeley.edu/publications/sound_and_music_chuas_circuit Zicarelli D, Lee MA. The Max Timeline Object. In International Computer Music Conference. Tokyo, Japan: International Computer Music Association; 1993. pp. 453-456. Freed A. New Tools for Rapid Prototyping of Musical Sound Synthesis Algorithms and Control. In International Computer Music Conference [Internet]. San Jose, CA: International Computer Music Association; 1992. pp. 178-181. http://cnmat.berkeley.edu/publications/new_tools_rapid_prototyping_musical_sound_synthesis_algorithms_and_control Hajdu G. 17 Tones. In International Computer Music Conference [Internet]. San Jose, CA: International Computer Music Association; 1992. pp. 449-450. http://cnmat.berkeley.edu/publications/17_tones Lee MA, Freed A, Wessel D. Neural networks for simultaneous classification and parameter estimation in musical instrument control. In Adaptive and Learning Systems [Internet]. Orlando, FL, USA; 1992. pp. 244-55. https://www.spiedigitallibrary.org/conference-proceedings-of-spie/1706/1/Neural-networks-for-simultaneous-classification-and-parameter-estimation-in-musical/10.1117/12.139949.full?SSO=1 Lee MA, Garnett G, Wessel D. An Adaptive Conductor Follower. In International Computer Music Conference [Internet]. San Jose, CA: International Computer Music Association; 1992. pp. 454-455. http://cnmat.berkeley.edu/publications/adaptive_conductor_follower Lee MA, Wessel D. Connectionist models for real-time control of synthesis and compositional algorithms. In International Computer Music Conference [Internet]. San Jose, CA: International Computer Music Association; 1992. pp. 277-280. http://cnmat.berkeley.edu/publications/connectionist_models_real_time_control_synthesis_and_compositional_algorithms Rodet X. Nonlinear Oscillator Models of Musical Instrument Excitation. In International Computer Music Conference [Internet]. San Jose, CA: International Computer Music Association; 1992. pp. 412-413. http://cnmat.berkeley.edu/publications/nonlinear_oscillator_models_musical_instrument_excitation Sandell GJ, Martens WL. Prototyping and Interpolation of Multiple Music Timbres Using Principal Component-Based Synthesis. In International Computer Music Conference. San Jose, CA: International Computer Music Association; 1992. pp. 34-37. Wessel D. Connectionist Models for Musical Control of Nonlinear Dynamical Systems. Journal of Acoustical Society of America. 1992;92. Delehanty L, Garnett G. CNMAT Studio Report: New Music Performance and Composition Research. In International Computer Music Conference [Internet]. McGill University: International Computer Music Association; 1991. pp. 388-391. http://cnmat.berkeley.edu/publications/cnmat_studio_report_new_music_performance_and_composition_research Freed A, Wessel D, Zicarelli D. MAX Objects for Media Integration. In International Computer Music Conference. McGill University: International Computer Music Association; 1991. pp. 397-400. Garnett G. Musical Signals, and Representations: A Survey [Internet]. dePoli G, Piccialli A, Roads C. Representations of Musical Signals. Cambridge, MA: MIT Press; 1991. http://cnmat.berkeley.edu/publications/musical_signals_and_representations_survey Hajdu G. Computermusik in der Bay Area. Neue Zeitschift fr Musik [Internet]. 1991;. http://cnmat.berkeley.edu/publications/computermusik_der_bay_area Lee MA, Freed A, Wessel D. Real-Time Neural Network Processing of Gestural and Acoustic Signals. In 17th International Computer Music Conference [Internet]. Montreal: International Computer Music Association; 1991. pp. 277-280. http://cnmat.berkeley.edu/publications/real_time_neural_network_processing_gestural_and_acoustic_signals Wessel D. Instruments That Learn, Refined Controllers, And Source Model Loudspeakers. Computer Music Journal [Internet]. 1991;15:82-86. http://cnmat.berkeley.edu/publications/instruments_learn_refined_controllers_and_source_model_loudspeakers Wessel D. Improvisation with highly interactive real-time performance systems. In International Computer Music Conference [Internet]. Montreal: International Computer Music Association; 1991. pp. 344-347. http://cnmat.berkeley.edu/publications/improvisation_highly_interactive_real_time_performance_systems Wessel D. Let's Develop a Common Language for Synth Programming [Internet]. Electronic Musician. 1991. http://cnmat.berkeley.edu/publications/lets_develop_common_language_synth_programming Freed A, Gordon K. DSP driver software for performance-oriented music synthesis systems. In International Computer Music Conference [Internet]. Glasgow, UK: International Computer Music Association; 1990. pp. 79-81. http://cnmat.berkeley.edu/publications/dsp_driver_software_performance_oriented_music_synthesis_systems Pointer S, Wawrzynek J, Wessel D. A Multimedia Digital Signal Processing Tutoring System. In International Computer Music Conference [Internet]. Glasgow, UK: International Computer Music Association; 1990. pp. 35-38. http://cnmat.berkeley.edu/publications/multimedia_digital_signal_processing_tutoring_system Wawrzynek J, von Eicken T. VLSI Parallel Processing for Musical Sound Synthesis. In International Computer Music Conference [Internet]. Glasgow, UK: International Computer Music Association; 1990. pp. 136-139. http://cnmat.berkeley.edu/publications/vlsi_parallel_processing_musical_sound_synthesis Barrire J-B, Baisnee P-F, Freed A, Baudot M-D. A Digital Signal Multiprocessor and its Musical Application. In 15th International Computer Music Conference [Internet]. Ohio State University: International Computer Music Association; 1989. pp. 17-20. http://cnmat.berkeley.edu/publications/digital_signal_multiprocessor_and_its_musical_application Freed A. New Media for Musicological Research and Education - The Country Blues in HyperMedia. In 15th International Computer Music Conference [Internet]. Ohio State University: International Computer Music Association; 1989. pp. 109-112. http://cnmat.berkeley.edu/publications/new_media_musicological_research_and_education_country_blues_hypermedia Mellinger DK, Garnett G, Mont-Reynaud B. Virtual Digital Signal Processing in an Object-Oriented System. Computer Music Journal. 1989;13:71-76. Wawrzynek J, von Eicken T. MIMIC, A Custom VLSI Parallel Processor for Musical Sound Synthesis. In: G. Lauther Mand U. IFIP IC10/WG10.5 Working Conference on Very Large Scale Integration [Internet]. Munich; 1989. http://cnmat.berkeley.edu/publications/mimic_custom_vlsi_parallel_processor_musical_sound_synthesis Wessel D, Felciano R, Freed A, Wawrzynek J. The Center for New Music and Audio Technologies: Studio Report 1989. In International Computer Music Conference [Internet]. San Francisco: International Computer Music Association; 1989. pp. 336-339. http://cnmat.berkeley.edu/publications/center_new_music_and_audio_technologies_cnmat_studio_report Wessel D. Timbre and the perceptual organization of musical patterns. Journal of Acoustical Society of America [Internet]. 1989;86:S58. http://cnmat.berkeley.edu/publications/timbre_and_perceptual_organization_musical_patterns Wessel D. Timbre Space as a Musical Control Structure. Computer Music Journal [Internet]. The MIT Press; 1979;3:45-52. http://www.mitpressjournals.org/loi/comj Wessel D. Timbre Space as a Musical Control Structure. Computer Music Journal [Internet]. The MIT Press; 1979;3:45-52. http://www.mitpressjournals.org/loi/comj

Pages