This page contains links to various articles and research papers related to auditory and visual perceptions, and constitutes collectively as a rough ‘audiovisual theory’:
Audiovisual Correlations
Perceived Match Between Visual Parameters and Auditory Correlates: An Experimental Multimedia Investigation – S. D. Lipscomb, E. M. Kim.
This research paper focuses on which attributes of our auditory and visual senses, such as size, loudness, shape and timbre, correlate more effectively with each other.
The Sound of Colour – D. L. Datteri, J. N. Howard.
This experiment explores the relationship between colour and pitch, and proposes an inverse correlation between the wavelengths of light and sound.
Representing Music with Visual Space and Colour – R. McGee.
This article discusses the various possible correlations between visual space and other auditory features, providing results and details of an experimental study.
Synesthesia-like Mappings of Lightness, Pitch and Melodic Interval – T. L. Hubbard.
This experimental study investigates whether certain levels of lightness correlate to certain auditory pitches or melodic intervals, revealing that lighter stimuli fit better with higher pitches and darker stimuli with lower pitches.
Audiovisual ‘Theory’
Audiovisual Composition – M. Grierson.
Article by Mick Grierson discussing audiovisual composition.
The Perception of Audio-Visual Composites: Accent Structure Ailgnment of Simple Stimuli – S. D. Lipscomb.
Research and discussion into the effectiveness of synchronized auditory and visual material, also discussing what constitutes a synchronized audiovisual event and defines how accents can be formed within each perception.
Pierre Schaeffer’s Contribution to Audiovisual Theory – N. Bizzaro.
Article outlining the works of composer, musicologist, engineer and pioneer of electronic music Pierre Scaeffer, from the formation of ‘Music Concrete’ to written works on audiovisual ideas and theories.
Electroacoustic Sound and Audiovisual Structure in Film – M. S. Anderson.
Online article discussing the structuring of sound and image within the context of film.
Auditory and Visual Objects – M. Kubovy, D. Van Valkenburg
Research article comparing the similarities between the perception of visual objects and individual auditory events, making an argument for the existence of an auditory ‘object’.
Perceptual Judgement of the Relationship Between Musical and Visual Components in Film – S. D. Lipscomb, R. A. Kendall
Experimental study into the effects of combining different genres of music with different styles of imagery in the context of film.
Projection Mapping
Comprehensive website that focuses on projection mapping, great source for current projects and shows, as well as the history of projection mapping.
http://www.projection-mapping.org/
Link to the blog ‘Conversations With Spaces’, which features a free download of ‘VPT 6.0’, written in Max/MSP/Jitter;
Further Reading
Art and Visual Perception: A Psychology of the Creative Eye – R. Arnheim.
Visual Thinking – R. Arnheim.
Audiovision: Sound on Screen – M. Chion.
Audio-visual Art and VJ Culture – M. Faulkner.
Audiovisuology 2, Essays: Histories and Theories of Audiovisual Media and Art – Various contributors, edited by D. Daniels and S. Naumann.
Third Eye 