Audio-visual Interaction
A Situated, embodied and embedded approach audiovisual interactions
An embedded approach acknowledges the local environment as participant in possible interactions. The surrounding physical reality shows itself in auditive and visual properties that can be accessed with appropriate sensors.
Interactions between individuals and the environment. In the context of Computer Music we assume though, that some kinds of interfaces or sensors are necessary to translate properties of worldly actions or events into the digital realm for further processing.
Situated systems for audio-visual interactions therefore can include computer vision by simple camera setups, stereo imaging, infrared, commercial tracking systems, etc.
Toolchain
Similar to the first part "Audiovisuelle Gestaltung" we will rely on a model of a toolchain that provides foundation and flexibility for the situated and embedded approach to interactive audio-vusual art and design.
The requirements for the tools to meet are similar to the first part "Audiovisuelle Gestaltung":
All tools are specialized in their field
All tools are established (libraries, documentation, tutorials, …)
Available on major operating systems
SuperCollider and Processing are open source / TouchDesigner basic version free to learn
Bottom-up low-level approach of programming: tools provide means to produce and manipulate material on fundamental parameters
Lean development possible, less overhead than game engines
Software for audiovisual design
For a list of software see course Audio-visual Design, Session 1.
Last updated