Interfaces 2 – Cameras
Computer Vision
Computer vision enables computers to interpret and understand visual information from digital images and videos. Specific algorithms are used to process, analyze, and extract meaningful features from visual data, transforming raw pixels into high-level understanding.
Tasks include object detection and facial recognition. The applications are widespread across industries, from autonomous vehicles navigating roads and medical imaging diagnosing diseases to augmented reality overlaying digital content on the physical world. For the course, the last field of application is of particular interest.
"Cloud Faces", Shinseungback Kimyonghun, 2014
CV – TouchDesigner
When we analyzed video images for their "activity" levels in the "Audiovisual Design" course, we were already engaging in computer vision. Though we worked with pre-recorded videos rather than live data from the external world, we were extracting meaningful information from images and tracking their temporal changes.
In fact, image processing techniques like edge detection are often components of computer vision algorithms. While TouchDesigner provides specific Texture Operators for these tasks, some plugins extend these capabilities with more specialized object detection features. One example is the recent MediaPipe plugin, which brings Google's computer vision framework into the TouchDesigner environment, enabling more advanced detection and tracking capabilities.
CV – Processing
OpenCV
A Processing wrapper for the OpenCV library. Provides functions for face detection, background subtraction, contour finding, and many other computer vision algorithms
BoofCV
High-performance computer vision library with a Processing wrapper. Good for feature detection, image segmentation.
DeepVision Processing
DeepVision Processing simplifies the process of working with vision algorithms by providing interfaces and examples. It's useful for interactive installations, digital art, and prototyping vision-based interactions. It extends the functionality of OpenCV for Processing with additional features specifically designed for Processing users.
Last updated