Workshop leaders: Lluis Gómez I Bigórda, Hangar.org, Barcelona Yves Degoyon, GISS.tv, Barcelona

In collaboration with Piksel (Norway)

Participants: 16 (maximum) Fee: 75 Euro

Location: BALTAN Laboratories Glaslaan 2, SWA 8 Eindhoven The Netherlands http://www.baltanlaboratories.org

Computer Vision is currently acquiring a growing relevance in the field of interactive arts. From Myron Krueger’s pioneering artwork in the 1970s to the present day, many artists have used Computer Vision techniques in their works, extending its field of traditional applications (medical, military, industrial, etc.) to interactive artistic practices. It might be visible in an interactive installation or hidden/embedded when used, for example, in gesture-driven musical instruments.

The purpose of this workshop is to introduce some computer vision techniques that form the basis of the actual OpenCV library for Pure Data; a set of objects, utilities and examples to use those techniques in an Open Source / FLOSS environment for one the very first times. At the same time we will introduce some practical examples of possible use cases of this technology, working on thematic research in the different domains of application: Interactive Installation, Augmented Reality, Learning Interfaces, Interactive Instruments, etc. This list will be extended depending on the interest and focus of the participants.

This workshop forms part of a collaboration between BALTAN Laboratories and Piksel. As part of BALTAN’s Blueprint research programme investigating the roles and forms of the art and technology laboratory of the future, BALTAN and Piksel are collaborating to explore the relationship between hard and software developers working on free and open source tools for artistic production, and the artistic use and development of these tools in a laboratory setting. The workshop is both open to the public as well as part of a collaborative research residency (for which we now have an open call).

Participation in the workshop is flexible. Days 1-4 involve acquiring basic knowledge and set the groundwork for working further with the technology. Days 5-7 will be dedicated to group work on specific projects. All participants are required to join the workshop on days 1 and 2 for the basic theory and practice. Attendance for the remaining days of the workshop is flexible but participants are asked to indicate when registering what days they will definitely be present.

To register: please send an email with your bio, technical experience and a short motivation indicating why you would like to join the workshop to angela[AT]baltanlaboratories.org. Please also be sure to indicate the days you intend to be present during the workshop week.

Note: Participants are asked to bring their own machine and video devices. All machines will be configured so that participants will be able to keep working on their project after the end of the workshop.

We will configure the machines as needed by OpenCV : ppc mac-intoshes : apple’s osx with gem intel mac-intoshes : apple’s osx with gem or ubuntu with pdp/pidip and gem pc’s : ubuntu with pdp/pidip and gem

WORKSHOP AGENDA

September 21 : Introduction to Computer Vision 10:00 - 17:00

Theory :

• Image and Video Format Concepts ( RGB, YUV, … )
• Static and Dynamic processing of images and video frames
• Movement Detection example
• Simple Tracking example
• Tracking using Pattern recognition
• Pattern recognition using a Statistical approach

Practice :

• Conversion of videos to a format suitable for analysis
• Simple Movement detection example
• Simple Tracking example

(Objective: Showing a panorama of existing computer vision techniques )

September 22 : Processing Live Video 10:00 - 17:00

Theory :

• Which camera to use? What to expect ?
• The importance of lightning and contrast
• Noise removal and filtering
• Advanced filtering and pre-processing of video

Practice :

• Using simple examples using different kind of inputs
• Measure the importance of filtering
• Use of video pre-processing techniques

(Objective : Stabilize the first examples with a more precise detection and tracking setup)

September 23 : Processing of data 10:00 - 17:00

Theory :

• Connecting analysis data to media processing
• Smoothing data ( mapping ) to get more stable results

Practice :

• Process incoming data to produce interaction
• Connect first examples to a media production unit ( sound and/or video )
• Calibrating inputs to get the expected result

(Objective : Using incoming data and process it to produce interaction )

September 24 : Choose the right technique in the right context 10:00-17:00

Theory :

• Outdoor/Indoor context
• Camera/Lighning setup for a ‘Darkroom’
• Importance of background and contrast

Practice :

• Using basic examples in different context ( outdoor, dark room )
• Playing with contrast and background

(Objective : Determine the best technique and setup for different contexts )

September 25-27 : Thematic Working Groups (Practice) 10:00 - 17:00

Groups :

• Motion Detection in a public space
• Tracking in the context of dance and theater
• Augmented reality
• Interactive sound instruments

(Objective : Realize a few prototypes using computer vision techniques for different kind of applications, towards a real application ) Biographies of the workshop leaders

Lluis Gomez i Bigorda

Lluis Gomez i Bigorda is in charge of the Free and Open Source department of the HANGAR medialab in Barcelona, association of visual artists of Catalunya dedicated to the production of multi-media art pieces, involving free hardware and free software development. He is active in the FLOSS community since more than 7 years and participated in the development of Pure Data, Freej and GISS free media platform (http://giss.tv). Lately, he worked on interactive setups with choregraphers and performers (Shu-lea Chang), using Computer Vision techniques and WII devices as the basis for interaction. He was participating in the visual collective R3 and now formed a new collective T4 : Terminal 4.

urls : Pure Data : http://www.artefacte.org/pd Hangar medialab : http://www.hangar.org GISS free media platform : http://giss.tv

Yves Degoyon

Yves Degoyon (es/fr) is a musician/performer and a free software developer/dealer. He developped since 2001 some tools for audio and video processing within the frame of Pure Data and some tools for escaping from the software mainstream, promoting self-mediation and inventive ways of communicating and organizing.

Some bits of code :: OpenCV for PD (with Lluis Gomez i Bigorda): http://www.hangar.org/wikis/lab/doku.php?id=start:puredata_opencv G.I.S.S. (with others) : http://www.giss.tv /etc/groups : http://etc-groups.sf.net MapOMatix : http://mapomatix.sf.net P.i.D.i.P : http://ydegoyon.free.fr/pidip.html Unauthorized PD : http://ydegoyon.free.fr/software.html

As a musician, he’s practising copyleft philosophy under the name of d.R.e.G.S: http://ydegoyon.free.fr

Tags: motion tracking, opencv, piksel

Baltan: http://www.baltanlaboratories.org Piksel: http://www.piksel.no

Pd-announce mailing list Pd-announce@iem.at http://lists.puredata.info/listinfo/pd-announce