Hello
For those interested: my latest research in pure visual data.
http://databaz.org/xtrm-art/?p=202
Here: a combination of a shading (from framebuffer) + deformation through the vertex (call file via GLSL glsl_verxtex and end with glsl_fragment to process floats glsl_program). Everything is handled in real time from a motion-tracking that both variables gives vertex + triggers two types of sound (64 grid areas in the image): 64 osc~ + sounds of a grid of sample .
best regards
p