smells very much like 'the wheel of reincarnation'. http://catb.org/~esr/jargon/html/W/wheel-of-reincarnation.html but definitely cool though. it should be possible in pd through pf soon (maybe in a year ;) but cards are not really optimized to read back from graphics memory i think.
Is this possible with pd? http://www.bionicfx.com/
-Realtime seems to be a problem, because things have to be translated from video into audio and back and forth:
- Individual audio samples are isolated from the audio stream
- Samples are transformed into video data elements and structures
- Appropriate pixel shader application loaded on the GPU
- Secondary audio samples are converted to video textures and loaded on
video card 5. AVEX data sent to the GPU for processing 6. Iterative processes perform functions and read and write results to textures 7. Final output of shaded pixels sent to off-screen video buffers 8. Video data is retrieved and decoded into audio
AvS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .....................................................................
` |Schreck Ensemble . . . . . . . . . . . . . . . . . . . . +
` |# -laboratory for live electro-acoustic music- # |
| http://www.schreck.nl/ |
| http://www.xs4all.nl/~schreck/ |
` *===========================================================++
` |Compositions http://www.xs4all.nl/~schreck/html/compo.html |
` |Samples http://www.xs4all.nl/~schreck/html/samp.html |
` |Patches http://www.xs4all.nl/~schreck/html/pat.html |
` |Videos http://www.xs4all.nl/~schreck/html/video.html |
` |Scores http://www.xs4all.nl/~schreck/html/scores.html |
*===========================================================++
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .....................................................................