Hello,
Sorry to blow my own trumpet twice in a row like this, but I just found this video somebody made of FUDIKaosDS in action - that's one of the two bits of software I posted about earlier. This video nicely shows off it's capabilities:
http://www.youtube.com/watch?v=fDCYaEc2VL8
It looks like this person is using Pure Data and Gem for the sound and visuals.
Best,
Chris.