Hi - erm, hard off :-)
some kind of 'sequencer' would be nice for the video.
yeah, definitely. I think this can be done by changing the visibility of the individual renderchains, and those changes can be triggered by metros (periodical bangs) - so this should be possible within the current framework. There will also be a cheap sampler - ie., you can internally capture your output and feed it back to tvjt.
definately include as much audio-interactivity as you can. ideally you want to be able to trigger video events by audio events such as drum beats...also by midi input...and then the best would be the option of using audio signals to generate video.
beat detection is already there, and so is processing of external midi signals. these events trigger bangs that in turn trigger envelope generators, it is possible to adjust each and every aspect of a render chains with these values. I'd love to add more audio-related stuff, but I'm not exactly an audio guy and don't have much of a clue int his respect ... I'm using bonk for the beat detection, which works great. There is some sort of treble detection as well, which is more or less reliable (basically it's a hip~ that triggers a bang if a certain threshold in the amplitude is exceeded). If you have any suggestions on more audio feature extraction, I'd be glad to implement them :-)
also, it would be important for me to be able to feed in the output of my own patches to the video stream.
there will be some sort of an api, I'll also document the internal message structure so it should be relatively easy to add more filters etc. and it would definitely a good idea to add an input for external sources. that should be easy enough, it's merely a matter of importing a gem render chain. I actually talked to Ben Bogart about this, maybe we can settle on some sort of quasi-standard that would allow to share stuff across different gem applications.
thanks & with kind regards, thoralf.
Does your mail provider give you FREE antivirus protection? Get Yahoo! Mail http://uk.mail.yahoo.com