Thanks to all for the helpful info. Especially, to Ben for widening my idea of what resources exist.
There are a large number of Graphics/Video libs for PD including: GridFlow (matrix operations), Framestein (windows only), PDP (something more like softVideo), and PiDiP (nice extra stuff on top of PDP), and of course Gem.
So now my task is to try to narrow my search to the appropriate tools for the task. Here is what I am planning (its not too complex):
grab video from camera in real-time periodically save it to a file(s) chroma key it as it is displayed concurrently display previously-saved video(s) behind the current real-time video apply diverse effects in real-time to the previously-saved video files that have been loaded in vary the amount of these effects according to gradiant input from a motion sensor
Could anyone suggest what combination of these tools might be most appropriately suited for this set of tasks?
Thanks in advance,
Jhave
Hey JHave,
I'm comment inline:
grab video from camera in real-time
no problem in Gem (DV video in, very very fast) (on OSX)
periodically save it to a file(s)
is pix_write working in OSX yet? Are you talking about saving a chunk of video, or individual frames? I never tried using pix_multiimage to load an array of images files saved with pix_write the performance may not be all that great.
chroma key it as it is displayed
Gem, no problem.
concurrently display previously-saved video(s) behind the current
real-time
video
no problem in Gem
apply diverse effects in real-time to the previously-saved video files
that
have been loaded in
define "effects" Gem has pix_ filters, and you can do a heck of a lot with openGL transformations for "effects".
vary the amount of these effects according to gradiant input from a motion sensor
Whats the HW interface for the sensor?
I would say in conlusion that I can't think of a good reason for using Jitter for this project. Perhaps to be able to save QT movies rather than individual frames...
Whats the timeline of the project? Gem is always changing!
Ben
periodically save it to a file(s)
is pix_write working in OSX yet? Are you talking about saving a chunk of video, or individual frames? I never tried using pix_multiimage to load an array of images files saved with pix_write the performance may not be all that great.
pix_write works in OSX. By default it writes out single high-quality photo-jpeg files into an image sequence which can be loaded into the QTPlayer.app and saved as a .mov file. The one caveat at the moment: using pix_write with pix_snap results in the images being flipped on the y axis. This is because QT and GL disagree on where to begin drawing pixmaps - QT starts in the top left, GL in the bottom left. I can add a flip function which will take care of this internally but it will affect speed somewhat. Currently I can record 640x480 scenes at 30fps (1ghz powerbook) using pix_snap + pix_write, but that might not be possible with the flip function in place. I will also talk to some people at Apple to see if there is a better solution to this.
It also wouldn't be too much of a chore to code up a QT movie recording object, but the soonest I could get to it would be next weekend.
hi,
grab video from camera in real-time
no problem in PDP ( pdp_v4l from PDP ).
periodically save it to a file(s)
no problem in PDP ( pdp_rec~ from PiDiP )
chroma key it as it is displayed
kind of ( you can use pdp_compose from PiDiP )
or use objects from Gem that can then be displayed in PDP ( using pdp2gem )
concurrently display previously-saved video(s) behind the current real-time video
no problem in PDP ( pdp_qt )
apply diverse effects in real-time to the previously-saved video files that have been loaded in
of course, a lot from PDP and PiDiP ( http://ydegoyon.free.fr/pidip.html )
vary the amount of these effects according to gradiant input from a motion sensor
sure if it has a midi or net interface. i know people commanding PDP/PiDiP with midi faders or USB gamepads. also, PiDiP does some motion detection ( pdp_ctrack, pdp_mgrid, pdp_shape )
just a detail, it's only for linux & partly for OSX ( to be improved ).
cheers, sevy
sevy how partly for OS X what works if i may ask?
-----Original Message----- From: pd-list-admin@iem.at [mailto:pd-list-admin@iem.at]On Behalf Of Yves Degoyon Sent: Saturday, October 25, 2003 6:06 PM Cc: JHAVE; pd-list@iem.at Subject: Re: [PD] Re: GEM vs Jitter a newbie request for opinions (newbie sez thanks)
hi, grab video from camera in real-timeno problem in PDP ( pdp_v4l from PDP ).
periodically save it to a file(s)no problem in PDP ( pdp_rec~ from PiDiP ) chroma key it as it is displayed
kind of ( you can use pdp_compose from PiDiP )or use objects from Gem that can then be displayed in PDP ( using pdp2gem )
concurrently display previously-saved video(s) behind the current real-time video no problem in PDP ( pdp_qt )
apply diverse effects in real-time to the previously-saved video files that have been loaded inof course, a lot from PDP and PiDiP ( http://ydegoyon.free.fr/pidip.html )
vary the amount of these effects according to gradiant input from a
motion sensor sure if it has a midi or net interface. i know people commanding PDP/PiDiP with midi faders or USB gamepads. also, PiDiP does some motion detection ( pdp_ctrack, pdp_mgrid, pdp_shape )
just a detail, it's only for linux & partly for OSX ( to be improved ).
cheers, sevy
hi,
well, video capture does not work on OSX. and the xvideo output is not available neither, so you have to use an opengl output.
- pidip has not been ported to OSX yet
but a guy from Medellin just told me he wanted to stick to it. ( there shouldn't be too much compatibility issues, it's plain C, but you need to get the dependency libs .. )
cheers, sevy
shreeswifty wrote:
sevy how partly for OS X what works if i may ask?
-----Original Message----- From: pd-list-admin@iem.at [mailto:pd-list-admin@iem.at]On Behalf Of Yves Degoyon Sent: Saturday, October 25, 2003 6:06 PM Cc: JHAVE; pd-list@iem.at Subject: Re: [PD] Re: GEM vs Jitter a newbie request for opinions (newbie sez thanks) hi,grab video from camera in real-time
no problem in PDP ( pdp_v4l from PDP ).periodically save it to a file(s)
no problem in PDP ( pdp_rec~ from PiDiP )
chroma key it as it is displayed
kind of ( you can use pdp_compose from PiDiP )
or use objects from Gem that can then be displayed in PDP ( using pdp2gem )concurrently display previously-saved video(s) behind the current real-time video
no problem in PDP ( pdp_qt )apply diverse effects in real-time to the previously-saved video files that have been loaded in
of course, a lot from PDP and PiDiP ( http://ydegoyon.free.fr/pidip.html )vary the amount of these effects according to gradiant input from a motion sensor
sure if it has a midi or net interface. i know people commanding PDP/PiDiP with midi faders or USB gamepads. also, PiDiP does some motion detection ( pdp_ctrack, pdp_mgrid, pdp_shape ) just a detail, it's only for linux & partly for OSX ( to be improved ). cheers, sevy
-
B. Bogart -
chris clepper -
JHAVE -
shreeswifty -
Yves Degoyon