Hi here,
I'm working on a live stage performance mixing juggling and computer arts, I've already worked a little bit with gem. For a project using a 100 fps IP-camera (check http://www2.elphel.com/index.html) , I'm looking for a way to use a streamed video in gem. Although I know it would be better to use pdp for this kind of stuff, most of the patch is already done in GEM (with a 25 fps DV cam), and it would be a pain in the ass to make it from scratch in pdp. The problem is : I can encapsulate the stream in a .mov file in order to make QT think it is a local file, but the pix_film object is unable to load the frame in it (while QT, Quartz Composer or other QT-based application can do it).
any ideas of a solution ? I'm using a PowerBook G4 with OS 10.4.5, Pd-0.39-2 from Miller and GEM-CVS (11/05)
To give an idea of what we are looking to do, here is a video of the patch with the DV-Cam http://video.adrienm.net/LaboReTime.avi
PS : excuse for my poor english... _________________ www.adrienm.net "Et avec quelle quantité d'illusions ai-je dû naitre pour pouvoir en perdre une chaque jour ?" Cioran
Hi Adrien,
Do you get a green screen when you try and load the quicktime file? I never tried encapsulating in Mov, just did a .qtl file (quicktime pro can export it) If you are getting a green frame I think you just need to tell Gem to load the next frame when its available:
[pix_film]X[t f]
So the right outlet of pix_film goes to [t f] which connects to the frame (right) inlet of pix_film.
I can't remember if you need to send [auto 1< to pix_film, I don't think you do need to.
good luck.
.b.
Adrien Mondot wrote:
Hi here,
I'm working on a live stage performance mixing juggling and computer arts, I've already worked a little bit with gem. For a project using a 100 fps IP-camera (check http://www2.elphel.com/index.html) , I'm looking for a way to use a streamed video in gem. Although I know it would be better to use pdp for this kind of stuff, most of the patch is already done in GEM (with a 25 fps DV cam), and it would be a pain in the ass to make it from scratch in pdp. The problem is : I can encapsulate the stream in a .mov file in order to make QT think it is a local file, but the pix_film object is unable to load the frame in it (while QT, Quartz Composer or other QT-based application can do it).
any ideas of a solution ? I'm using a PowerBook G4 with OS 10.4.5, Pd-0.39-2 from Miller and GEM-CVS (11/05)
To give an idea of what we are looking to do, here is a video of the patch with the DV-Cam http://video.adrienm.net/LaboReTime.avi
PS : excuse for my poor english... _________________ www.adrienm.net "Et avec quelle quantité d'illusions ai-je dû naitre pour pouvoir en perdre une chaque jour ?" Cioran
GEM-dev mailing list GEM-dev@iem.at http://lists.puredata.info/listinfo/gem-dev
Great it seems to work...
Now I just need to buy a new computer to make it work at 100fps :-)
Thanks a lot A Le 28 mars 06 à 21:33, B. Bogart a écrit :
Hi Adrien,
Do you get a green screen when you try and load the quicktime file? I never tried encapsulating in Mov, just did a .qtl file (quicktime pro can export it) If you are getting a green frame I think you just need to tell Gem to load the next frame when its available:
[pix_film]X[t f]
So the right outlet of pix_film goes to [t f] which connects to the frame (right) inlet of pix_film.
I can't remember if you need to send [auto 1< to pix_film, I don't think you do need to.
good luck.
.b.
_________________ www.adrienm.net "Et avec quelle quantité d'illusions ai-je dû naitre pour pouvoir en perdre une chaque jour ?" Cioran
On 3/29/06, Adrien Mondot adrien.mondot@gmail.com wrote:
Great it seems to work...
Now I just need to buy a new computer to make it work at 100fps :-)
Thanks a lot A
A post on the Quicktime developer list seemed to indicate that the capture frame rates were pretty low using that camera. Can you give more details about the setup?
I just get a Mac Book Pro (today), I try to compile PD and GEM and make new test, I will make a short overview after on how it work.
What is surprising, is that QT perform very poorly in reading the stream versus mencoder or mplayer : there is a lot of frame drop in QT when you exceed the 25fps, while in mencoder everything work fine (in 100 fps) (this where done on a PowerBook G4)
And when just playing the stream in QTPlayer, it works, but if you try to use te stream in another app like QuartzComposer or PD, the stream break very often.
What kind of detail do you need about the setup ?
Le 30 mars 06 à 19:33, chris clepper a écrit :
On 3/29/06, Adrien Mondot adrien.mondot@gmail.com wrote:
Great it seems to work...
Now I just need to buy a new computer to make it work at 100fps :-)
Thanks a lot A
A post on the Quicktime developer list seemed to indicate that the capture frame rates were pretty low using that camera. Can you give more details about the setup?
_________________ www.adrienm.net "Et avec quelle quantité d'illusions ai-je dû naitre pour pouvoir en perdre une chaque jour ?" Cioran
Le 30 mars 06 à 19:33, chris clepper a écrit :
On 3/29/06, Adrien Mondot adrien.mondot@gmail.com wrote:
Great it seems to work...
Now I just need to buy a new computer to make it work at 100fps :-)
Thanks a lot A
A post on the Quicktime developer list seemed to indicate that the capture frame rates were pretty low using that camera. Can you give more details about the setup?
_________________ www.adrienm.net "Et avec quelle quantité d'illusions ai-je dû naitre pour pouvoir en perdre une chaque jour ?" Cioran
Neither of the OSX GEM developers have Intel Macs but someone on the list was working on compiling it recently.
We don't have any code specific to rtsp in GEM. Quicktime supposedly handles all of that internally, but there are probably certain parts of the API to help streaming. One thing to make sure you do in GEM is set the gemwin frame rate to at least 100 [gemwin 100]. At that point it is possible for Quicktime to deliver frames to GEM that fast, but I have never tested anything like that. Also, everything in GEM will run at that frame rate so the load on the CPU and GPU will go up.
On 3/31/06, Adrien Mondot adrien.mondot@gmail.com wrote:
I just get a Mac Book Pro (today), I try to compile PD and GEM and make new test, I will make a short overview after on how it work. What is surprising, is that QT perform very poorly in reading the stream versus mencoder or mplayer : there is a lot of frame drop in QT when you exceed the 25fps, while in mencoder everything work fine (in 100 fps) (this where done on a PowerBook G4)
And when just playing the stream in QTPlayer, it works, but if you try to use te stream in another app like QuartzComposer or PD, the stream break very often.
What kind of detail do you need about the setup ?
Is there anyway to stream out RTSP from Gem in a similar way?
.hc
On Mar 29, 2006, at 10:52 AM, Adrien Mondot wrote:
Great it seems to work...
Now I just need to buy a new computer to make it work at 100fps :-)
Thanks a lot A Le 28 mars 06 à 21:33, B. Bogart a écrit :
Hi Adrien,
Do you get a green screen when you try and load the quicktime file? I never tried encapsulating in Mov, just did a .qtl file (quicktime pro can export it) If you are getting a green frame I think you just need to tell Gem to load the next frame when its available:
[pix_film]X[t f]
So the right outlet of pix_film goes to [t f] which connects to the frame (right) inlet of pix_film.
I can't remember if you need to send [auto 1< to pix_film, I don't think you do need to.
good luck.
.b.
www.adrienm.net "Et avec quelle quantité d'illusions ai-je dû naitre pour pouvoir en perdre une chaque jour ?" Cioran
GEM-dev mailing list GEM-dev@iem.at http://lists.puredata.info/listinfo/gem-dev
________________________________________________________________________ ____
¡El pueblo unido jamás será vencido!
Hello,
I'm still fighting with pd to make it compile on a brand new intel- mac... I tried to use Hans's Darwin_app packages, and after some tweak and dirty hacks (no portaudio, no portmidi no ogg, no jack, and no loader), I managed to have a pd.app bundle. The problem is that it don't manage to load the external although they are in the good place and just fresh compiled. As I don't really know the source tree of the pd packages and how it works, it is pretty hard to understand why... One of the obvious solution would be that disabling the loader in the external prevent pd from load any external ?
But the loader don't compile, I have this error :
/Users/Adrien/SourcesProg/packages/darwin_app/../../externals/loaders/ import.c:27: error: too few arguments to function 'sys_load_lib'
the line 27 of import.c is : if (!sys_load_lib(sys_libdir->s_name, libname))
One of the other problem is that althought I'm compiling everything, the bundle is still in ppc (but almost everything inside is i386 except the Pd-0.39/Contents/MacOS/pd-0.39), and I don't understant how to force to make it intel native.
Help please....
Le 31 mars 06 à 03:29, Hans-Christoph Steiner a écrit :
Is there anyway to stream out RTSP from Gem in a similar way?
Well I believe it should be possible with some quicktime-code, maybe it would be more interresting to wait for the next release of the quicktime API wich should be really more clean than the actual one. However there is sample code on http://developer.apple.com/samplecode/ QuickTime/idxGraphicsImaging-date.html that allow to output the video buffer via the firewire port.
_________________ www.adrienm.net "Et avec quelle quantité d'illusions ai-je dû naitre pour pouvoir en perdre une chaque jour ?" Cioran
On Apr 1, 2006, at 11:38 AM, Adrien Mondot wrote:
Hello,
I'm still fighting with pd to make it compile on a brand new intel- mac... I tried to use Hans's Darwin_app packages, and after some tweak and dirty hacks (no portaudio, no portmidi no ogg, no jack, and no loader), I managed to have a pd.app bundle. The problem is that it don't manage to load the external although they are in the good place and just fresh compiled. As I don't really know the source tree of the pd packages and how it works, it is pretty hard to understand why... One of the obvious solution would be that disabling the loader in the external prevent pd from load any external ?
But the loader don't compile, I have this error :
/Users/Adrien/SourcesProg/packages/darwin_app/../../externals/ loaders/import.c:27: error: too few arguments to function 'sys_load_lib'
the line 27 of import.c is : if (!sys_load_lib(sys_libdir->s_name, libname))
One of the other problem is that althought I'm compiling everything, the bundle is still in ppc (but almost everything inside is i386 except the Pd-0.39/Contents/MacOS/pd-0.39), and I don't understant how to force to make it intel native.
Help please....
With Pd-extended, you need to apply all of the patches first before compiling. That above error is caused by the lack of the libdir patch. You do that by: "cd packages/ && make patch_pd". Right now that expects 0.39.2 and probably won't work with other versions.
Pd-extended is indeed very complicated. Hopefully we can simplify things by unifying build systems. Also, docs always help. I find it very useful to document whenever I am trying something new. Anything you can add to this wiki page would be helpful.
https://puredata.org/docs/developer/MacOSXApp
Le 31 mars 06 à 03:29, Hans-Christoph Steiner a écrit :
Is there anyway to stream out RTSP from Gem in a similar way?
Well I believe it should be possible with some quicktime-code, maybe it would be more interresting to wait for the next release of the quicktime API wich should be really more clean than the actual one. However there is sample code on http://developer.apple.com/ samplecode/QuickTime/idxGraphicsImaging-date.html that allow to output the video buffer via the firewire port.
So there is no existing way to stream out RTSP from Pd right now? I know about [pdp_theorice], but RTSP would be nice to have also.
.hc
________________________________________________________________________ ____
As we enjoy great advantages from inventions of others, we should be glad of an opportunity to serve others by any invention of ours; and this we should do freely and generously. - Benjamin Franklin
On Apr 1, 2006, at 11:38 AM, Adrien Mondot wrote:
Hello,
I'm still fighting with pd to make it compile on a brand new intel- mac... I tried to use Hans's Darwin_app packages, and after some tweak and dirty hacks (no portaudio, no portmidi no ogg, no jack, and no loader), I managed to have a pd.app bundle. The problem is that it don't manage to load the external although they are in the good place and just fresh compiled. As I don't really know the source tree of the pd packages and how it works, it is pretty hard to understand why... One of the obvious solution would be that disabling the loader in the external prevent pd from load any external ?
But the loader don't compile, I have this error :
/Users/Adrien/SourcesProg/packages/darwin_app/../../externals/ loaders/import.c:27: error: too few arguments to function 'sys_load_lib'
the line 27 of import.c is : if (!sys_load_lib(sys_libdir->s_name, libname))
One of the other problem is that althought I'm compiling everything, the bundle is still in ppc (but almost everything inside is i386 except the Pd-0.39/Contents/MacOS/pd-0.39), and I don't understant how to force to make it intel native.
Help please....
Actually, this is a pretty good document on this topic, let me know if anything is missing:
https://puredata.org/docs/developer/darwin
(its not a wiki, I guess it should be...)
./hc
Le 31 mars 06 à 03:29, Hans-Christoph Steiner a écrit :
Is there anyway to stream out RTSP from Gem in a similar way?
Well I believe it should be possible with some quicktime-code, maybe it would be more interresting to wait for the next release of the quicktime API wich should be really more clean than the actual one. However there is sample code on http://developer.apple.com/ samplecode/QuickTime/idxGraphicsImaging-date.html that allow to output the video buffer via the firewire port.
www.adrienm.net "Et avec quelle quantité d'illusions ai-je dû naitre pour pouvoir en perdre une chaque jour ?" Cioran
________________________________________________________________________ ____
"Looking at things from a more basic level, you can come up with a more direct solution... It may sound small in theory, but it in practice, it can change entire economies." - Amy Smith
On Apr 1, 2006, at 11:38 AM, Adrien Mondot wrote:
I'm still fighting with pd to make it compile on a brand new intel- mac...
...I'm hoping to get an intel mac after I get my current projects done, so you're really going to have to depend on pd's and apple's documentation to get this going...
I tried to use Hans's Darwin_app packages, and after some tweak and dirty hacks (no portaudio, no portmidi no ogg, no jack, and no loader), I managed to have a pd.app bundle. The problem is that it don't manage to load the external although they are in the good place and just fresh compiled. As I don't really know the source tree of the pd packages and how it works, it is pretty hard to understand why... One of the obvious solution would be that disabling the loader in the external prevent pd from load any external ?
...no: I didn't even realize that there was an external [loader] until now (ie. I had no problem loading externals when I first built pd last summer on the preview intel macs)...unfortunately I just don't have time to help here...
But the loader don't compile, I have this error :
/Users/Adrien/SourcesProg/packages/darwin_app/../../externals/ loaders/import.c:27: error: too few arguments to function 'sys_load_lib'
the line 27 of import.c is : if (!sys_load_lib(sys_libdir->s_name, libname))
One of the other problem is that althought I'm compiling everything, the bundle is still in ppc (but almost everything inside is i386 except the Pd-0.39/Contents/MacOS/pd-0.39), and I don't understant how to force to make it intel native.
...I believe this externals/loader/import object is only tested with pd-0.38-4...and you shouldn't need it unless you want to experiment and help hans work on namespaces...
Help please....
Le 31 mars 06 à 03:29, Hans-Christoph Steiner a écrit :
Is there anyway to stream out RTSP from Gem in a similar way?
Well I believe it should be possible with some quicktime-code, maybe it would be more interresting to wait for the next release of the quicktime API wich should be really more clean than the actual one. However there is sample code on http://developer.apple.com/ samplecode/QuickTime/idxGraphicsImaging-date.html that allow to output the video buffer via the firewire port.
...sure, there's tons of sample code, but chris and I only have so much time...in other words, we accept patches, or large sums of money ;-)
james
On 4/1/06, Adrien Mondot adrien.mondot@gmail.com wrote:
Le 31 mars 06 ŕ 03:29, Hans-Christoph Steiner a écrit :
Is there anyway to stream out RTSP from Gem in a similar way?
Well I believe it should be possible with some quicktime-code, maybe it would be more interresting to wait for the next release of the quicktime API wich should be really more clean than the actual one. However there is sample code on http://developer.apple.com/samplecode/QuickTime/idxGraphicsImaging-date.html that allow to output the video buffer *via *the firewire port.
The problem with implementing both rtsp and firewire is that it is a hell of a lot of work and the results pretty much suck. It's not worth expending the effort on it.
There are better ways to do both things already.
-
Adrien Mondot -
B. Bogart -
chris clepper -
Hans-Christoph Steiner -
james tittle