Dear List,
I am still looking for a reasonable solution to have a video input to Mac OS X with Gem.
I was testing syphon_client, works almost OK, except that could not make any motion detector out of it, no pix_background works with it, cannot change contrast, threshold, basically nothing.
Just came to my mind the VLC plugin, which I have compiled luckily, but the documentation is so poor to the VLC plugin that cannot find a way to get a video device with one message into it.
Can anyone give me a nice hint to use the vlc plugin with a USB webcam connected directly to the computer? What is the message to use?
Thanks in advance for any help!
Popesz
Csaba Láng wrote:
Dear List,
I am still looking for a reasonable solution to have a video input to Mac OS X with Gem.
I was testing syphon_client, works almost OK, except that could not make any motion detector out of it, no pix_background works with it, cannot change contrast, threshold, basically nothing.
as far as i know from the mac/MAX-world, with syphon you get a TEXTURE, not a pix. which means that all pix_ objects won't work, because the data is on the GPU (not pixels calculated by the CPU).
this is actually a good thing for manipulating video as it's much more efficient, especially with larger image sizes.
the "downside" of it is that you have to enter the openGL world to do things. maybe start by checking out any texture-related GEM objects, like those listed under "MANIPULATORS" in the GEM documentation ([color], [scaleXYZ], [rotateXYZ] ...) to see if it gets you anywhere.
i have a handful of shaders concerning contrast, threshold, chromakey (the one i recently posted here) etc...
if you want i can post them for testing
best
oliver
Oliver,
sounds good, please share the shaders. Is there any option to move from GPU to CPU so the pix_whatever objects can manipulate them again?
Popesz
On Thu, Nov 22, 2018 at 4:09 PM oliver oliver@klingt.org wrote:
Csaba Láng wrote:
Dear List,
I am still looking for a reasonable solution to have a video input to Mac OS X with Gem.
I was testing syphon_client, works almost OK, except that could not make any motion detector out of it, no pix_background works with it, cannot change contrast, threshold, basically nothing.
as far as i know from the mac/MAX-world, with syphon you get a TEXTURE, not a pix. which means that all pix_ objects won't work, because the data is on the GPU (not pixels calculated by the CPU).
this is actually a good thing for manipulating video as it's much more efficient, especially with larger image sizes.
the "downside" of it is that you have to enter the openGL world to do things. maybe start by checking out any texture-related GEM objects, like those listed under "MANIPULATORS" in the GEM documentation ([color], [scaleXYZ], [rotateXYZ] ...) to see if it gets you anywhere.
i have a handful of shaders concerning contrast, threshold, chromakey (the one i recently posted here) etc...
if you want i can post them for testing
best
oliver
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Hi, dear list !
i took the opportunity of csaba's question to publish my glsl shader abstractions collection on GITHUB.
Hopefully it will be useful for other PD/Gem users as well.
Please feel free to test, (ab)use, report, critisize etc.
Csaba Láng wrote:
Oliver,
sounds good, please share the shaders.
here they are:
https://github.com/oliverstotz/ol_glsl
tested and working with PD 0.49 under windows 7 and macos (don't know the OS version, sorry. but it wasn't the newest ...)
Is there any option to move from GPU to CPU so the pix_whatever objects can manipulate them again?
i think there is (don't know for sure though, never did it with Gem), but AFAIKT it's not a good idea. i did it some time ago with MAX/JITTER and you lose a lot of computation power (also framerates) in the process. other than for monitoring/debugging reasons i would stay away from it.
best
oliver
To use VLC backend with [pix_video] :
where ... are instructions to use this backend. Explainations are here : https://wiki.videolan.org/VLC_command-line_help
For exemple to capture your screen, you can send [device screen://( ++
Jack
Le 22/11/2018 à 15:51, Csaba Láng a écrit :
Dear List,
I am still looking for a reasonable solution to have a video input to Mac OS X with Gem.
I was testing syphon_client, works almost OK, except that could not make any motion detector out of it, no pix_background works with it, cannot change contrast, threshold, basically nothing.
Just came to my mind the VLC plugin, which I have compiled luckily, but the documentation is so poor to the VLC plugin that cannot find a way to get a video device with one message into it.
Can anyone give me a nice hint to use the vlc plugin with a USB webcam connected directly to the computer? What is the message to use?
Thanks in advance for any help!
Popesz
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Perfect, thanks Jack, was looking for this page just could not find in the deep noise on the mighty internet!
On Thu, Nov 22, 2018 at 4:15 PM Jack jack@rybn.org wrote:
To use VLC backend with [pix_video] :
- send [driver vlc(
- then send a message [device ...(
where ... are instructions to use this backend. Explainations are here : https://wiki.videolan.org/VLC_command-line_help
For exemple to capture your screen, you can send [device screen://( ++
Jack
Le 22/11/2018 à 15:51, Csaba Láng a écrit :
Dear List,
I am still looking for a reasonable solution to have a video input to Mac OS X with Gem.
I was testing syphon_client, works almost OK, except that could not make any motion detector out of it, no pix_background works with it, cannot change contrast, threshold, basically nothing.
Just came to my mind the VLC plugin, which I have compiled luckily, but the documentation is so poor to the VLC plugin that cannot find a way to get a video device with one message into it.
Can anyone give me a nice hint to use the vlc plugin with a USB webcam connected directly to the computer? What is the message to use?
Thanks in advance for any help!
Popesz
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management ->
https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Just to make for others easier in the future, managed to have a video input from a webcam into Gem on Mac OS X 10.14 with the VLC plugin, which I admire very much :)
Opened vlc first and added a Capture Device, which opened immediately the webcam with a tytle of the window on the top: qtcapture://0x14100000043e3009. So sent a message to pix_vlc: device qtcapture://0x14100000043e3009 and tadam there is the live input from the webcam.
What is even better that I can use the same stream twice, once to VLC and simultaneously into Pd as well.
Thanks for all the info you gave, that is why I love this community!
Best, Popesz
On Thu, Nov 22, 2018 at 4:17 PM Csaba Láng langcsaba@gmail.com wrote:
Perfect, thanks Jack, was looking for this page just could not find in the deep noise on the mighty internet!
On Thu, Nov 22, 2018 at 4:15 PM Jack jack@rybn.org wrote:
To use VLC backend with [pix_video] :
- send [driver vlc(
- then send a message [device ...(
where ... are instructions to use this backend. Explainations are here : https://wiki.videolan.org/VLC_command-line_help
For exemple to capture your screen, you can send [device screen://( ++
Jack
Le 22/11/2018 à 15:51, Csaba Láng a écrit :
Dear List,
I am still looking for a reasonable solution to have a video input to Mac OS X with Gem.
I was testing syphon_client, works almost OK, except that could not make any motion detector out of it, no pix_background works with it, cannot change contrast, threshold, basically nothing.
Just came to my mind the VLC plugin, which I have compiled luckily, but the documentation is so poor to the VLC plugin that cannot find a way to get a video device with one message into it.
Can anyone give me a nice hint to use the vlc plugin with a USB webcam connected directly to the computer? What is the message to use?
Thanks in advance for any help!
Popesz
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management ->
https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Good to know ! Should be useful for OSX users. Thanx. ++
Jack
Le 22/11/2018 à 16:27, Csaba Láng a écrit :
Just to make for others easier in the future, managed to have a video input from a webcam into Gem on Mac OS X 10.14 with the VLC plugin, which I admire very much :)
Opened vlc first and added a Capture Device, which opened immediately the webcam with a tytle of the window on the top: qtcapture://0x14100000043e3009. So sent a message to pix_vlc: device qtcapture://0x14100000043e3009 and tadam there is the live input from the webcam.
What is even better that I can use the same stream twice, once to VLC and simultaneously into Pd as well.
Thanks for all the info you gave, that is why I love this community!
Best, Popesz
On Thu, Nov 22, 2018 at 4:17 PM Csaba Láng <langcsaba@gmail.com mailto:langcsaba@gmail.com> wrote:
Perfect, thanks Jack, was looking for this page just could not find in the deep noise on the mighty internet! On Thu, Nov 22, 2018 at 4:15 PM Jack <jack@rybn.org <mailto:jack@rybn.org>> wrote: To use VLC backend with [pix_video] : - send [driver vlc( - then send a message [device ...( where ... are instructions to use this backend. Explainations are here : https://wiki.videolan.org/VLC_command-line_help For exemple to capture your screen, you can send [device screen://( ++ Jack Le 22/11/2018 à 15:51, Csaba Láng a écrit : > Dear List, > > I am still looking for a reasonable solution to have a video input to > Mac OS X with Gem. > > I was testing syphon_client, works almost OK, except that could not make > any motion detector out of it, no pix_background works with it, cannot > change contrast, threshold, basically nothing. > > Just came to my mind the VLC plugin, which I have compiled luckily, but > the documentation is so poor to the VLC plugin that cannot find a way to > get a video device with one message into it. > > Can anyone give me a nice hint to use the vlc plugin with a USB webcam > connected directly to the computer? What is the message to use? > > Thanks in advance for any help! > > Popesz > > _______________________________________________ > Pd-list@lists.iem.at <mailto:Pd-list@lists.iem.at> mailing list > UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list > _______________________________________________ Pd-list@lists.iem.at <mailto:Pd-list@lists.iem.at> mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Somehow i never got the vlc plugin to work. How do you do it? Can someone enlighten me?
Am Do., 22. Nov. 2018, 17:01 hat Jack jack@rybn.org geschrieben:
Good to know ! Should be useful for OSX users. Thanx. ++
Jack
Le 22/11/2018 à 16:27, Csaba Láng a écrit :
Just to make for others easier in the future, managed to have a video input from a webcam into Gem on Mac OS X 10.14 with the VLC plugin, which I admire very much :)
Opened vlc first and added a Capture Device, which opened immediately the webcam with a tytle of the window on the top: qtcapture://0x14100000043e3009. So sent a message to pix_vlc: device qtcapture://0x14100000043e3009 and tadam there is the live input from the webcam.
What is even better that I can use the same stream twice, once to VLC and simultaneously into Pd as well.
Thanks for all the info you gave, that is why I love this community!
Best, Popesz
On Thu, Nov 22, 2018 at 4:17 PM Csaba Láng <langcsaba@gmail.com mailto:langcsaba@gmail.com> wrote:
Perfect, thanks Jack, was looking for this page just could not find in the deep noise on the mighty internet! On Thu, Nov 22, 2018 at 4:15 PM Jack <jack@rybn.org <mailto:jack@rybn.org>> wrote: To use VLC backend with [pix_video] : - send [driver vlc( - then send a message [device ...( where ... are instructions to use this backend. Explainations are here : https://wiki.videolan.org/VLC_command-line_help For exemple to capture your screen, you can send [device
screen://(
++ Jack Le 22/11/2018 à 15:51, Csaba Láng a écrit : > Dear List, > > I am still looking for a reasonable solution to have a video input to > Mac OS X with Gem. > > I was testing syphon_client, works almost OK, except that could not make > any motion detector out of it, no pix_background works with it, cannot > change contrast, threshold, basically nothing. > > Just came to my mind the VLC plugin, which I have compiled luckily, but > the documentation is so poor to the VLC plugin that cannot find a way to > get a video device with one message into it. > > Can anyone give me a nice hint to use the vlc plugin with a USB webcam > connected directly to the computer? What is the message to use? > > Thanks in advance for any help! > > Popesz > > _______________________________________________ > Pd-list@lists.iem.at <mailto:Pd-list@lists.iem.at> mailing
list
> UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list > _______________________________________________ Pd-list@lists.iem.at <mailto:Pd-list@lists.iem.at> mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management ->
https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
It was a long time ago when I compiled it for my Mac, but I guess with MacPort or homebrew, using the same method as for linux. Get the source of Gem from the github, and just compile it after installing libvlc-dev. I think that is the whole philosophy behind it.
On Thu, Nov 22, 2018 at 9:30 PM Johnny Mauser via Pd-list < pd-list@lists.iem.at> wrote:
Somehow i never got the vlc plugin to work. How do you do it? Can someone enlighten me?
Am Do., 22. Nov. 2018, 17:01 hat Jack jack@rybn.org geschrieben:
Good to know ! Should be useful for OSX users. Thanx. ++
Jack
Le 22/11/2018 à 16:27, Csaba Láng a écrit :
Just to make for others easier in the future, managed to have a video input from a webcam into Gem on Mac OS X 10.14 with the VLC plugin, which I admire very much :)
Opened vlc first and added a Capture Device, which opened immediately the webcam with a tytle of the window on the top: qtcapture://0x14100000043e3009. So sent a message to pix_vlc: device qtcapture://0x14100000043e3009 and tadam there is the live input from the webcam.
What is even better that I can use the same stream twice, once to VLC and simultaneously into Pd as well.
Thanks for all the info you gave, that is why I love this community!
Best, Popesz
On Thu, Nov 22, 2018 at 4:17 PM Csaba Láng <langcsaba@gmail.com mailto:langcsaba@gmail.com> wrote:
Perfect, thanks Jack, was looking for this page just could not find in the deep noise on the mighty internet! On Thu, Nov 22, 2018 at 4:15 PM Jack <jack@rybn.org <mailto:jack@rybn.org>> wrote: To use VLC backend with [pix_video] : - send [driver vlc( - then send a message [device ...( where ... are instructions to use this backend. Explainations are here : https://wiki.videolan.org/VLC_command-line_help For exemple to capture your screen, you can send [device
screen://(
++ Jack Le 22/11/2018 à 15:51, Csaba Láng a écrit : > Dear List, > > I am still looking for a reasonable solution to have a video input to > Mac OS X with Gem. > > I was testing syphon_client, works almost OK, except that could not make > any motion detector out of it, no pix_background works with it, cannot > change contrast, threshold, basically nothing. > > Just came to my mind the VLC plugin, which I have compiled luckily, but > the documentation is so poor to the VLC plugin that cannot find a way to > get a video device with one message into it. > > Can anyone give me a nice hint to use the vlc plugin with a USB webcam > connected directly to the computer? What is the message to
use?
> > Thanks in advance for any help! > > Popesz > > _______________________________________________ > Pd-list@lists.iem.at <mailto:Pd-list@lists.iem.at> mailing
list
> UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list > _______________________________________________ Pd-list@lists.iem.at <mailto:Pd-list@lists.iem.at> mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management ->
https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
my last 5 cents to this topic, I wanted to confirm that even the built-in FaceTime camera works stable. Hope helped to our Mac community.
Popesz
On Thu, Nov 22, 2018 at 9:35 PM Csaba Láng langcsaba@gmail.com wrote:
It was a long time ago when I compiled it for my Mac, but I guess with MacPort or homebrew, using the same method as for linux. Get the source of Gem from the github, and just compile it after installing libvlc-dev. I think that is the whole philosophy behind it.
On Thu, Nov 22, 2018 at 9:30 PM Johnny Mauser via Pd-list < pd-list@lists.iem.at> wrote:
Somehow i never got the vlc plugin to work. How do you do it? Can someone enlighten me?
Am Do., 22. Nov. 2018, 17:01 hat Jack jack@rybn.org geschrieben:
Good to know ! Should be useful for OSX users. Thanx. ++
Jack
Le 22/11/2018 à 16:27, Csaba Láng a écrit :
Just to make for others easier in the future, managed to have a video input from a webcam into Gem on Mac OS X 10.14 with the VLC plugin, which I admire very much :)
Opened vlc first and added a Capture Device, which opened immediately the webcam with a tytle of the window on the top: qtcapture://0x14100000043e3009. So sent a message to pix_vlc: device qtcapture://0x14100000043e3009 and tadam there is the live input from the webcam.
What is even better that I can use the same stream twice, once to VLC and simultaneously into Pd as well.
Thanks for all the info you gave, that is why I love this community!
Best, Popesz
On Thu, Nov 22, 2018 at 4:17 PM Csaba Láng <langcsaba@gmail.com mailto:langcsaba@gmail.com> wrote:
Perfect, thanks Jack, was looking for this page just could not find in the deep noise on the mighty internet! On Thu, Nov 22, 2018 at 4:15 PM Jack <jack@rybn.org <mailto:jack@rybn.org>> wrote: To use VLC backend with [pix_video] : - send [driver vlc( - then send a message [device ...( where ... are instructions to use this backend. Explainations are here : https://wiki.videolan.org/VLC_command-line_help For exemple to capture your screen, you can send [device
screen://(
++ Jack Le 22/11/2018 à 15:51, Csaba Láng a écrit : > Dear List, > > I am still looking for a reasonable solution to have a video input to > Mac OS X with Gem. > > I was testing syphon_client, works almost OK, except that could not make > any motion detector out of it, no pix_background works with it, cannot > change contrast, threshold, basically nothing. > > Just came to my mind the VLC plugin, which I have compiled luckily, but > the documentation is so poor to the VLC plugin that cannot find a way to > get a video device with one message into it. > > Can anyone give me a nice hint to use the vlc plugin with a USB webcam > connected directly to the computer? What is the message to
use?
> > Thanks in advance for any help! > > Popesz > > _______________________________________________ > Pd-list@lists.iem.at <mailto:Pd-list@lists.iem.at> mailing
list
> UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list > _______________________________________________ Pd-list@lists.iem.at <mailto:Pd-list@lists.iem.at> mailing
list
UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management ->
https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
No latency. Using the cam the same time in VLC and Gem, the image is identical.
On Fri, Nov 23, 2018 at 1:32 PM IOhannes m zmölnig zmoelnig@iem.at wrote:
On 11/23/18 1:22 PM, Csaba Láng wrote:
my last 5 cents to this topic, I wanted to confirm that even the built-in FaceTime camera works stable. Hope helped to our Mac community.
cool. can you tell us something about the latency of the camera?
gfmadsr IOhannes
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
the same as VLC produces, for me looks like 3-4 frames which is like a 100-120ms. Is there a way to measure it precisely?
On Fri, Nov 23, 2018 at 1:41 PM IOhannes m zmölnig zmoelnig@iem.at wrote:
On 11/23/18 1:34 PM, Csaba Láng wrote:
No latency. Using the cam the same time in VLC and Gem, the image is identical.
what i meant is: what is the latency between real actions and the captured video?
fmdst IOhannes
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
You can produce a test clip with a nr in each frame and play back this clip with an other machine. Then film this clip with your test setup and take photo with a short exposure of both, the orignal video and the recaptured test system. In your photo you will see the difference in frames. My experience with osx and puredata + Gem is a latency of minimum 160-200ms. I would be interested in other experiences!
Am Fr., 23. Nov. 2018, 13:44 hat Csaba Láng langcsaba@gmail.com geschrieben:
the same as VLC produces, for me looks like 3-4 frames which is like a 100-120ms. Is there a way to measure it precisely?
On Fri, Nov 23, 2018 at 1:41 PM IOhannes m zmölnig zmoelnig@iem.at wrote:
On 11/23/18 1:34 PM, Csaba Láng wrote:
No latency. Using the cam the same time in VLC and Gem, the image is identical.
what i meant is: what is the latency between real actions and the captured video?
fmdst IOhannes
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
I uploaded a small rudimentary testclip to puredata.info:
http://puredata.info/Members/johnnymauser/timetestclip/at_download/file
best wishes,
-j-
Am 23.11.2018 um 14:19 schrieb Johnny Mauser joson.android@googlemail.com:
You can produce a test clip with a nr in each frame and play back this clip with an other machine. Then film this clip with your test setup and take photo with a short exposure of both, the orignal video and the recaptured test system. In your photo you will see the difference in frames. My experience with osx and puredata + Gem is a latency of minimum 160-200ms. I would be interested in other experiences!
Am Fr., 23. Nov. 2018, 13:44 hat Csaba Láng langcsaba@gmail.com geschrieben: the same as VLC produces, for me looks like 3-4 frames which is like a 100-120ms. Is there a way to measure it precisely?
On Fri, Nov 23, 2018 at 1:41 PM IOhannes m zmölnig zmoelnig@iem.at wrote: On 11/23/18 1:34 PM, Csaba Láng wrote:
No latency. Using the cam the same time in VLC and Gem, the image is identical.
what i meant is: what is the latency between real actions and the captured video?
fmdst IOhannes
Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list _______________________________________________ Pd-list@lists.iem.at mailing list UNSUBSCRIBE and account-management -> https://lists.puredata.info/listinfo/pd-list
Quoting Csaba Láng langcsaba@gmail.com:
the same as VLC produces, for me looks like 3-4 frames which is like a 100-120ms.
thanks.
Is there a way to measure it precisely?
i was just curious, so your informal estimate is enough for me.
gfmards IOhannes