Hi list,
I'm looking for a solution to use the gem output on an android phone for vr.
I found this app, but it is windows only, no linux host. http://www.swatterco.com/vr_streamer.php
Any ideas about this?
m.
Hey Max,
Recently I have been looking at this very subject, in the end using trinus vr (trinusvirtualreality.com) on windows was the easiest solution for me
I have tried something similar on linux (Fedora) but my problem was just getting my PC to actually connect with my phone- this would be trivial I assume for someone who is experienced setting up VNC connections/networking on Linux. So take a look at these and good luck
https://play.google.com/store/apps/details?id=tantra.tantransha.cardboardrem... http://www.vrbites.com/apps/cardboard-vnc-free/
On Fri, Mar 31, 2017 at 8:34 PM, Max abonnements@revolwear.com wrote:
Hi list,
I'm looking for a solution to use the gem output on an android phone for vr.
I found this app, but it is windows only, no linux host. http://www.swatterco.com/vr_streamer.php
Any ideas about this?
m.
GEM-dev mailing list GEM-dev@lists.iem.at https://lists.puredata.info/listinfo/gem-dev
Hi Alan,
that's interesting. I haven't thought about the VNC option. I will need A VNC server on my Linux computer which allows me to send the content of the GEM window only.
This apps seem useful to get the accelerometer, compass and gyro sensor data to the Pd host. https://sensors2.org/osc/ https://sensors2.org/pd/
Another idea would be to use VLC on the android phone to open a stream that is sent by the computer via Pd/Gem and some way to cast the stream.
On 2017년 04월 01일 23:31, Alan Brooker wrote:
Hey Max,
Recently I have been looking at this very subject, in the end using trinus vr (trinusvirtualreality.com http://trinusvirtualreality.com) on windows was the easiest solution for me
I have tried something similar on linux (Fedora) but my problem was just getting my PC to actually connect with my phone- this would be trivial I assume for someone who is experienced setting up VNC connections/networking on Linux. So take a look at these and good luck
https://play.google.com/store/apps/details?id=tantra.tantransha.cardboardrem... http://www.vrbites.com/apps/cardboard-vnc-free/
On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements@revolwear.com mailto:abonnements@revolwear.com> wrote:
Hi list, I'm looking for a solution to use the gem output on an android phone for vr. I found this app, but it is windows only, no linux host. http://www.swatterco.com/vr_streamer.php <http://www.swatterco.com/vr_streamer.php> Any ideas about this? m. _______________________________________________ GEM-dev mailing list GEM-dev@lists.iem.at <mailto:GEM-dev@lists.iem.at> https://lists.puredata.info/listinfo/gem-dev <https://lists.puredata.info/listinfo/gem-dev>
On 2017년 04월 02일 20:01, Max wrote:
Hi Alan,
that's interesting. I haven't thought about the VNC option. I will need A VNC server on my Linux computer which allows me to send the content of the GEM window only.
Note to self and anyone searching this some day: this works with x11vnc. Use the command xwininfo to find out the ID of the window to be shared, then use x11vnc -id {id number here} to share only one window to the vnc client.
However cardboard-vnc-free is doing too much. First of all, it controls the moise pointer on the server (as a VNC client should) but I don't need that. There is an option "Viewer" in the connection settings that will diable this and lower the latency from about 3 seconds to 1 second.
cardboard-vnc-free is also adding two viewports to the shared image, to fake a 3D. That's a show stopper, because I want to use the stereo mode in GEM.
Another idea would be to use VLC on the android phone to open a stream that is sent by the computer via Pd/Gem and some way to cast the stream.
I think this is the way to go. It also has lower latency than a VNC connection.
What's the best way to stream a GEM window, so that I can play this stream with VLC on the Android device?
M.
On 2017년 04월 01일 23:31, Alan Brooker wrote:
Hey Max,
Recently I have been looking at this very subject, in the end using trinus vr (trinusvirtualreality.com http://trinusvirtualreality.com) on windows was the easiest solution for me
I have tried something similar on linux (Fedora) but my problem was just getting my PC to actually connect with my phone- this would be trivial I assume for someone who is experienced setting up VNC connections/networking on Linux. So take a look at these and good luck
https://play.google.com/store/apps/details?id=tantra.tantransha.cardboardrem...
http://www.vrbites.com/apps/cardboard-vnc-free/
On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements@revolwear.com mailto:abonnements@revolwear.com> wrote:
Hi list, I'm looking for a solution to use the gem output on an android phone for vr. I found this app, but it is windows only, no linux host. http://www.swatterco.com/vr_streamer.php <http://www.swatterco.com/vr_streamer.php> Any ideas about this? m.
Hello,
Le 03/04/2017 à 18:50, Max a écrit :
On 2017년 04월 02일 20:01, Max wrote:
Hi Alan,
that's interesting. I haven't thought about the VNC option. I will need A VNC server on my Linux computer which allows me to send the content of the GEM window only.
Note to self and anyone searching this some day: this works with x11vnc. Use the command xwininfo to find out the ID of the window to be shared, then use x11vnc -id {id number here} to share only one window to the vnc client.
However cardboard-vnc-free is doing too much. First of all, it controls the moise pointer on the server (as a VNC client should) but I don't need that. There is an option "Viewer" in the connection settings that will diable this and lower the latency from about 3 seconds to 1 second.
cardboard-vnc-free is also adding two viewports to the shared image, to fake a 3D. That's a show stopper, because I want to use the stereo mode in GEM.
Another idea would be to use VLC on the android phone to open a stream that is sent by the computer via Pd/Gem and some way to cast the stream.
I think this is the way to go. It also has lower latency than a VNC connection.
What's the best way to stream a GEM window, so that I can play this stream with VLC on the Android device?
I would say (if you are on linux) : use https://github.com/umlaeute/v4l2loopback to create a virtual v4l2 device, then it's possible to use pix_record eventually in conjonction with pix_snap to shoot Gem window and write it to this virtual v4l2 device (on my computer, it would involve to send a [codec v4l2< message to pix_record) then you can stream to the Android device with ffmpeg fed by this v4l2 device and read it with vlc
also possible to grab the Gem screen with ffmpeg -f x11grab +options
++ b
M.
On 2017년 04월 01일 23:31, Alan Brooker wrote:
Hey Max,
Recently I have been looking at this very subject, in the end using trinus vr (trinusvirtualreality.com http://trinusvirtualreality.com) on windows was the easiest solution for me
I have tried something similar on linux (Fedora) but my problem was just getting my PC to actually connect with my phone- this would be trivial I assume for someone who is experienced setting up VNC connections/networking on Linux. So take a look at these and good luck
https://play.google.com/store/apps/details?id=tantra.tantransha.cardboardrem...
http://www.vrbites.com/apps/cardboard-vnc-free/
On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements@revolwear.com mailto:abonnements@revolwear.com> wrote:
Hi list, I'm looking for a solution to use the gem output on an android
phone for vr.
I found this app, but it is windows only, no linux host. http://www.swatterco.com/vr_streamer.php <http://www.swatterco.com/vr_streamer.php> Any ideas about this? m.
GEM-dev mailing list GEM-dev@lists.iem.at https://lists.puredata.info/listinfo/gem-dev
Hi,
I was thinking about a solution to stream Gem output to network device for a while And the solution that came up to my mind is to render in a frame buffer and send the texture to a GPU video encoder like nvenc then download the encoded frame to the RAM and stream it.
This would be much more efficient than direct screen grabbing.
Unfortunately I didn't take the time to implement this for now. Some vnc server use hardware compression but I don't know one on Linux.
Best
A
Le 3 avr. 2017 9:08 PM, "Benjamin ~ b01" benjah@free.fr a écrit :
Hello,
Le 03/04/2017 à 18:50, Max a écrit :
On 2017년 04월 02일 20:01, Max wrote:
Hi Alan,
that's interesting. I haven't thought about the VNC option. I will need A VNC server on my Linux computer which allows me to send the content of the GEM window only.
Note to self and anyone searching this some day: this works with x11vnc. Use the command xwininfo to find out the ID of the window to be shared, then use x11vnc -id {id number here} to share only one window to the vnc client.
However cardboard-vnc-free is doing too much. First of all, it controls the moise pointer on the server (as a VNC client should) but I don't need that. There is an option "Viewer" in the connection settings that will diable this and lower the latency from about 3 seconds to 1 second.
cardboard-vnc-free is also adding two viewports to the shared image, to fake a 3D. That's a show stopper, because I want to use the stereo mode in GEM.
Another idea would be to use VLC on the android phone to open a stream that is sent by the computer via Pd/Gem and some way to cast the stream.
I think this is the way to go. It also has lower latency than a VNC connection.
What's the best way to stream a GEM window, so that I can play this stream with VLC on the Android device?
I would say (if you are on linux) : use https://github.com/umlaeute/v4l2loopback to create a virtual v4l2 device, then it's possible to use pix_record eventually in conjonction with pix_snap to shoot Gem window and write it to this virtual v4l2 device (on my computer, it would involve to send a [codec v4l2< message to pix_record) then you can stream to the Android device with ffmpeg fed by this v4l2 device and read it with vlc
also possible to grab the Gem screen with ffmpeg -f x11grab +options
++ b
M.
On 2017년 04월 01일 23:31, Alan Brooker wrote:
Hey Max,
Recently I have been looking at this very subject, in the end using trinus vr (trinusvirtualreality.com http://trinusvirtualreality.com) on windows was the easiest solution for me
I have tried something similar on linux (Fedora) but my problem was just getting my PC to actually connect with my phone- this would be trivial I assume for someone who is experienced setting up VNC connections/networking on Linux. So take a look at these and good luck
https://play.google.com/store/apps/details?id=tantra.tantransha.
cardboardremotedesktop.lite&hl=en
http://www.vrbites.com/apps/cardboard-vnc-free/
On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements@revolwear.com mailto:abonnements@revolwear.com> wrote:
Hi list, I'm looking for a solution to use the gem output on an android
phone for vr.
I found this app, but it is windows only, no linux host. http://www.swatterco.com/vr_streamer.php <http://www.swatterco.com/vr_streamer.php> Any ideas about this? m.
GEM-dev mailing list GEM-dev@lists.iem.at https://lists.puredata.info/listinfo/gem-dev
GEM-dev mailing list GEM-dev@lists.iem.at https://lists.puredata.info/listinfo/gem-dev
Thank you so much Antoine and Benjamin for those ideas, I'll try to get this running.
I also saw that it's possible to open the Gemwwin on a remote host with the [remotehost( message to [gemwin] (see gemwin-help) However, there is no further explanation of that feature and I haven't seen any discussion on pd-list or here about it. I was wondering if that could work too. With an X Server running on the Android. https://f-droid.org/repository/browse/?fdfilter=x%20server&fdid=au.com.d...
Or am I missing something?
On 2017년 04월 04일 09:33, Antoine Villeret wrote:
Hi,
I was thinking about a solution to stream Gem output to network device for a while And the solution that came up to my mind is to render in a frame buffer and send the texture to a GPU video encoder like nvenc then download the encoded frame to the RAM and stream it.
This would be much more efficient than direct screen grabbing.
Unfortunately I didn't take the time to implement this for now. Some vnc server use hardware compression but I don't know one on Linux.
Best
A
Le 3 avr. 2017 9:08 PM, "Benjamin ~ b01" <benjah@free.fr mailto:benjah@free.fr> a écrit :
Hello, Le 03/04/2017 à 18:50, Max a écrit : > On 2017년 04월 02일 20:01, Max wrote: >> Hi Alan, >> >> that's interesting. I haven't thought about the VNC option. I will need >> A VNC server on my Linux computer which allows me to send the content of >> the GEM window only. > > Note to self and anyone searching this some day: this works with x11vnc. > Use the command xwininfo to find out the ID of the window to be > shared, then use > x11vnc -id {id number here} > to share only one window to the vnc client. > > However cardboard-vnc-free is doing too much. First of all, it > controls the moise pointer on the server (as a VNC client should) but > I don't need that. There is an option "Viewer" in the connection > settings that will diable this and lower the latency from about 3 > seconds to 1 second. > > cardboard-vnc-free is also adding two viewports to the shared image, > to fake a 3D. That's a show stopper, because I want to use the stereo > mode in GEM. > >> Another idea would be to use VLC on the android phone to open a stream >> that is sent by the computer via Pd/Gem and some way to cast the stream. > > I think this is the way to go. It also has lower latency than a VNC > connection. > > What's the best way to stream a GEM window, so that I can play this > stream with VLC on the Android device? I would say (if you are on linux) : use https://github.com/umlaeute/v4l2loopback <https://github.com/umlaeute/v4l2loopback> to create a virtual v4l2 device, then it's possible to use pix_record eventually in conjonction with pix_snap to shoot Gem window and write it to this virtual v4l2 device (on my computer, it would involve to send a [codec v4l2< message to pix_record) then you can stream to the Android device with ffmpeg fed by this v4l2 device and read it with vlc also possible to grab the Gem screen with ffmpeg -f x11grab +options ++ b > > > M. > > > >> On 2017년 04월 01일 23:31, Alan Brooker wrote: >>> Hey Max, >>> >>> Recently I have been looking at this very subject, in the end using >>> trinus vr (trinusvirtualreality.com <http://trinusvirtualreality.com> <http://trinusvirtualreality.com <http://trinusvirtualreality.com>>) >>> on windows was the easiest solution for me >>> >>> I have tried something similar on linux (Fedora) but my problem was >>> just getting my PC to actually connect with my phone- this would be >>> trivial I assume for someone who is experienced setting up VNC >>> connections/networking on Linux. So take a look at these and good luck >>> >>> https://play.google.com/store/apps/details?id=tantra.tantransha.cardboardremotedesktop.lite&hl=en <https://play.google.com/store/apps/details?id=tantra.tantransha.cardboardremotedesktop.lite&hl=en> >>> >>> >>> http://www.vrbites.com/apps/cardboard-vnc-free/ <http://www.vrbites.com/apps/cardboard-vnc-free/> >>> >>> On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements@revolwear.com <mailto:abonnements@revolwear.com> >>> <mailto:abonnements@revolwear.com <mailto:abonnements@revolwear.com>>> wrote: >>> >>> Hi list, >>> >>> I'm looking for a solution to use the gem output on an android >>> phone >>> for vr. >>> >>> I found this app, but it is windows only, no linux host. >>> http://www.swatterco.com/vr_streamer.php <http://www.swatterco.com/vr_streamer.php> >>> <http://www.swatterco.com/vr_streamer.php <http://www.swatterco.com/vr_streamer.php>> >>> >>> Any ideas about this? >>> >>> m.
concerning the remotehost message I think you are referring to [create remotehost:id( message right ? this message let you choose the X display where to open the rendering window.
I'm using it when controlling patch over SSH, the patch GUI is displayed on my laptop somewhere in the world, while the rendering window is displayed on the local computer on which Pd is running. I have to create the window with [create locahost:0( because on an SSH session with window forwarding (ssh -x or ssh -y) $DISPLAY env variable is defined to :10. I don't know how to do the reverse (display patcher GUI on local computer and rendering window on remote one, in your case an android device)
I'm also using VirtualGL to display OpenGL accelerated window on a remote device for example to display rendering window on my laptop over SSH. VIrtual GL is much more efficient than any VNC application I ever used (but I didn't try them all). Unfortunately VirtualGL doesn't seem to work on Android.
Best
Antoine
-- do it yourself http://antoine.villeret.free.fr
2017-04-04 10:14 GMT+02:00 Max abonnements@revolwear.com:
Thank you so much Antoine and Benjamin for those ideas, I'll try to get this running.
I also saw that it's possible to open the Gemwwin on a remote host with the [remotehost( message to [gemwin] (see gemwin-help) However, there is no further explanation of that feature and I haven't seen any discussion on pd-list or here about it. I was wondering if that could work too. With an X Server running on the Android. https://f-droid.org/repository/browse/?fdfilter=x%20server& fdid=au.com.darkside.XServer
Or am I missing something?
On 2017년 04월 04일 09:33, Antoine Villeret wrote:
Hi,
I was thinking about a solution to stream Gem output to network device for a while And the solution that came up to my mind is to render in a frame buffer and send the texture to a GPU video encoder like nvenc then download the encoded frame to the RAM and stream it.
This would be much more efficient than direct screen grabbing.
Unfortunately I didn't take the time to implement this for now. Some vnc server use hardware compression but I don't know one on Linux.
Best
A
Le 3 avr. 2017 9:08 PM, "Benjamin ~ b01" <benjah@free.fr mailto:benjah@free.fr> a écrit :
Hello, Le 03/04/2017 à 18:50, Max a écrit : > On 2017년 04월 02일 20:01, Max wrote: >> Hi Alan, >> >> that's interesting. I haven't thought about the VNC option. I will need >> A VNC server on my Linux computer which allows me to send the content of >> the GEM window only. > > Note to self and anyone searching this some day: this works with x11vnc. > Use the command xwininfo to find out the ID of the window to be > shared, then use > x11vnc -id {id number here} > to share only one window to the vnc client. > > However cardboard-vnc-free is doing too much. First of all, it > controls the moise pointer on the server (as a VNC client should)
but > I don't need that. There is an option "Viewer" in the connection > settings that will diable this and lower the latency from about 3 > seconds to 1 second. > > cardboard-vnc-free is also adding two viewports to the shared image, > to fake a 3D. That's a show stopper, because I want to use the stereo > mode in GEM. > >> Another idea would be to use VLC on the android phone to open a stream >> that is sent by the computer via Pd/Gem and some way to cast the stream. > > I think this is the way to go. It also has lower latency than a VNC > connection. > > What's the best way to stream a GEM window, so that I can play this > stream with VLC on the Android device? I would say (if you are on linux) : use https://github.com/umlaeute/v4l2loopback https://github.com/umlaeute/v4l2loopback to create a virtual v4l2 device, then it's possible to use pix_record eventually in conjonction with pix_snap to shoot Gem window and write it to this virtual v4l2 device (on my computer, it would involve to send a [codec v4l2< message to pix_record) then you can stream to the Android device with ffmpeg fed by this v4l2 device and read it with vlc
also possible to grab the Gem screen with ffmpeg -f x11grab +options ++ b > > > M. > > > >> On 2017년 04월 01일 23:31, Alan Brooker wrote: >>> Hey Max, >>> >>> Recently I have been looking at this very subject, in the end
using >>> trinus vr (trinusvirtualreality.com http://trinusvirtualreality.com <http://trinusvirtualreality.com http://trinusvirtualreality.com>) >>> on windows was the easiest solution for me >>> >>> I have tried something similar on linux (Fedora) but my problem was >>> just getting my PC to actually connect with my phone- this would be >>> trivial I assume for someone who is experienced setting up VNC >>> connections/networking on Linux. So take a look at these and good luck >>> >>> https://play.google.com/store/apps/details?id=tantra.tantran sha.cardboardremotedesktop.lite&hl=en https://play.google.com/store/apps/details?id=tantra.tantra nsha.cardboardremotedesktop.lite&hl=en >>> >>> >>> http://www.vrbites.com/apps/cardboard-vnc-free/ http://www.vrbites.com/apps/cardboard-vnc-free/ >>> >>> On Fri, Mar 31, 2017 at 8:34 PM, Max <abonnements@revolwear.com mailto:abonnements@revolwear.com >>> <mailto:abonnements@revolwear.com mailto:abonnements@revolwear.com>> wrote: >>> >>> Hi list, >>> >>> I'm looking for a solution to use the gem output on an android >>> phone >>> for vr. >>> >>> I found this app, but it is windows only, no linux host. >>> http://www.swatterco.com/vr_streamer.php http://www.swatterco.com/vr_streamer.php >>> <http://www.swatterco.com/vr_streamer.php http://www.swatterco.com/vr_streamer.php> >>> >>> Any ideas about this? >>> >>> m.
On 2017년 04월 04일 10:34, Antoine Villeret wrote:
I'm also using VirtualGL to display OpenGL accelerated window on a remote device for example to display rendering window on my laptop over SSH. VIrtual GL is much more efficient than any VNC application I ever used (but I didn't try them all). Unfortunately VirtualGL doesn't seem to work on Android.
maybe it is possible: https://play.google.com/store/apps/details?id=x.org.server (that background music....)
:)
I can see the Pd gui on my phone with $ export PULSE_SERVER=tcp:{local IP}:4712 metacity & puredata
the test audio patch makes noise on the computer.
It (expectedly) doesn't allow me to open a GEM window
error: GEM: X server has no OpenGL GLX extension error: GEM: Error creating const context error: GEM: A serious error occured creating const Context error: GEM: Continue at your own risk! error: GEM: X server has no OpenGL GLX extension error: GEM: Unable to create window error: [gemwin]: no window made error: GEM: Create window first! error: JACKerror: SuspendRefNum error error: JACKerror: JackClient::Execute error name = pure_data_2 error: JACK: server shut down
On 2017년 04월 04일 11:16, Max wrote:
On 2017년 04월 04일 10:34, Antoine Villeret wrote:
I'm also using VirtualGL to display OpenGL accelerated window on a remote device for example to display rendering window on my laptop over SSH. VIrtual GL is much more efficient than any VNC application I ever used (but I didn't try them all). Unfortunately VirtualGL doesn't seem to work on Android.
maybe it is possible: https://play.google.com/store/apps/details?id=x.org.server (that background music....)
:)
GEM-dev mailing list GEM-dev@lists.iem.at https://lists.puredata.info/listinfo/gem-dev