Hello
I am collaborating with a programmer who has developed a kinect streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear some ideas regarding what to do with the data
Cheers~
pp
The first thing to try out is a theremin, of course. Then, I find it fun to put "sound objects" floating in the space and map its volume or triggering to the distance to one of your joints (hand, for instance), so that when you "touch" them they sound. You can also try more complex things. Playing with distance between joints is also fun, because you get rid of the "absolutness" of the camera. Or you can even map things to the angle between your arms, and so. I made a kind of air violin with it. It's useful to have tools to work with the data, I was working on a linear algebra abstractions library with dot products, distance, sum of vectors, etc implemented but it's kind of on idle by now. Hope I will finish it some day... It should be easy to build a fast, basic version though. Or I can make a repository and upload mine, if it's useful for anybody... but some objects are a bit buggy.
2012/3/13 Pagano, Patrick pat@digitalworlds.ufl.edu
Hello
I am collaborating with a programmer who has developed a kinect streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear some ideas regarding what to do with the data
Cheers~
pp
Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Check out William Brent's dilib: http://williambrent.conflations.com/pages/research.html
.hc
On Mar 13, 2012, at 1:23 PM, Pagano, Patrick wrote:
Hello
I am collaborating with a programmer who has developed a kinect streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear some ideas regarding what to do with the data
Cheers~
pp
<OSCroute_kinect4.pd>_______________________________________________ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
The arc of history bends towards justice. - Dr. Martin Luther King, Jr.
Hans I think i looked at this before. Do you have DIlib? It seems like it's not available yet? I thought i grabbed this before but that was on linux
pp ________________________________ From: Hans-Christoph Steiner [hans@at.or.at] Sent: Saturday, March 17, 2012 10:12 PM To: Pagano, Patrick Cc: pd-list@iem.at Subject: Re: [PD] Kinect mappings
Check out William Brent's dilib: http://williambrent.conflations.com/pages/research.html
.hc
On Mar 13, 2012, at 1:23 PM, Pagano, Patrick wrote:
Hello
I am collaborating with a programmer who has developed a kinect streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear some ideas regarding what to do with the data
Cheers~
pp
<OSCroute_kinect4.pd>_______________________________________________ Pd-list@iem.atmailto:Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
The arc of history bends towards justice. - Dr. Martin Luther King, Jr.
Why not use pix_openni to do the skeleton-tracking needed? Then you can omit OSCeleton, which is quite limited anyway.
On Sun, Mar 18, 2012 at 3:52 AM, Pagano, Patrick pat@digitalworlds.ufl.eduwrote:
Hans I think i looked at this before. Do you have DIlib? It seems like it's not available yet? I thought i grabbed this before but that was on linux
pp
*From:* Hans-Christoph Steiner [hans@at.or.at] *Sent:* Saturday, March 17, 2012 10:12 PM *To:* Pagano, Patrick *Cc:* pd-list@iem.at *Subject:* Re: [PD] Kinect mappings
Check out William Brent's dilib: http://williambrent.conflations.com/pages/research.html
.hc
On Mar 13, 2012, at 1:23 PM, Pagano, Patrick wrote:
Hello
I am collaborating with a programmer who has developed a kinect streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear some ideas regarding what to do with the data
Cheers~
pp
<OSCroute_kinect4.pd>_______________________________________________ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
The arc of history bends towards justice. - Dr. Martin Luther King, Jr.
Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Yes
I use pix_openni, it's for me in fact, the better solution.
p
Le 18 mars 2012 à 07:02, dreamer a écrit :
Why not use pix_openni to do the skeleton-tracking needed? Then you can omit OSCeleton, which is quite limited anyway.
On Sun, Mar 18, 2012 at 3:52 AM, Pagano, Patrick pat@digitalworlds.ufl.edu wrote: Hans I think i looked at this before. Do you have DIlib? It seems like it's not available yet? I thought i grabbed this before but that was on linux
pp From: Hans-Christoph Steiner [hans@at.or.at] Sent: Saturday, March 17, 2012 10:12 PM To: Pagano, Patrick Cc: pd-list@iem.at Subject: Re: [PD] Kinect mappings
Check out William Brent's dilib: http://williambrent.conflations.com/pages/research.html
.hc
On Mar 13, 2012, at 1:23 PM, Pagano, Patrick wrote:
Hello
I am collaborating with a programmer who has developed a kinect streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear some ideas regarding what to do with the data
Cheers~
pp
<OSCroute_kinect4.pd>_______________________________________________ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
The arc of history bends towards justice. - Dr. Martin Luther King, Jr.
Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
I find that openni on the Mac takes to long to register the skeleton so we are using processing to track and osc the joints and relationships. I was originally just soliciting fun ideas for the huge data stream the kinect provides
Patrick Pagano B.S.,M.F.A Digital Media Engineer UF Digital Worlds Institute (352)294-2020
On Mar 18, 2012, at 5:49 AM, "philippe boisnard" <philemon1@mac.commailto:philemon1@mac.com> wrote:
Yes
I use pix_openni, it's for me in fact, the better solution.
p
Le 18 mars 2012 à 07:02, dreamer a écrit :
Why not use pix_openni to do the skeleton-tracking needed? Then you can omit OSCeleton, which is quite limited anyway.
On Sun, Mar 18, 2012 at 3:52 AM, Pagano, Patrick <pat@digitalworlds.ufl.edumailto:pat@digitalworlds.ufl.edu> wrote: Hans I think i looked at this before. Do you have DIlib? It seems like it's not available yet? I thought i grabbed this before but that was on linux
pp ________________________________ From: Hans-Christoph Steiner [hans@at.or.atmailto:hans@at.or.at] Sent: Saturday, March 17, 2012 10:12 PM To: Pagano, Patrick Cc: pd-list@iem.atmailto:pd-list@iem.at Subject: Re: [PD] Kinect mappings
Check out William Brent's dilib: http://williambrent.conflations.com/pages/research.html
.hc
On Mar 13, 2012, at 1:23 PM, Pagano, Patrick wrote:
Hello
I am collaborating with a programmer who has developed a kinect streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear some ideas regarding what to do with the data
Cheers~
pp
<OSCroute_kinect4.pd>_______________________________________________ Pd-list@iem.atmailto:Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
The arc of history bends towards justice. - Dr. Martin Luther King, Jr.
Pd-list@iem.atmailto:Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Pd-list@iem.atmailto:Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
hi!
if you have installed latest unstables of openni and nite it should
start tracking of a new user almost immediately without the need of a
calibration pose.
what takes long time (at least on my machine) is the initialization
process. (when you start gemwin)
for me pix_openni works much better and stable on linux.
if you have gem framerate at 30fps you get 15x30 joints with x,y,z
coordinates per second.
it's really not an easy task to extract useful information out of it.
i lately added the skeleton smoothing feature, that can be very
helpful to smoothen the output. (skeleton_smoothing 0.0-1.0)
what you need is a set of abstractions to make geometric calculations
from the datastream, the ability to monitor/draw graphs and the
"interpretation" of this data/gesture detection. iemmatrix can be
practical for the vector calculations and to make the patches more
readable.
i'm working in the moment on such abstractions but still a work in progress.
anyway i'm curious how the kinect for windows sdk is working.
with the built in speech recognition and source localization over the
microphone array it has some advantages over openni/nite.
but for me the platform dependency is a no-go. so i won't work on an
external with this framework in the future.
maybe someone else? :-)
matthias
Zitat von "Pagano, Patrick" pat@digitalworlds.ufl.edu:
I find that openni on the Mac takes to long to register the skeleton
so we are using processing to track and osc the joints and
relationships. I was originally just soliciting fun ideas for the
huge data stream the kinect providesPatrick Pagano B.S.,M.F.A Digital Media Engineer UF Digital Worlds Institute (352)294-2020
On Mar 18, 2012, at 5:49 AM, "philippe boisnard"
<philemon1@mac.commailto:philemon1@mac.com> wrote:Yes
I use pix_openni, it's for me in fact, the better solution.
p
Le 18 mars 2012 à 07:02, dreamer a écrit :
Why not use pix_openni to do the skeleton-tracking needed? Then you can omit OSCeleton, which is quite limited anyway.
On Sun, Mar 18, 2012 at 3:52 AM, Pagano, Patrick
<pat@digitalworlds.ufl.edumailto:pat@digitalworlds.ufl.edu> wrote: Hans I think i looked at this before. Do you have DIlib? It seems like
it's not available yet? I thought i grabbed this before but that was on linuxpp ________________________________ From: Hans-Christoph Steiner [hans@at.or.atmailto:hans@at.or.at] Sent: Saturday, March 17, 2012 10:12 PM To: Pagano, Patrick Cc: pd-list@iem.atmailto:pd-list@iem.at Subject: Re: [PD] Kinect mappings
Check out William Brent's dilib: http://williambrent.conflations.com/pages/research.html
.hc
On Mar 13, 2012, at 1:23 PM, Pagano, Patrick wrote:
Hello
I am collaborating with a programmer who has developed a kinect
streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear
some ideas regarding what to do with the dataCheers~
pp
<OSCroute_kinect4.pd>_______________________________________________ Pd-list@iem.atmailto:Pd-list@iem.at mailing list UNSUBSCRIBE and account-management ->
http://lists.puredata.info/listinfo/pd-list
The arc of history bends towards justice. - Dr. Martin Luther King, Jr.
Pd-list@iem.atmailto:Pd-list@iem.at mailing list UNSUBSCRIBE and account-management ->
http://lists.puredata.info/listinfo/pd-list
Pd-list@iem.atmailto:Pd-list@iem.at mailing list UNSUBSCRIBE and account-management ->
http://lists.puredata.info/listinfo/pd-list
Sorry about this, I'm working on some updates and additions (including working in pix_openni), so I've taken it down for the moment. Let me know off-list if you want it as is/in-progress. I'm planning on having it finished by early summer.
On Sat, Mar 17, 2012 at 10:52 PM, Pagano, Patrick pat@digitalworlds.ufl.edu wrote:
Hans I think i looked at this before. Do you have DIlib? It seems like it's not available yet? I thought i grabbed this before but that was on linux
pp ________________________________ From: Hans-Christoph Steiner [hans@at.or.at] Sent: Saturday, March 17, 2012 10:12 PM To: Pagano, Patrick Cc: pd-list@iem.at Subject: Re: [PD] Kinect mappings
Check out William Brent's dilib: http://williambrent.conflations.com/pages/research.html
.hc
On Mar 13, 2012, at 1:23 PM, Pagano, Patrick wrote:
Hello
I am collaborating with a programmer who has developed a kinect streamer with windows SDK that sends data over udp. I am soliciting some ideas on WHAT to do with the data stream. We are thinking movies/models and midi, but I would love to hear some ideas regarding what to do with the data
Cheers~
pp
<OSCroute_kinect4.pd>_______________________________________________ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
The arc of history bends towards justice. - Dr. Martin Luther King, Jr.
Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
-
dreamer -
Hans-Christoph Steiner -
Matthias Kronlachner -
Pagano, Patrick -
philippe boisnard -
Quim Llimona -
William Brent