When playing movies with Gem on Mac OS X, I've noticed that the sound
is automatically played. But on Windows this is not the case. Is
there a way to play the sound from the movie using Gem on Windows?
.hc
As we enjoy great advantages from inventions of others, we should be
glad of an opportunity to serve others by any invention of ours; and
this we should do freely and generously. - Benjamin Franklin
On 11/15/06, Hans-Christoph Steiner hans@eds.org wrote:
When playing movies with Gem on Mac OS X, I've noticed that the sound is automatically played. But on Windows this is not the case. Is there a way to play the sound from the movie using Gem on Windows?
Sound on OSX is an unintended byproduct, and probably default to off from now on. I don't have any plans to make sound work on Windows.
On Nov 15, 2006, at 9:49 PM, chris clepper wrote:
On 11/15/06, Hans-Christoph Steiner hans@eds.org wrote:
When playing movies with Gem on Mac OS X, I've noticed that the sound is automatically played. But on Windows this is not the case. Is there a way to play the sound from the movie using Gem on Windows?
Sound on OSX is an unintended byproduct, and probably default to
off from now on. I don't have any plans to make sound work on
Windows.
Is there then another way to play the audio track of a video file?
Having the audio and video in one file is handy because it allows the
video author to handle the sync when Pd is just doing the playback.
I am working with a student, Ardis Kadiu, on a 9-screen, 9-computer
system and we need to be able to play the author's movies with sound
and all in sync.
.hc
If you are not part of the solution, you are part of the problem.
On 11/15/06, Hans-Christoph Steiner hans@eds.org wrote:
Is there then another way to play the audio track of a video file? Having the audio and video in one file is handy because it allows the video author to handle the sync when Pd is just doing the playback. I am working with a student, Ardis Kadiu, on a 9-screen, 9-computer system and we need to be able to play the author's movies with sound and all in sync.
For basic sync playback with no further processing Quicktime does pretty well. It is important to note that the audio played by Quicktime does not run through the PD audio chain at all. That becomes a sticky point when adding this feature.
If its any consolation, it also sucks in Jitter. spigot~ got
seriously broken with QT 7, and whatnot. Their solution is to
automatically extract an AIFF, make an XML file, and load it into a
buffer~ which can then be sent to MSP tilde land.
Ive not played with it, but it isnt elegant, ill tell you that.
Anyway, theres lots of room for improvement.
v a d e //
www.vade.info abstrakt.vade.info
On Thu, 16 Nov 2006, vade wrote:
If its any consolation, it also sucks in Jitter. spigot~ got seriously broken with QT 7, and whatnot. Their solution is to automatically extract an AIFF, make an XML file, and load it into a buffer~ which can then be sent to MSP tilde land. Ive not played with it, but it isnt elegant, ill tell you that. Anyway, theres lots of room for improvement.
Well, the weirdest part is "make an XML file", as if this had anything to do with solving the problem at hand. It's sort of like "wave a dead chicken".
_ _ __ ___ _____ ________ _____________ _____________________ ... | Mathieu Bouchard - tél:+1.514.383.3801 - http://artengine.ca/matju | Freelance Digital Arts Engineer, Montréal QC Canada
Hahaha, I was wondering about that too!
~Kyle
On 11/16/06, Mathieu Bouchard matju@artengine.ca wrote:
On Thu, 16 Nov 2006, vade wrote:
If its any consolation, it also sucks in Jitter. spigot~ got seriously broken with QT 7, and whatnot. Their solution is to automatically extract an AIFF, make an XML file, and load it into a buffer~ which can then be sent to MSP tilde land. Ive not played with it, but it isnt elegant, ill tell you that. Anyway, theres lots of room for improvement.
Well, the weirdest part is "make an XML file", as if this had anything to do with solving the problem at hand. It's sort of like "wave a dead chicken".
_ _ __ ___ _____ ________ _____________ _____________________ ... | Mathieu Bouchard - tél:+1.514.383.3801 - http://artengine.ca/matju | Freelance Digital Arts Engineer, Montréal QC Canada
PD-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Quicktime is a little tricky, as you have to sync different timebases
(QTUnits) of playback for different tracks. The XML format ensures
sample accurate playback for the frame number of the movie you are on
(it lists the QT rate of each track). Otherwise the two will be out
of sync. Dead chicken or not, something like that is needed.
<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<spigot-data lastaccess="-1048437663"> <sourcemovie path="tokyo:/Documents/Final Cut Pro Documents/Capture Scratch/Montreal Footage/Bridge and Lights" movieduration="1694494" audioduration="1694478" moddate="-1064404625" /> <audiofile path="tokyo:/Users/vade/Library/Application Support/ Cycling '74/spigot-cache/Bridge and Lights.aif" moddate="-1048437663" /> </spigot-data>
v a d e //
www.vade.info abstrakt.vade.info
I LIVE! I LIVE! I LIVE! I LIVE! I LIVE! I LIVE! I LIVE! I LIVE! I
LIVE! I LIVE! I LIVE! I LIVE!
You will not be saved by the Holy Ghost. You will not be saved by the
God Plutonium.
In fact, YOU WILL NOT BE SAVED!
On Nov 16, 2006, at 2:36 AM, Mathieu Bouchard wrote:
On Thu, 16 Nov 2006, vade wrote:
If its any consolation, it also sucks in Jitter. spigot~ got
seriously broken with QT 7, and whatnot. Their solution is to
automatically extract an AIFF, make an XML file, and load it into
a buffer~ which can then be sent to MSP tilde land. Ive not played
with it, but it isnt elegant, ill tell you that. Anyway, theres
lots of room for improvement.Well, the weirdest part is "make an XML file", as if this had
anything to do with solving the problem at hand. It's sort of like
"wave a dead chicken"._ _ __ ___ _____ ________ _____________ _____________________ ... | Mathieu Bouchard - tél:+1.514.383.3801 - http://artengine.ca/matju | Freelance Digital Arts Engineer, Montréal QC
Canada_______________________________________________ PD-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/ listinfo/pd-list
On Nov 16, 2006, at 12:10 AM, chris clepper wrote:
On 11/15/06, Hans-Christoph Steiner hans@eds.org wrote:
Is there then another way to play the audio track of a video file?
Having the audio and video in one file is handy because it allows
the video author to handle the sync when Pd is just doing the
playback. I am working with a student, Ardis Kadiu, on a 9-screen,
9-computer system and we need to be able to play the author's
movies with sound and all in sync.For basic sync playback with no further processing Quicktime does
pretty well. It is important to note that the audio played by
Quicktime does not run through the PD audio chain at all. That
becomes a sticky point when adding this feature.
Yeah, QuickTime on Mac OSX is working well, but our problem is that
we are running on Windows machine (soon to be converted to Debian).
Is this QuickTime playback possible on Windows or Debian?
.hc
Access to computers should be unlimited and total. - the hacker ethic
On 11/16/06, Hans-Christoph Steiner hans@eds.org wrote:
Yeah, QuickTime on Mac OSX is working well, but our problem is that we are running on Windows machine (soon to be converted to Debian). Is this QuickTime playback possible on Windows or Debian?
The way Quicktime plays back using 'auto' is different on Windows. I had to do a lot of screwing around with QT code on OSX to get decent playback, but Windows doesn't need that amount of monkeying (mainly because Windows Quicktime is horribly crippled by design). I would be a big change on the Windows side to add sound.
I think there is a pdp object that plays sound from movie files?
On Nov 16, 2006, at 10:14 AM, Hans-Christoph Steiner wrote:
Yeah, QuickTime on Mac OSX is working well, but our problem is that
we are running on Windows machine (soon to be converted to
Debian). Is this QuickTime playback possible on Windows or Debian?
...on Debian you could use pdp_qt~ (from pdp) or pdp_yqt (from pidip)?
jamie
i've tried a lot of things to play audio and video in sync. there's one technique that's really reliable and that works on all platforms with gem and/or pdp. i've posted it here a while back - here is it again:
you'll have to split the audio and the video into individual files and play them separately. the best way to make sure that a/v stays perfectly in sync would be to play the audio with [vline~] + [tabread4~] and [snapshot~] the ouput of [vline~] every [gemhead] to determine the frame of the video to be displayed.
the technique above (replace [vline~] with whatever you're controlling your audio playback with) also works for timestretching, reverse playback and scratching. and beside the video and the audio file also a dead_chicken.txt is needed because the framerate of the video needs to be known to pd somehow.
sven.
A very practical and useful solution. I especially love the 'dead chicken' xml joke!
~Kyle
On 11/16/06, sven ml.sven@subscience.de wrote:
i've tried a lot of things to play audio and video in sync. there's one technique that's really reliable and that works on all platforms with gem and/or pdp. i've posted it here a while back - here is it again:
you'll have to split the audio and the video into individual files and
play
them separately. the best way to make sure that a/v stays perfectly in sync would be to
play the audio
with [vline~] + [tabread4~] and [snapshot~] the ouput of [vline~] every
[gemhead]
to determine the frame of the video to be displayed.
the technique above (replace [vline~] with whatever you're controlling your audio playback with) also works for timestretching, reverse playback and scratching. and beside the video and the audio file also a dead_chicken.txt is needed because the framerate of the video needs to be known to pd somehow.
sven.
PD-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Am 16.11.2006 um 21:46 schrieb sven:
you'll have to split the audio and the video into individual files
and play them separately. the best way to make sure that a/v stays perfectly in sync would
be to play the audio with [vline~] + [tabread4~] and [snapshot~] the ouput of [vline~]
every [gemhead] to determine the frame of the video to be displayed.the technique above (replace [vline~] with whatever you're
controlling your audio playback with) also works for timestretching, reverse playback and scratching. and beside the video and the audio file also a dead_chicken.txt is
needed because the framerate of the video needs to be known to pd somehow.
sven,
why do you need to know the framerate? i think actually just the kHz
rate of the sample needs to be known. then if sample and video have
the same length and you have the total number of frames... just
devide them with the total of samples and you will know which frame
goes with which sample, or not?
no dead_chicken.txt in the end?
max
sven, why do you need to know the framerate? i think actually just the kHz
rate of the sample needs to be known. then if sample and video have
the same length and you have the total number of frames... just
devide them with the total of samples and you will know which frame
goes with which sample, or not? no dead_chicken.txt in the end?
i've tested that with gem already a while ago and sometimes i got the wrong number of frames. never really investigated why gem would report wrong number of frames. and how to get the samplerate info of an audio file? i'm sure there could be a way that doesn't need the extra info but i prefer flexibility / reliability and besides audio / videoinfos the extra file can also be used to store a lot more meta information that can be useful sooner or later. this of course depends on what you want to do. anyway the method above always works / worked for me so i didn't really bother to invest more time to eliminate the need for the chicken.
sven.
On Tue, 28 Nov 2006, Max Neupert wrote:
Am 16.11.2006 um 21:46 schrieb sven:
and beside the video and the audio file also a dead_chicken.txt is needed because the framerate of the video needs to be known to pd somehow.
just devide them with the total of samples and you will know which frame goes with which sample, or not? no dead_chicken.txt in the end?
Just to clarify what i meant by waving a dead chicken: I was poking fun at XML in particular, because it's often used in context where it's completely overkill or even unfit, just because of superstition - usually that superstition coming from superiors not fit for making that kind of decision; or else the need to comply with customers' superstitions.
OTOH, I agree, that if the audio and video files start at the same point in time, and they're not missing frames of any kind, and they have only one framerate each (e.g. all 48000 Hz audio and all 25 Hz video), and know which two files go together (same folder and same name except suffix), then there's no use for a syncfile.
_ _ __ ___ _____ ________ _____________ _____________________ ... | Mathieu Bouchard - tél:+1.514.383.3801 - http://artengine.ca/matju | Freelance Digital Arts Engineer, Montréal QC Canada
-
chris clepper -
Hans-Christoph Steiner -
james tittle -
Kyle Klipowicz -
Mathieu Bouchard -
Max Neupert -
sven -
vade