Hallo!
I just have come over the vamp plugins (http://www.vamp-plugins.org) again. It is a plugin system for feature extraction, audio analysis and is used by the Sonic Visualizer, Ardour, Audacity and others ... There already exist many plugins (see http://www.vamp-plugins.org/download.html and the features listed there) and it would be definitely nice to have them in pd.
However, it's also not so straight forward to implement a host, because some plugins need data in frequency domain or in a specific blocksize ...
I made a GSoC page where I described it in more details (http://puredata.info/dev/summer-of-code/VampPlugins) and would be definitely interested in implementing this for GSoC. Anyhow, I don't know if this project might be too small ... maybe it can be also combined with something else ?
LG Georg
Hi!
On Sun, 2008-03-16 at 13:29 +0100, Georg Holzmann wrote:
Hallo!
I just have come over the vamp plugins (http://www.vamp-plugins.org) again. It is a plugin system for feature extraction, audio analysis and is used by the Sonic Visualizer, Ardour, Audacity and others ... There already exist many plugins (see http://www.vamp-plugins.org/download.html and the features listed there) and it would be definitely nice to have them in pd.
Certainly the aubio functionality and the libxtract functionality (which gives some 50 features), are already available to Pd as an external (no need for a plugin host).
http://libxtract.sourceforge.net/
Although, from your list, it looks like you are mainly interested in the 'higher level' features?
The vamp-libxtract-plugin wraps some of the libxtract functionality, but is not as flexible (or efficient) as the Pd version. If you have any comments or suggestions, or features you would like to see implemented, I would be happy to hear it!
I made a GSoC page where I described it in more details (http://puredata.info/dev/summer-of-code/VampPlugins) and would be definitely interested in implementing this for GSoC. Anyhow, I don't know if this project might be too small ... maybe it can be also combined with something else ?
I think it would combine very nicely into the PluginHost suggestion I added last week!
best,
Jamie
Hallo!
Certainly the aubio functionality and the libxtract functionality (which gives some 50 features), are already available to Pd as an external (no need for a plugin host).
Yes, I have seen that. For these two libraries it's of course better to use the direct bindings ....
Although, from your list, it looks like you are mainly interested in the 'higher level' features?
At the moment I don't think about a particular feature. I am in general interested in music information retrieval and thought these plugins would be nice to have in Pd ...
I think it would combine very nicely into the PluginHost suggestion I added last week!
Yes this would be an option ...
For me, as I am interested in DSP and similar things, it would be also nice to additionally add new or other MIR/feature extraction algorithms. However, I think that it would be better to add such algorithms to libxtract or any other vamp plugin collection, then also other projects would benefit from it. But on the other hand this wouldn't be a pd-only project, so I don't know if it is suited for the GSoC program ... but in the end they would be also available in pd - through the VAMP plugin host external ;)
LG Georg
Hi,
On Sun, 2008-03-16 at 19:26 +0100, Georg Holzmann wrote:
For me, as I am interested in DSP and similar things, it would be also nice to additionally add new or other MIR/feature extraction algorithms. However, I think that it would be better to add such algorithms to libxtract or any other vamp plugin collection, then also other projects would benefit from it.
I completely agree with that. This was my original motivation for writing libxtract as a C library rather than a set of Pd objects.
But on the other hand this wouldn't be a pd-only project, so I don't know if it is suited for the GSoC program ... but in the end they would be also available in pd - through the VAMP plugin host external ;)
Yes, it would be great if some improvements got made to libxtract as a 'side effect' of the Pd GSoC! Something that might be interesting would be a set of MIR-inspired abstractions that use the libxtract/aubio bindings + the Pd machine learning objects ([knn], [ann_mlp], [ann_som]) to do common tasks - e.g. speech recognition, audio segmentation with labelling etc. A kind of Pd MIR toolkit.
Jamie
Hallo!
Yes, it would be great if some improvements got made to libxtract as a 'side effect' of the Pd GSoC! Something that might be interesting would be a set of MIR-inspired abstractions that use the libxtract/aubio bindings + the Pd machine learning objects ([knn], [ann_mlp], [ann_som]) to do common tasks - e.g. speech recognition, audio segmentation with labelling etc. A kind of Pd MIR toolkit.
Yes that would be a nice project: first coding the vamp plugin and afterwards a set of abstraction (MIR toolkit) with some common tasks. Then these abstractions would also act as documentation so that pd-people can reproduce the way they work. And if some lower-level features are missing they could be added to libxtract or other VAMP plugins.
Thinking about it, it probably would be a good idea if the vamp host was developed separately from the PluginHost. Particularly for the purposes of GSoC, I think projects should stay a manageable size. The important thing is that the two project teams (VampPlugins, PluginHost) communicate with each other so that we retain the possibility to merge the vamp host code into the generalised plugin host at some later stage if it seems appropriate.
Hm ... I am not sure if this is such a good idea. I guess that LADSPA/VST/... plugins are quite different to VAMP plugins, which output control data. Therefore I am not sure if it actually makes sense to combine those plugin hosts ... (of course they could have a similar syntax/interface, so that it's easy to use for users)
LG Georg
It sounds like a very worthwhile project. It doesn't sound too small to me. If you really are able to get everything working that quickly, then you could spend the extra time polishing everything so that it works really easily, then also making sure that there are docs for it.
.hc
On Mar 16, 2008, at 8:29 AM, Georg Holzmann wrote:
Hallo!
I just have come over the vamp plugins (http://www.vamp- plugins.org) again. It is a plugin system for feature extraction, audio analysis and is used by the Sonic Visualizer, Ardour, Audacity and others ... There already exist many plugins (see http://www.vamp-plugins.org/download.html and the features listed there) and it would be definitely nice to have them in pd.
However, it's also not so straight forward to implement a host, because some plugins need data in frequency domain or in a specific blocksize ...
I made a GSoC page where I described it in more details (http://puredata.info/dev/summer-of-code/VampPlugins) and would be definitely interested in implementing this for GSoC. Anyhow, I don't know if this project might be too small ... maybe it can be also combined with something else ?
LG Georg
PD-dev mailing list PD-dev@iem.at http://lists.puredata.info/listinfo/pd-dev
------------------------------------------------------------------------ ----
Access to computers should be unlimited and total. - the hacker ethic
Thinking about it, it probably would be a good idea if the vamp host was developed separately from the PluginHost. Particularly for the purposes of GSoC, I think projects should stay a manageable size.
The important thing is that the two project teams (VampPlugins, PluginHost) communicate with each other so that we retain the possibility to merge the vamp host code into the generalised plugin host at some later stage if it seems appropriate.
Jamie
On Sun, 2008-03-16 at 12:59 -0400, Hans-Christoph Steiner wrote:
It sounds like a very worthwhile project. It doesn't sound too small to me. If you really are able to get everything working that quickly, then you could spend the extra time polishing everything so that it works really easily, then also making sure that there are docs for it.
.hc
On Mar 16, 2008, at 8:29 AM, Georg Holzmann wrote:
Hallo!
I just have come over the vamp plugins (http://www.vamp- plugins.org) again. It is a plugin system for feature extraction, audio analysis and is used by the Sonic Visualizer, Ardour, Audacity and others ... There already exist many plugins (see http://www.vamp-plugins.org/download.html and the features listed there) and it would be definitely nice to have them in pd.
However, it's also not so straight forward to implement a host, because some plugins need data in frequency domain or in a specific blocksize ...
I made a GSoC page where I described it in more details (http://puredata.info/dev/summer-of-code/VampPlugins) and would be definitely interested in implementing this for GSoC. Anyhow, I don't know if this project might be too small ... maybe it can be also combined with something else ?
LG Georg
PD-dev mailing list PD-dev@iem.at http://lists.puredata.info/listinfo/pd-dev
Access to computers should be unlimited and total. - the hacker ethic
PD-dev mailing list PD-dev@iem.at http://lists.puredata.info/listinfo/pd-dev
-
Georg Holzmann -
Hans-Christoph Steiner -
Jamie Bullock