Hi Etienne,
I am not sure if I understood well your problem, but I have a strange behaving in Gem too with VLC plugin. I have 2 identical IP cams on a local network, and while the first cam streams video smoothly or almost smoothly, the other cam shows a one second stream max or less, than stops at the last frame and never goes on.
Already tried many computers with ubuntu 14.04.2 and looks the same. While in a browser or VLC i can see the stream, in Gem with videovlc plugin it stops.
Here are some error reports from the terminal, maybe it is interesting for you:
MultiFramedRTPSource::doGetNextFrame1(): The
total received frame size exceeds the client's buffer size (100000).
80761 bytes of trailing data will be dropped!
../../../include/vlc_xlib.h:46:vlc_xlib_init: Xlib not initialized for threads.
This process is probably using LibVLC incorrectly.
Pass "--no-xlib" to libvlc_new() to fix this.
[b0e398c8] vdpau_avcodec generic error: Xlib not initialized for threads
[b0e398c8] vdpau_avcodec generic error: Xlib is required for VDPAU
[b0e643c0] core vout display error: Failed to change zoom
[b0e643c0] core vout display error: Failed to set on top
[b0e643c0] core vout display error: Failed to change source AR
[h264 @ 0xb0e329c0] Invalid level prefix
[h264 @ 0xb0e329c0] error while decoding MB 88 40
[b0e643c0] core vout display error: Failed to change zoom
[b0e643c0] core vout display error: Failed to change source AR