just a quick update:
pd runs definitely smoother on the udoo with the debian hard float image. i am now down to 10ms with no problems (and a very cheap usb-soundcard dongle)
8ms gives some crackles but still works…
this is with the usual rtprio and memlock stuff and -rt and for now with a gui.