I'm also having real good experience with Ubuntu 10.4 (slightly customized with the UStudio packages). I agree that only Firewire devices performance seems to really improve with a RT kernel.
In RT with a Ricoh chip and FFADO from svn I can have 8ms latency (I only tried using 6 channels and 8 i/o open), although I have to note that a few times with heavy load of audio streaming amongst different applications jack dies and needs to be restarted. I didn't need to set IRQ so far. In non-RT I use a edirol ua-25 which works pretty good with low latency too (but not as good as firewire rt).
M