Personally, I've gotten better performance with Satellite CCRMA (lower latency, fewer dropouts and crashes), but if you are already up and running with Raspbian, there's no harm in trying that out first!
If you are using pd, you probably need to start dsp manually within the patch after a short delay. [loadbang] -> [del 100] -> [;pd dsp 1(
I'm not sure why, but it seems like you need to do that to get audio to start without the GUI.