It should be possible to interface Blender with pd, there are some people doing this but I don't know exactly how. Blender runs on several platforms inclusive your beloved and behated ones, is free oss and has a builtin 3D engine + uses Python as scripting language. Maybe over OSC.
Cheers,
Malte Steiner media art + development -www.block4.com-