The ASIO is working now not before I submitted a bug though. I added pd/lib and pd/bin to the path and loadlib and Gem to the libraries loaded as mentioned above.
At one point I wasn't getting this message about could not find MSVCRT71.dll. I am getting the message still and gem is not loading.
I am able to play with latency set to 12ms on Windows VISTA I didn't try lower yet. Everything is so smooth.