The closest equivalent to Shark is probably Intels vTune ($$$), but AMD makes a free profiler called Code Analyst which they offer for Windows and Linux. I use it on Windows and while it's not nearly as good as Shark, it does give you a better idea about what is going on. You don't need to do anything special to the profiled app.
http://developer.amd.com/calinux.aspx#a