I should also point out that HSV/HLS/HSB/etc is not a useful color space to deal with. Excellent details as to why are provided by Charles Poynton:
http://www.poynton.com/notes/colour_and_gamma/ColorFAQ.html#RTFToC36
http://www.poynton.com/notes/colour_and_gamma/GammaFAQ.html#HSI
If you need brightness or saturation then use YUV which properly accounts for non-linear aspects of color. The 'hue' part of HSV is worthless.