It’s a good idea. If you did this you’d want to use the V part of HSV and not the H (hue). And ideally you’d want to average over a window of pixels because while hue angle tends to be similar over nearby pixel, the intensities (values) can vary a lot from pixel to pixel.
Would be good to find...