Revert "More securely get hue and saturation from monochrome color spaces."

This reverts commit 028c71cbfe49f2a37a7efb7788404496576f90da.
Fix a lot of edge cases for monochrome color spaces.