PixelShaderGen: Color combiner compare mode fix and simplification

Changed `int3(255,255,255)` to `int3(1,1,1)` and removed the redundant `max()`.

Fixes issue 7178.