mpegvideoenc: check color_range

Rework the comparison into something simpler to understand.
fate: add on2avc audio test