slight cleanup of int x-trans downsample

as with float version center sample area, fix upper bounds, and know
that RGB are in a 2:5:2 ratio