More sensible check for downsampling by integer amounts