Don't pad small integers with zero bytes