Avoid underflow if asked to pad to smaller than current size