Only resize if larger to begin with.