In an ideal world, SilverStripe would leave images that already match the target size untouched and only resize the ones that actually have to be resized.
This can be achieved by subclassing the Image class.