Refactor scaling so it only happens when doing COW