Remove old file after rename.