Remove old files from rebase