Remove files that weren't supposed to exist anyway.