Remove file that does not need to be bumped from the config