Removing configuration file and adding it to the ignore list