Remove settings from tracked files