Remove and ignore files that should not be tracked