Be more strict with default ignored directories

- Closes #144