[Finder] Fix broken windows install

| Q             | A
| ------------- | ---
| Bug fix?      | yes
| New feature?  | no
| BC breaks?    | no
| Deprecations? | no
| Tests pass?   | yes
| Fixed tickets | #11984
| License       | MIT
| Doc PR        | -

The commit b63926b24666798e8e20030b7c4f9b29ae7b7f09 from PR #11970
introduces a directory containing invalid chars for directory
names under windows.