Fix Windows path bugs, run all config tests against Windows

Adding a note for myself: I've moved all this stuff there :)