Fix #9234: Create dirs when they don't exist

There is no real reason why we should fail when the config dir (or
similar directories) that the user specifies don't exist.