Ensure config dir exists, applying more chown hackery