Get everything into the correct config dir