Add a tmp directory for passenger (and maybe other stuff)
Deep-merge loaded config files