Setup config files and finalize dir structure