Make sure that the conf directory stays around

Git doesn't normally preserve empty directories, which broke startup since the
server does a read on that directory. Add a README to make sure the directory
exists.