Don't create avalon.conf until there's a passenger.conf