deny all robots
adde DB config
configuration overhaul