conf improved, robots.txt added