updated README, add humans and robots txt. Small configuration improvements