added some debug checking code to django templates and controller actions
added robots.txt