added robots.txt to prevent search engine indexing on admin and api routes