updated robots.txt file to exclude tech directory