Adding a Disallow field to the robots.txt to not allow my website to be crawled on job portals.