Adding api to robots.txt