Command: curl -L 10.100.116.150/robots.txt
Output:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0100    89  100    89    0     0  31717      0 --:--:-- --:--:-- --:--:-- 44500
User-agent: *
Disallow: /protected/
Disallow: /api/v2/
Allow: /downloads/
Crawl-delay: 1
Exit code: 0