ekalinin/robots.js — pull request #14 by richorama (2014-02-13 13:06:41+00:00)
Title: Allow custom HTTP options

... to enable basic auth, or other custom headers on the HTTP request.