DS-1841: adding example files for agent and domain-based spider filtering, borrowed from OSU Libraries, with much thanks
Merge pull request #431 from hardyoyo/DS-1841-add-examples-for-spider-filtering-by-domain-and-agent

DS-1841 adding example files for agent and domain-based spider filtering