DS-1841 adding example files for agent and domain-based spider filtering

borrowed from OSU Libraries, with much thanks