A web crawler, stop-word shingler and comparator agent for use in a distributed grid environment