do not respider if collectiverespiderfreq
is <= 0.0. added a url filter for that.
added a couple url filters for retrying
errors (tcp timed out, etc)