Added patch to allow to clear out the DocIDServer in order to allow
recrawling of pages. Call frontier.clearDocIDs() to do this safely.