processinq (standalone): create components through factory
additional changes to make standalone processinq work with current scheduler and dispatcher
inferring standard client-ids. don't initialize wscl if absent. shutdown scheduler properly
flush workset if client is starved
merge processinq-sa changes made for wide7
hqconfig: return default value if type coersion failed
code cleanups around IncomingQueue in hq.py
add static file handler for make testing status.py easier
include 'buffered' in status of PriorityEnqueue
removed most of seendb dump functionality from seendump.py to lib/seen.py, added binary dump choice.
added new dispatcher with sort-merge based seen check
processinq-sa: -D option for selecting seen-check method (cherry-picking 038484b4c956d5ddd7860e17b7e2ffc8407c139f from wide7 patch branch)
fix bugs found in test run
fix bug found in test run (processinq-sa) manual cherry-pick adb8bf3fdff79f4b1bacc576acd33ca9ed95eea3
bug fix: td and ts are missing in processinq result. (cherry-pick 2dc0d5b098ef8a29aaab2ebc2ed77694f81b7bca from wide7 branch)
MergeDispatcher bug fix: fails to reject seen URLs if there are more than once instances of the URL in a cycle. also creates duplicated records in SEEN
utility for checking and repairing sort-merge seen file
mergedispatcher: re-processing INCOMING (cherry-pick 858eb5309f40d5754ad5ec48f8ff1fd6adae23f2 from wide7 branch)