Redis Queue + web crawling project
new classes: stats, storage, travel
blerp
stats "done"
succesfully crawling unique sites
did some stuff-good stuff, of course
stats need serious debugging but are workable for now
got bogged down in stats - keep moving
simplified ratings and stats for now
added rough lead rating code to Travel package
iteration 1... COMPLETE!!ONE11!
code clean up and reporting script
changed execution permissions for startup
minor changes
minor changes
Roughly version 1.0.  Have a control loop creating workers and
queues, starting and managing workers, and iterating on a work
process.  Incremental revisions will polish crawling strategies,
store results intelligently, and generify architecture over time.
middling point
polishing startup/shutdown, scaling, and reporting
deleted Queuer <- replaced by Startup.py
added ignition file for graceful if slow shutdown