Initial commit.
Server and spider are not connected.
Spider hangs on some sites.
No logging.
Made spider to use separate thread to parse content create new spider tasks.
Married spider and server.
Still no logging.
Added logging.