[FCS-30] Two policies for handling crawling depth.
[FCS-30] Crawler CLOSING state.
Merge branch 'FCS-30'

Conflicts:
	server/task_server.py
	server/url_processor.py
[NT] [Merge] Depth policy.