Gracefully close worker on term.

This change (attempts to) add a signal handler to the worker allowing it
to gracefully shutdown on a TERM signal. This means that it will finish
the tasks that it has accepted but not request any more work.
Make S3Target respect format
Allows specification of priority for hadoop jobs
Fixes a bug in graph creation for unknown dependencies
Fallback since older versions of Tornado can't handle max_hader_size
Merge pull request #399 from danielhfrank/graceful-shutdown

Gracefully close worker on term.
Merge pull request #401 from tommyengstrom/S3Target-format-fix

Make S3Target respect format
Merge pull request #406 from Houzz/mr_priority

Allows specification of priority for hadoop jobs
Merge pull request #408 from Houzz/fix_unknown_task_bug

Fixes a bug in graph creation for unknown dependencies
Revert "Gracefully close worker on term."
Merge pull request #414 from spotify/revert-399-graceful-shutdown

Revert "Gracefully close worker on term."
Adding ordereddict dependency to debian/control
Merge pull request #417 from freider/ordereddict

Adding ordereddict dependency to debian/control
Merge pull request #413 from spotify/erikbern/max-header-size-fallback

Fallback since older versions of Tornado can't handle max_hader_size
Switch to using POST for RPC requests.
Fallback to GET if scheduler doesn't support POST.
Remove GET request size workaround.
set permissions of pidfiles to 777

This commit also features some super minor refactoring of luigi.lock
Merge pull request #411 from campanja/http-post-in-rpc

Switch to using POST for RPC requests.
Remove deprecated code from hive.py