Add ability to read from s3.
Add iteration of s3 files
- fix all cases of    logging.foo(format_string % args)
- fix logging calls from logger.foo(format_string % args) into
  logger.foo(format_string, *args)
- and make a small optimization to error line accrual in
  run_and_track_hadoop_job.py
enable support for boto config in S3Client
Merge pull request #205 from JonNelson/logging

Don't use string interpolating when logging, let the logging framework do that.
An inheritance decorator

Method and practice for instantiating classes that are inherited from

More tests, and ability to nullify parameters

Added better naming to common_params, and an assertion and test to boot

Python 2.6 compatible unit tests
Merge pull request #207 from dattalab/inherit_decorator

WIP: An inheritance decorator
Merge pull request #209 from jimjh/allow-boto-config

Enable support for boto config in S3Client
Issue #137: Adding command line parameters to global config so that logging is configurable
Merge pull request #187 from mortardata/cmiller_s3_open_r

Updated S3Target to allow open('r') for an S3 path.
Merge pull request #157 from gf-atebbe/logging

Issue #137
Disabling gzip compressions since it breaks the browser

Change-Id: Ia2c1a7964ab6df674ece5a67994c79508aa396b4
Reviewed-on: https://gerrit.spotify.net/gerrit/87762
TC-Compile-And-Test: Team City <teamcity@spotify.com>
Reviewed-by: Lars Albertsson <lalle@spotify.com>
Merge pull request #219 from jakobalander/master

Disabling gzip compressions since it breaks the browser
Add snakebite support to improve HDFS operation performance
Replacing inheritance with decorators
Replacing inheritance with decorators in luigi.util

- Added docstring to @inherits (thanks, alexbw) and deprecated the Derived class
- Added a @requires decorator
- Added some helper method for tasks using @inherits
- Added a @copies decorator and deprecated the Copy class
- Added a @delegates decorator and deprecated the CompositionTask class
Merge pull request #218 from erikbern/decorator-fixup

Refactored luigi.util and deprecated Copy, Derived etc
Add a command line argument to pass in the logging configuration file
Merge pull request #220 from alanbbr/master

Add snakebite support to improve HDFS operation performance
Refactor worker#run to prepare fix for #222

Break up worker#run into smaller methods and give each a meaningful
name so it's easier to figure out what it's doing and allow code reuse.

Collapse duplicate if constructs.
luigi-history configuration option for writing stuff to Hadoop job output directory

Specifically for tracking the job ID in a configuration where no history is stored in the output directory by Hadoop.