spotify/luigi — pull request #57 by rathboma (2013-05-06 19:31:13+00:00)
Title: Added a flag to HivePartitionTarget to prevent failure if a table doesn't exist

This enables the following dependency graph:

{Generate Data} -> {Generate Schema} -> {Create Table} -> {Add Partition}

The Add Partition task has an output type of HivePartitionTarget, however the DAG doesn't execute (errors) if the table isn't created before that target is evaluated.

My change allows you to override this behavior and return 'False' instead of raising an exception.