spotify/luigi — pull request #327 by a1k0n (2014-05-13 16:01:17+00:00)
Title: Check for missing files in distributed cache setup

Once in a while we get errors like this:
File "luigi/hadoop.py", line 717, in _setup_links
os.link(src, dst)
OSError: [Errno 2] No such file or directory

and it's impossible to tell what went wrong without guessing; this is an attempt to help debug that situation.