Wiring in shadow extraction

WIP: @markhibberd 



> Wrong types. HdfsRepository. Should minimise this code as much as possible

Hmm, I don't see how you would do that. `HdfsRepository` is not a type. But I might be missing something.