NGI_pipeline working version

It is still under testing but it should be pretty stable: @mario please review it carefully
@guillermo-carrasco I'm using shelve here because I needed something to play with, but I'm sure shelve won't stand up to any kind of Production use. Do you have any other recommendations? I was thinking to move to SQLite but maybe you have more experience with this kind of stuff than I do