improvements to pipeline, added sqlite import