updates to pipeline structure

some LSF tuning and some bug fixes for edge cases