major revision. pipelines greatly improved and paralelized