fix bug in JM crawler, make sure one item only crawled once
bug fix in pipeline