pipeline correctly processes all items on spider exit