transfer filtering and downloading logic to spider