updates to processing pipeline