Major refactoring to better separate job processing logic from provider-specific data stream processing logic.