Lambda architecture for data flow