Streaming cross-cat inference engine