Project: springxd
Issue XD-3119: The performance of the pipe [in singlenode]
Do as a developer, in the case of large data from the source to the sink will after multiple processors, I found that even if the processor does not do anything, message from the source to the sink of performance, with the number of processors, the message forwarding performance will decrease very much. For example: spring xd run in singlenode After the tcp-client connects the socket service, receive very many text (a line of text messages) stream definition: tcp-client |t1:transform |t2:transform |t3:transform |t4:transform |null Message passing rate: 20000 per second Transform didn't do anything. stream definition: tcp-client|null Message passing rate: 170000 per second Message is a line of text, my business requires me to a second processing 300000 pieces of data.(About 100 MB/s in a machine ) Tell me how to solve the performance bottleneck. Can stream only have source and sink to get high performance?
Story points: 1