Patent ID: 9692667
Date: 2017-06-27
CPC Classifications: G06F,H04L

Claim:
1. A stream processing method for a stream processing system, wherein the method comprises: receiving, by a stream processing apparatus, a first stream processing task, wherein the first stream processing task comprises one or more stream processing components, a data input and output relationship of the one or more stream processing components, and an identifier of a stream data source; calculating, by the stream processing apparatus, a computing resource required by each stream processing component of the one or more stream processing components comprised in the first stream processing task; wherein the one or more stream processing components of the first stream processing task comprises a first stream processing component, wherein the computing resource required by the first stream processing component does not meet a preset constraint condition; wherein the method further comprises: obtaining, by duplicating the first stream processing component, one or more second stream processing components, wherein each of the one or more second stream processing components has the same computing logic as the first stream processing component and the same data input and output relationship as the first stream processing component, and adding the one or more second stream processing components to the first stream processing task to obtain a second stream processing task; wherein the one or more stream processing components of the first stream processing task further comprises a third stream processing component configured for sending data to the first stream processing component, and wherein the third stream processing component sends, to the first stream processing component and the one or more second stream processing components, according to a first data allocation policy, the data to be sent by the third stream processing component to the first stream processing component; wherein the first stream processing task comprises the stream data source that corresponds to the identifier of the stream data source, the stream data source being configured for sending data to the first stream processing component, and wherein the stream data source sends, to the first stream processing component and the one or more second stream processing components, according to a second data allocation policy, the data to be sent by the stream data source to the first stream processing component; wherein the computing resource required by the first stream processing component in the first stream processing task is divided for the first stream processing component and the one or more second stream processing components according to a resource allocation policy; and wherein the method further comprises: allocating each stream processing component in the second stream processing task to a computing node that is in the stream processing system and that meets a computing resource required by the stream processing component.