Patent ID: 10909122

Abstract:
Method, system, and computer program product are provided to guarantee no tuple loss and/or corruption in a real-time data streaming environment. In some embodiments, a stream of tuples is sent from an entry operator to downstream operator(s), and, at the entry operator, a mark is placed on each tuple in the stream of tuples. In an embodiment where the stream of tuples includes first, second, and subsequent tuple(s), for example, the mark may comprise a tuple-unique number and a tuple-data hash of data contained in the tuple, and the mark on the second and each subsequent tuple may further comprise a link-back hash associated with the immediately preceding tuple in the stream of tuples. In some embodiments, the link-back hash is used to check whether a tuple is lost or received out of order, and the tuple-data hash is used to check whether a received tuple is corrupt.