Patent ID: 11907205
Assignee: INTUIT INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method of efficient data parity, comprising:
receiving, by a first data consuming component in a first data pipeline a plurality of database change records from a publication service, the plurality of database change records indicating changes to an underlying data source;
updating, by the first data consuming component, a secondary data store to include the plurality of database change records;
selecting a sample subset of the plurality of database change records based on one or more conditions; and
for each respective database change record in the sample subset that has already been consumed by a second data consuming component in a second data pipeline that received one or more database change records from the publication service and updated a primary data store based on the one or more database change records:
comparing the respective database change record to first data from the primary data store that corresponds to the respective database change record;
determining an inconsistency between the primary data store and a particular database change record based on the comparing;
responsive to determining the inconsistency, determining whether the second data consuming component has consumed a database change record with a higher offset value than the first data consuming component;
responsive to determining the second data consuming component has consumed a database change record with a higher offset value than the first data consuming component, delaying a parity determination for the particular database change record in the sample subset until the first data consuming component has consumed the database change record with the higher offset value; and
responsive to determining the second data consuming component has consumed no database change record with a higher offset value than the first data consuming component, determining a parity failure,
wherein a notification is generated based on determination of the parity failure.