Patent ID: 11928125
Assignee: CAPITAL ONE SERVICES, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. A method for cleaning and organizing event data for extract, transform, load (ETL) processing, comprising:
obtaining, by an event log management system, a first dataset from a first data repository,
wherein the first dataset includes event data associated with a generic schema, the event data including a plurality of events that include actions or occurrences in a data ecosystem, and
wherein the generic schema is associated with a data format that supports schema variability among a plurality of applications that generated the event data;

inferring, by the event log management system, an event-specific schema for the plurality of events that defines an organizational structure for the event data based on common attributes that are identified among the plurality of events using one or more data analytics functions;
storing, by the event log management system, a second dataset in a second data repository,
wherein the second dataset partitions the event data using the organizational structure defined by the event-specific schema;

generating, by the event log management system, a third dataset to be ingested into an ETL pipeline, the third dataset including a subset of the event data included in the second dataset that satisfies one or more registration parameters related to an ETL use case; and
providing, by the event log management system, the third dataset to an ETL system configured to ingest the third dataset into the ETL pipeline and process the third dataset based on the ETL use case.