Patent ID: 11971878
Assignee: COINBASE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system for supporting both batch processing and streaming data applications, the system comprising:
a multi-layer data platform for indexing on-chain data, wherein the multi-layer data platform comprises one or more processors and non-transitory computer-readable media storing instructions that, when executed by the one or more processors, cause operations comprising:
populating a first dataset, wherein the first dataset is populated based on:
receiving first on-chain data from a blockchain node of a blockchain network, wherein the first on-chain data comprises hexadecimal encoded data from a first block of the blockchain network;
storing the first on-chain data, in the first dataset at a blockchain-interface layer, wherein the first dataset comprises the hexadecimal encoded data, and wherein the first dataset uses a first format;

populating a second dataset, wherein the second dataset is populated based on:
transforming the first on-chain data in the first format to a second format, wherein the second format comprises a columnar oriented format; and
storing the first on-chain data, in the second dataset at a data lakehouse layer, wherein the second dataset comprises the first on-chain data and second on-chain data in the second format, wherein the second on-chain data is from a second block on the blockchain network, and wherein transforming and storing the first on-chain data to and in the second format comprises:
detecting new on-chain data in the first on-chain data;
appending the new on-chain data to an unbounded table as a micro batch; and
storing the new on-chain data in the second dataset.