What is the best format for storing data in a lakehouse?
Different formats have their pros and cons in the context of storing data in a lakehouse. The three most popular formats are delta lake, iceberg and hudi. Among these three, delta lake is most widely used lakehouse storage format. Iceberg and hudi are also gaining acceptance as more and more companies are building their lakehouses. While delta lake covers most lakehouse features, if merge-on-read is an important feature for you then Hudi might be the way to go, and if partition evolution is an important feature for you then Iceberg might be the best option for you.