user: Why are over partitioned tables poor data layout strategy

assistant: Over-partitioning creates physical boundaries beyond which the file compaction and z-ordering aren’t effective and you’re still left with the small files problems. With Delta, a better strategy is to use combination of partitioning and z-ordering to allow for better file layouts. 

Would be helpful to understand the business requirements & design details behind these highly partitioned tables you have in parquet today

user: Classify each of the following as either a city or food: Edinburgh, Madrid, pasta, jam, Berlin, soup

assistant: Cities: Edinburgh, Madrid, Berlin Food: pasta, jam, soup

user: Name some of the superhero teams of Marvel Comics as per the passage.

assistant: Avengers, X-Men, Fantastic Four, and Guardians of the Galaxy.