DOI: 10.5281/zenodo.8098908
title: Annotated Benchmark of Real-World Data for Approximate Functional Dependency Discovery

description: <strong>Annotated Benchmark of Real-World Data for Approximate Functional Dependency Discovery</strong> This collection consists of ten open access relations commonly used by the data management community. In addition to the relations themselves (please take note of the references to the original sources below), we added three lists in this collection that describe approximate functional dependencies found in the relations. These lists are the result of a manual annotation process performed by two independent individuals by consulting the respective schemas of the relations and identifying column combinations where one column implies another based on its semantics. As an example, in the <em>claims.csv</em> file, the <em>AirportCode</em> implies <em>AirportName</em>, as each code should be unique for a given airport. The file <em>ground_truth.csv</em> is a comma separated file containing approximate functional dependencies. <em>table</em> describes the relation we refer to, <em>lhs</em> and <em>rhs</em> reference two columns of those relations where semantically we found that <em>lhs</em> implies <em>rhs</em>. The file <em>excluded_candidates.csv</em> and <em>included_candidates.csv</em> list all column combinations that were excluded or included in the manual annotation, respectively. We excluded a candidate if there was no tuple where both attributes had a value or if the <em>g3_prime</em> value was too small. <strong>Dataset References</strong> <em>adult.csv</em>: Dua, D. and Graff, C. (2019). UCI Machine Learning Repository. Irvine, CA: University of California, School of Information and Computer Science. <em>claims.csv</em>: TSA Claims Data 2002 to 2006, published by the U.S. Department of Homeland Security. <em>dblp10k.csv</em>: Frequency-aware Similarity Measures. Lange, Dustin; Naumann, Felix (2011). 243–248. Made available as DBLP Dataset 2. <em>hospital.csv</em>: Hospital dataset used in Johann Birnick, Thomas Bläsius, Tobias Friedrich, Felix Naumann, Thorsten Papenbrock, and Martin Schirneck. 2020. Hitting set enumeration with partial information for unique column combination discovery. Proc. VLDB Endow. 13, 12 (August 2020), 2270–2283. https://doi.org/10.14778/3407790.3407824. Made available as part the dataset collection to that paper. <em>t_biocase_...</em> files: t_bioc_... files used in Johann Birnick, Thomas Bläsius, Tobias Friedrich, Felix Naumann, Thorsten Papenbrock, and Martin Schirneck. 2020. Hitting set enumeration with partial information for unique column combination discovery. Proc. VLDB Endow. 13, 12 (August 2020), 2270–2283. https://doi.org/10.14778/3407790.3407824. Made available as part the dataset collection to that paper. <em>tax.csv</em>: Tax dataset used in Johann Birnick, Thomas Bläsius, Tobias Friedrich, Felix Naumann, Thorsten Papenbrock, and Martin Schirneck. 2020. Hitting set enumeration with partial information for unique column combination discovery. Proc. VLDB Endow. 13, 12 (August 2020), 2270–2283. https://doi.org/10.14778/3407790.3407824. Made available as part the dataset collection to that paper.
description: {"references": ["Johann Birnick, Thomas Bl\u00e4sius, Tobias Friedrich, Felix Naumann, Thorsten Papenbrock, and Martin Schirneck. 2020. Hitting set enumeration with partial information for unique column combination discovery. Proc. VLDB Endow. 13, 12 (August 2020), 2270\u20132283. https://doi.org/10.14778/3407790.3407824"]}