Marginal (contingency) tables are the method of choice for government agencies releasing statistical summaries of categorical data. In this paper, we derive lower bounds on how much distortion (noise) is necessary in these tables to ensure the privacy of sensitive data. We extend a line of recent work on impossibility results for private data analysis [9, 12, 13, 15 ] to a natural and important class of functionalities. Consider a database consisting of n rows (one per individual), each row comprising d binary attributes. For any subset of T attributes of size |T | = k, the marginal table for T has 2 k entries; each entry counts how many times in the database a particular setting of these attributes occurs. We provide lower bounds for releasing all`d k´k -attribute marginal tables under several different notions of privacy. (1) We give efficient polynomial time attacks which allow an adversary to reconstruct sensitive information given insufficiently perturbed marginal table releases. In particular, for a constant k, we obtain a tight bound of e Ω(min{ √ n, on the average distortion per entry for any mechanism that releases all k-attribute marginals while providing "attribute" privacy (a weak notion implied by most privacy definitions). (2) Our reconstruction attacks require a new lower bound on the least singular value of a random matrix with correlated rows. Let M (k) be a matrix with`d k´r ows formed by taking all possible k-way entry-wise products of an underlying set of d random vectors from {0, 1} n . For constant k, we show that the least singular value of M (k) is e Ω( √ d k ) with high probability (the same asymptotic bound as for independent rows). (3) We obtain stronger lower bounds for marginal tables satisfying differential privacy. We give a lower bound of * The full version [20] contains proofs omitted here. 1 The e Ω(·) notation hides inverse polylogarithmic factors in d, n, k.
In particular, when k is a constant, Kasiviswanathan et al. REF
The price of privately releasing contingency tables and the spectra of random matrices with correlated rows
STOC '10
Mathematics Computer Science