Halfspace matrices
We introduce the notion of a halfspace matrix, which is a sign matrix A with rows indexed by linear threshold functions f, columns indexed by inputs x is an element of {-1, 1}(n), and the entries given by A(f,x) = f (x). We use halfspace matrices to solve the following problems. In communication complexity, we exhibit a Boolean function f with discrepancy Omega(1/n(4)) under every product distribution but O(root n/2(n/4)) under a certain non-product distribution. This partially solves an open problem of Kushilevitz and Nisan (1997). In learning theory, we give a short and simple proof that the statistical-query (SQ) dimension of halfspaces in n dimensions is less than 2(n + 1)(2) under all distributions. This improves on the n(O(1)) estimate from the fundamental paper of Blum et al. (1998). We show that estimating the SQ dimension of natural classes of Boolean functions can resolve major open problems in complexity theory, such as separating PSPACE(cc) and PHcc. Finally, we construct a matrix A is an element of {-1, 1}(NxNlog N) with dimension complexity logN but margin complexity Omega(N-1/4/root log N). This gap is an exponential improvement over previous work. We prove several other relationships among the complexity measures of sign matrices, complementing work by Linial et al. (2006, 2007). Keywords. Linear threshold functions, communication complexity, complexity measures of sign matrices, complexity of learning.
linear threshold functions communication complexity complexity measures of sign matrices complexity of learning