We need to properly count the number of non-zeros.