Started recovering the sparsity pattern on the block level (formed by
the blocks)