I forget, what did we decide before - build the matrix as a LIL, but convert to a CSR before we return it?