It should be faster to convert LIL to CSR, so just use `tocsr` here.