Not doing an unnecessary conversion to a dense matrix