Do matrix exprs need to know about this?  It seems like DenseMatrix stuff unnecessarily crossing over.