At the moment, it's coupled to the underlying matrix representation, but with the new code for pulling out raw rows, I don't think there's any barrier to having it inside there.