I guess there could be a subclass that uses HugeDoubleMatrix as storage?