Use flat vector storage for the matrix