Well, we also do not allowed to convert a vector into double array. Use the same techinque from `AbstractMatrix` class.