@mengxr There always has <code>activeSize < index.length</code> in Breeze SparseVector. I don't see the problem. Do you mean we also check it in the test case? 
btw, maybe we could keep a same <activeSize> in our SparseVector? That would avoid the data copying issue in conversion.