I would say we should stop worrying about performance until we discover we need to. Also because Quantity is a subclass of ndarray the size of the ndarray will not have a speed penalty, the cost of adding a unit will be independent of the array size.

Also I did not say we should *not* allow default unit, I just think that it should not be mandatory or in fact even encouraged.