Return SmallVectorImpl& instead of SmallVector& in a couple places to avoid having to specify the vector size in multiple places.