Don't free vectors in their dtor

Merge/rebase error from DST. Thanks to @eddyb for finding.

Closes #16826 (I hope)

r?
Actually, this is calling `get_fill()` instead of `get_len()`. Curious.