Actually copy/move the internal storage of the variant