Avoid a ubsan warning on GCC 4.9 due uninitialized sign enum being
read during swap (in the move constructor)