I just tried out this feature in 2.0.2 and it seems to not work at all if there are more than two fields. It appears to delete an entire field, place a blank one above it, and moves the rest down. So the case of >2 fields is currently broken anyway.

Ideally, and this is a lot more work than this version, we would push the swap button, then make all the fields selectable somehow, and after the user selects two fields, swap them. This would require some more UI work, and I'm not sure what would be a good way to present it.