Temporary remove swapByteOrderN unit tests

It appears to be the case that htobe16, htobe32 and htobe64 are not
necessarily available on every plattform.