Fix a bug that "!XXX" may return inverted result

It may be happened on big endian environment.