Add -Wpointer-sign to CFLAGS to ensure we don't get confused between
uint64_t and int64_t.