[build][fix] Should only use `XI_CFLAGS` internally -

When `XI_EXTRA_CFLAGS` is used intenrally any external settings
will override it, e.g. running `make XI_EXTRA_CFLAGS=-I../../libfoo`
breaks all internal assignments to `XI_EXTRA_CFLAGS`.