[fix][build] Should not touch `$(XI_CFLAGS)` directly at this point