Append to CFLAGS and CXXFLAGS instead of overwriting them.