Fix building with CFLAGS to use additional system defined flags

Signed-off-by: Vinzenz Feenstra <vfeenstr@redhat.com>