Don't throw away user set CFLAGS

This was apparently accidentally broken in commit 39141fed.