Forward CFLAGS and LDFLAGS to the compiler

Will be easier to add custom flags, especially for cross compiling with buildbot.