Do not unset/overwrite system environment CFLAGS/LDFLAGS

From hasufell on IRC
Merge pull request #547 from dorkster/bugfixes

Do not unset/overwrite system environment CFLAGS/LDFLAGS