Remove inherited LDFLAGS

Compiling on GCC was failing in Travis due to linking problems on GCC. Clang build fine.