Remove some compiler flags coming from llvm-config. This fixes up some issues when building with GCC 4.8.2