--system-libs option make the build fail

It fails when installing on a system where Linuxbrew deps are installed in custom places and add to PATH & LD_LIBRARY_PATH