Make sure libraries in /usr/local/lib are found

Explicitly pass rpath and other flags to the build within Travis CI
so that we can properly load our dependent libraries.