Set rpath correctly

Without this the `#{HOMEBREW_PREFIX}/lib` part gets dropped from linker invocations.