Setting a relative path should work fine. Imagine you have rust checked out
at /usr/rust and set libdir to ../lib