Be more aggressive about the library search path.

- Always try libdir
- Then /lib and /usr/lib on Unix like systems
- And try a bare library file name