We need to search prefix/lib32 and prefix/lib64 in addition to prefix/lib