Don't use install dir to search for dependencies

It breaks building in fakeroot
Revert "Try to fix build on travis-ci"

It shouldn't be needed now

This reverts commit 92cca72126f30a78b1313a6f6e875b059f092a02.