Switch to pkg-config for dependent libs

Seems to be the correct way to do things