Replace build dependencies with pkg-config as much as we can