Fix pkgconfig input

Don't default the prefix to /usr