The use of uninstalled pkg-config files has always been dubious to begin
with. Builds using a separate prefix should modify the PKG_CONFIG_PATH,
instead of pointing to build directories.