Revert "Fix libpfm linkage."

This reverts commit 9555f95bbfd30f5118a5ed40425d2543644c89a5.