Remove Homebrew-specific header and library search paths