Revert "cpufreq: Don't use cpu removed during cpufreq_driver_unregister"

This reverts commit 44c075550c723a6c8c1c407b2d400784e8880535.