cpufreq: fix performance regression