cpufreq: More clean up for 3.4