Revert "cpufreq: don't allow governor limits to be changed when it is disabled"

This reverts commit b2e4d7e64ea3a1b5aea2f6a6dbf99975c070a95d.