Revert "drivers:cpufreq:interactive: Make perms all loosey-goosey"

This reverts commit 633a3b51f8b97cdf41cc40ee1df7e2c8f86ba9e5.