PM: devfreq: Add some conservativeness