Revert "cpufreq: Fix wrong time unit conversion"

This reverts commit 3b56558808f78cf0cc7b9934b54829097b928341.