We can say "all of the time" to mean "all the time." Both are correct, but "all the time" is the shorter, more commonly-used idiom.