Store clockid_t in cache settings to avoid branching

This is an OOMA (Out Of My Ass) optimization. Won't make a difference
in performance but the line count is shorter and I like it better this
way.