In my experience, yes. But that's not true across the board. I tend to stop drinking caffeine by 11 a.m., or else I won't get to sleep until after midnight.
Caffeine metabolizes differently from person to person, and that's no different whether hot or cold coffee. Some folks can have a cup of coffee after dessert and sleep soundly.