Fix an issue where expired Timer pointers caused other timers to be delayed.

Fixes #6179