server: fix timer leak

@xiangli-cmu @bmizerany
:+1: