server: fix timer leak

@xiangli-cmu @bmizerany