Fixed #169 - Server crash

Do you not need to cancel this somehow if they *do* connect in time?  Shouldn't this timeout callback be returning early if some success condition is met?  Otherwise aren't you going to automatically destroy this no matter what happens?