Fixed #169 - Server crash

If that's the case, your comment above this code is wrong, since we don't *only* remove it if they don't connect in time, but always.  You should beef up that comment to reflect what's happening here.  I don't think there's a race condition here, but there is some need for clarity in the code, especially with regard to the progression from authorized to sync (e.g., who holds references to this user).