Properly remove UserConnection from server's list

Previous version did not properly remove a UserConnection from the server's list when they change servers.

This version also prevent duplicates from being placed in a server's list.