Remove servers from users when destroyed; closes #23