quickly skip over mutex locked servers when looking for servers
do full timeout check when idle
delete first matching client when deleting