CopyOnWriteArrayList should be sufficient looking for this as we do not really care if during one traversal to evict connections, new conn managers will be added. They will be evicted next time.