Flexible, autoscalable, efficient client pool implementation