So one problem with this approach, even though it does this nice connection limiting thing, is that each entire batched multiGet will take as long as the slowest key. And if a single kv pair fails, the entire batch will fail.