Check for idle workers before shrinking pool