Only try to allocate memory for eviction workers if they are configured.