Fix assigning to specific worker when worker is not at position 0 in worker collectiojn