Patent ID: 11941519
Assignee: WAYMO LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A distributed computing system for training a model, the distributed computing system including a plurality of available processors comprising:
a first subset of processors configured to handle a threshold amount of simultaneous processing threads; and
a second subset of processors each having a threshold amount of memory;
wherein the distributed computing system is configured to:
automatically select the first subset of processors based on one or more attributes;
automatically select the second subset of processors based on the threshold amount of memory;
generate the copy of the model on each of the first subset of processors, the generation inciuding applying one or more perturbations to an input of the copy of the model, each copy of the model having an identifier associated therewith, the identifiers being used to track how each copy of the model is trained, to track the training results of one copy of the model relative to other copies of the model in order to evaluate different types of training behavior, to augment the training results based on a real world scenario, and to weigh the training results based on adesired distribution, each copy of the model being configured to work on one or more different types of data associated with the model;
train the copies of the model on the first subset of processors in accordance with the threshold amount of simultaneous processing threads; and
aggregate, based on the identifiers and the training results, the trained copies of the model on the second subset of processors in accordance with the threshold amount of memory.