Patent ID: 11907821
Assignee: DEEPMIND TECHNOLOGIES LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 5:
6. The method of claim 5, wherein the plurality of training sessions comprises one or more initial training sessions, wherein the one or more initial training sessions comprise respective hyperparameter values sampled from a first distribution of values, and respective model parameter values sampled from a second distribution of values, and wherein the operations further comprise:
generating a hyperparameter schedule for the selected candidate model, comprising:
identifying a particular training session assigned to a worker of the one or more workers, wherein the particular training session comprises model parameter values corresponding to model parameter values of the selected candidate model,
generating a subgraph comprising a node representing the particular training session and respective nodes whose respective edges form a path from the node comprising the node representing the particular training session and a node representing an initial training session of the one or more initial training sessions, and
obtaining a hyperparameter schedule from respective hyperparameter values of each training session represented by a respective node in the subgraph.