Patent ID: 11915152
Assignee: D5AI LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 19:
20. A computerized method of improving operation of a student ML system, the method comprising:
initial training, iteratively through machine learning, the student ML system on training data to perform a machine learning task, wherein:
the student ML system comprises an input layer, an output layer, and at least a first inner layer between the input and output layers;
each layer comprises at least one node, such that the first inner layer comprises at least a first node;
the first node of the first inner layer outputs an activation value for each set of input values to the first node of the first inner layer;
the activation value is determined based on an activation function for the first node of the first inner layer and based on learned parameters for the first node of the first inner layer; and
the initial training the student ML system comprises, following iterations of the training of the student ML system, updating the learned parameters for the first node of the first inner layer;

generating, by a reference system, a set of additional training data for the student ML system, wherein the reference system comprises a ML system and comprises a computer;
following the initial training of the student ML system:
training the student ML system on the set of additional training data generated by the reference system, wherein the additional training data are input to the input layer of the student ML system;
receiving, by a learning coach ML system, from the student ML system, observations about an internal state of the student ML system as the student ML system is being trained on the set of training data generated by the reference system, wherein:
the learning coach ML system has been trained through machine learning to determine one or more revised hyperparameter values for the student ML system, wherein each of the one or more revised hyperparameter values controls an aspect of the machine learning by the student ML system;
the learning coach ML system comprises an input layer and an output layer;
the learning coach ML system determines the one or more revised hyperparameter values for the student ML system based on input to the learning coach ML system from the student ML system;
the input to the learning coach ML system from the student ML system is input to the input layer of the learning coach ML system;
the input from the student ML system to the learning coach ML system comprises the observations about the internal state of the student ML system; and
the observations about the internal state of the student ML system comprise values related to the learned parameters and the activation values of the first node of the first inner layer of the student ML system; and

determining, by the learning coach ML system, the one or more revised hyperparameter values for the student ML system based on the observations about the first node of the first inner layer of the student ML system from training on the set of additional training data generated by the reference system to improve operation of the student ML system.