Patent ID: 11907032
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC F  G  H | IPC G  H

Claim 17:
18. A computing device comprising:
one or more processing devices;
one or more temperature sensors;
a fan; and
a fan tachometer;
wherein the one or more processing devices are configured to:
receive a reinforcement learning model from a server computing device;
execute an application program;
while executing the application program, collect performance data including:
temperature data received from the one or more temperature sensors; and
fan speed data received from the fan tachometer;

generate a fan control signal at least in part by applying the reinforcement learning model to the performance data, wherein the reinforcement learning model has a loss function including:
a fan speed term computed as a function of a fan speed included in the fan speed data; and
a temperature overshoot term added to the loss function when the temperature data indicates a temperature above a predetermined temperature threshold;

control the fan according to the fan control signal; and
perform additional training on the reinforcement learning model based at least in part on the performance data and the loss function of the reinforcement learning model.