Patent ID: 11893490
Assignee: INTEL CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A non-transitory computer-readable medium storing instructions, execution of which by one or more processors including a general-purpose graphics processor, causes the one or more processors to perform operations comprising:
determining a first scale factor to apply to first tensor data associated with a first layer of a neural network model;
converting the first tensor data associated with the first layer of the neural network model to generate first converted tensor data, the first tensor data converted from a first datatype to a second datatype, wherein the second datatype is an 8-bit datatype;
generating a first output tensor that is associated with the first layer of the neural network model, the first output tensor generated via the general-purpose graphics processor based on the first converted tensor data and the first scale factor;
determining a second scale factor to apply to second tensor data associated with a second layer of the neural network model;
converting the second tensor data associated with the second layer of the neural network model to generate second converted tensor data, the second tensor data converted from the first datatype to the second datatype; and
generating a second output tensor that is associated with the second layer of the neural network model, the second output tensor generated via the general-purpose graphics processor based on the second converted tensor data and the second scale factor.