Patent ID: 11887004
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 12:
13. The system of claim 12, wherein the batch renormalization layer is configured to, after the neural network has been trained to determine trained values of the learnable parameters for each of the components:
receive a new first layer output generated by the first neural network layer for a new neural network input;
normalize each component of the new first layer output using respective pre-computed normalization statistics for the component to generate a new renormalized layer output;
generate a new batch renormalization layer output by transforming, for each component, the component of the new renormalized layer output in accordance with the trained values of the set of learnable parameters for the component; and
provide the batch renormalization layer output as a new layer input to the second neural network layer.