Patent ID: 11900235
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. The system of claim 14, wherein generating the updated layer hidden state for the time step comprises:
for each respective gate of each LSTM layer,
processing the layer input to the respective LSTM neural network layer in accordance with a first group of the set of parameters associated with the respective gate that include parameter values applied to the layer input of the respective LSTM layer to update the respective gate of the respective LSTM neural network layer;
processing the hidden state to the respective LSTM neural network layer in accordance with a second group of the set of parameters associated with the respective gate that include parameter values applied to the hidden state of the respective LSTM neural network layer to update the respective gate of the respective LSTM neural network layer;
generating an activation value for the respective gate by combining values obtained from processing the layer input and processing the hidden state;
generating a modified activation value for the respective gate by combining the activation value with a third group of the set of parameters associated with the respective gate that include bias values for the respective gate; and
applying a normalization function to the modified activation value for the respective gate to generate a final value of the respective gate for the respective time step.