PATENT CLAIM ANALYSIS

Application Number: 16407645
Application Type: Utility
Filing Date: 2019-05
Publication Date: 2019-11
Patent Classification: ["706", "023000"]

Abstract:
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting actions to be performed by an agent interacting with an environment. In one aspect, a system comprises a grid cell neural network and an action selection neural network. The grid cell network is configured to: receive an input comprising data characterizing a velocity of the agent; process the input to generate a grid cell representation; and process the grid cell representation to generate an estimate of a position of the agent in the environment; the action selection neural network is configured to: receive an input comprising a grid cell representation and an observation characterizing a state of the environment; and process the input to generate an action selection network output.

Claim (Index 20):
One or more non-transitory computer storage media storing instructions that when executed by one or more computers cause the one or more computers to perform operations for selecting actions to be performed by an agent interacting with an environment, the operations comprising:\n receiving data characterizing a current velocity of the agent; providing the data characterizing the current velocity of the agent as an input to a grid cell neural network to obtain a current grid cell representation, wherein the grid cell neural network is trained to:\n process an input characterizing a velocity of the agent to generate a grid cell representation; and \n process the grid cell representation to generate an estimate of a position of the agent in the environment; \n receiving a current observation characterizing a current state of the environment; processing the current grid cell representation and the current observation using an action selection neural network to generate an action selection network output; and selecting, using the action selection network output, an action to be performed by the agent in response to the current observation.

Metadata:
- Claim Count in Document: 53.0
- Percentile: 100.0
- Lexical Diversity: 2.35593
- Patent Class: 706.0
- Transitional Phrase Type: open
- Component Type: 1
- Foreign Priority: False
- Related Applications: ['16403343', '15977913', '15349900', '15091840', '14952540']

Analysis Scores:
- 35 USC 101 Eligibility (BERT): 0.3381290344056118
- 35 USC 102 Novelty (BERT): 0.4840959480047668
- Combined Prediction Score: 0.3527257257655273
- Mean Citation Score: 219.092092
- Max Citation Score: 239.16454
- Similarity Product: 207.7118926856184

Labels:
- Claim Label 101: 1
- Claim Label 102: 1
- Claim Label 103: 1
- Claim Label 112: 0
- Combined Label: 1
- Label 101 Adjusted: 1

Dataset: test