PATENT CLAIM ANALYSIS

Application Number: 16407645
Application Type: Utility
Filing Date: 2019-05
Publication Date: 2019-11
Patent Classification: ["706", "023000"]

Abstract:
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting actions to be performed by an agent interacting with an environment. In one aspect, a system comprises a grid cell neural network and an action selection neural network. The grid cell network is configured to: receive an input comprising data characterizing a velocity of the agent; process the input to generate a grid cell representation; and process the grid cell representation to generate an estimate of a position of the agent in the environment; the action selection neural network is configured to: receive an input comprising a grid cell representation and an observation characterizing a state of the environment; and process the input to generate an action selection network output.

Claim (Index 1):
A system for selecting actions to be performed by an agent interacting with an environment, the system comprising one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to implement:\n a grid cell neural network that is configured to:\n receive an input comprising data characterizing a velocity of the agent; \n process the input to generate a grid cell representation; and \n process the grid cell representation to generate an estimate of a position of the agent in the environment; \n an action selection neural network that is configured to:\n receive an input comprising a grid cell representation and an observation characterizing a state of the environment; and \n process the input to generate an action selection network output; \n a subsystem that is configured to:\n receive data characterizing a current velocity of the agent; \n provide the data characterizing the current velocity of the agent as input to the grid cell neural network to obtain a current grid cell representation; \n receive a current observation characterizing a current state of the environment; \n provide the current grid cell representation and the current observation as input to the action selection neural network to obtain an action selection network output; and \n select, using the action selection network output, an action to be performed by the agent in response to the current observation.

Metadata:
- Claim Count in Document: 53.0
- Percentile: 100.0
- Lexical Diversity: 2.35593
- Patent Class: 706.0
- Transitional Phrase Type: open
- Component Type: 1
- Foreign Priority: False
- Related Applications: ['16403343', '15977913', '15349900', '15091840', '14952540']

Analysis Scores:
- 35 USC 101 Eligibility (BERT): 0.3385470459520299
- 35 USC 102 Novelty (BERT): 0.4820623340780901
- Combined Prediction Score: 0.3528985747646359
- Mean Citation Score: 219.092092
- Max Citation Score: 239.16454
- Similarity Product: 212.4332823355508

Labels:
- Claim Label 101: 1
- Claim Label 102: 1
- Claim Label 103: 1
- Claim Label 112: 0
- Combined Label: 1
- Label 101 Adjusted: 1

Dataset: test