PATENT CLAIM ANALYSIS

Application Number: 15977913
Application Type: Utility
Filing Date: 2018-05
Publication Date: 2018-09
Patent Classification: ["706", "017000"]

Abstract:
Systems, methods, and apparatus, including computer programs encoded on a computer storage medium, for selecting an actions from a set of actions to be performed by an agent interacting with an environment. In one aspect, the system includes a dueling deep neural network. The dueling deep neural network includes a value subnetwork, an advantage subnetwork, and a combining layer. The value subnetwork processes a representation of an observation to generate a value estimate. The advantage subnetwork processes the representation of the observation to generate an advantage estimate for each action in the set of actions. The combining layer combines the value estimate and the respective advantage estimate for each action to generate a respective Q value for the action. The system selects an action to be performed by the agent in response to the observation using the respective Q values for the actions in the set of actions.

Claim (Index 6):
The system of  claim 1 , wherein combining the value estimate and the respective advantage estimate comprises:\n determining a measure of central tendency of the respective advantage estimates for the actions in the set of actions; determining a respective adjusted advantage estimate for the action by adjusting the respective advantage estimate for the action using the measure of central tendency; and combining the respective advantage estimate for the action and the value estimate to determine the respective Q value for the action.

Metadata:
- Claim Count in Document: 12.0
- Percentile: 93.0
- Lexical Diversity: 2.7
- Patent Class: 706.0
- Transitional Phrase Type: none
- Component Type: 0
- Foreign Priority: False
- Related Applications: ['15349900', '14952540', '15367094', '15091840', '14097862']

Analysis Scores:
- 35 USC 101 Eligibility (BERT): 0.4128475536376428
- 35 USC 102 Novelty (BERT): 0.574120984697343
- Combined Prediction Score: 0.4289748967436129
- Mean Citation Score: 270.19093000000004
- Max Citation Score: 456.92892
- Similarity Product: 452.6384407326293

Labels:
- Claim Label 101: 1
- Claim Label 102: 0
- Claim Label 103: 1
- Claim Label 112: 1
- Combined Label: 0
- Label 101 Adjusted: 1

Dataset: test