PATENT CLAIM ANALYSIS

Application Number: 16021971
Application Type: Utility
Filing Date: 2018-06
Publication Date: 2018-11
Patent Classification: ["706", "015000"]

Abstract:
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output sequence from an input sequence. In one aspect, one of the systems includes an encoder neural network configured to receive the input sequence and generate encoded representations of the network inputs, the encoder neural network comprising a sequence of one or more encoder subnetworks, each encoder subnetwork configured to receive a respective encoder subnetwork input for each of the input positions and to generate a respective subnetwork output for each of the input positions, and each encoder subnetwork comprising: an encoder self-attention sub-layer that is configured to receive the subnetwork input for each of the input positions and, for each particular input position in the input order: apply an attention mechanism over the encoder subnetwork inputs using one or more queries derived from the encoder subnetwork input at the particular input position.

Claim (Index 24):
The system of  claim 14 , wherein each decoder subnetwork comprises:\n a decoder self-attention sub-layer that is configured to, at each generation time step:\n receive an input for each output position preceding the corresponding output position and, for each of the particular output positions:\n apply an attention mechanism over the inputs at the output positions preceding the corresponding position using one or more queries derived from the input at the particular output position to generate a updated representation for the particular output position.

Metadata:
- Claim Count in Document: 80.0
- Percentile: 94.0
- Lexical Diversity: 2.65574
- Patent Class: 706.0
- Transitional Phrase Type: none
- Component Type: 0
- Foreign Priority: False
- Related Applications: ['15396091', '15237575', '15815686', '15970662', '15055476']

Analysis Scores:
- 35 USC 101 Eligibility (BERT): 0.3502362029009353
- 35 USC 102 Novelty (BERT): 0.4932861958952064
- Combined Prediction Score: 0.3645412022003624
- Mean Citation Score: 196.154436
- Max Citation Score: 209.22903
- Similarity Product: 150.96003784125745

Labels:
- Claim Label 101: 1
- Claim Label 102: 1
- Claim Label 103: 0
- Claim Label 112: 0
- Combined Label: 1
- Label 101 Adjusted: 0

Dataset: test