PATENT CLAIM ANALYSIS

Application Number: 16021971
Application Type: Utility
Filing Date: 2018-06
Publication Date: 2018-11
Patent Classification: ["706", "015000"]

Abstract:
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating an output sequence from an input sequence. In one aspect, one of the systems includes an encoder neural network configured to receive the input sequence and generate encoded representations of the network inputs, the encoder neural network comprising a sequence of one or more encoder subnetworks, each encoder subnetwork configured to receive a respective encoder subnetwork input for each of the input positions and to generate a respective subnetwork output for each of the input positions, and each encoder subnetwork comprising: an encoder self-attention sub-layer that is configured to receive the subnetwork input for each of the input positions and, for each particular input position in the input order: apply an attention mechanism over the encoder subnetwork inputs using one or more queries derived from the encoder subnetwork input at the particular input position.

Claim (Index 11):
The system of  claim 10 , wherein the encoder self-attention sub-layer is configured to, for each input position, combine the initial encoder self-attention outputs for the input position generated by the encoder self-attention layers to generate the output for the encoder self-attention sub-layer.

Metadata:
- Claim Count in Document: 80.0
- Percentile: 94.0
- Lexical Diversity: 2.65574
- Patent Class: 706.0
- Transitional Phrase Type: none
- Component Type: 0
- Foreign Priority: False
- Related Applications: ['15396091', '15237575', '15815686', '15970662', '15055476']

Analysis Scores:
- 35 USC 101 Eligibility (BERT): 0.3521126770004339
- 35 USC 102 Novelty (BERT): 0.4849483052944421
- Combined Prediction Score: 0.3653962398298347
- Mean Citation Score: 196.154436
- Max Citation Score: 209.22903
- Similarity Product: 164.76982406386438

Labels:
- Claim Label 101: 1
- Claim Label 102: 1
- Claim Label 103: 0
- Claim Label 112: 1
- Combined Label: 1
- Label 101 Adjusted: 0

Dataset: test