Before revision:  We also show that the full attention version of our model achieves competitive performance compared to existing LibriSpeech benchmarksfor attention-based models trained with cross-entropy loss .
After revision:  We also show that the full attention version of our model beats the-state-of-the art accuracy on the LibriSpeech benchmarks .