Getting really large value at particular Index

Ayush_Singhal: <p>I was just playing around with some HuggingFace NLP Models <code>Roberta</code>/<code>Deberta</code>. I got the embeddings from them as the final output. But when I plotted them on a graph, I found something abnormal. All of the values were very small as expected, but the value at <code>588</code> in the case of <code>Roberta</code> came up to be around 10 , (in points). I tried it with different sentences, words, paragraphs, but everytime only the value at 588 seemed to be abnromal. The graph looked like this<br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/a/5/a56cd75fad76991e5a8edcbf13a637b4aebe71e1.png" data-download-href="https://discuss.pytorch.org/uploads/default/a56cd75fad76991e5a8edcbf13a637b4aebe71e1" title="Roberta"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/a/5/a56cd75fad76991e5a8edcbf13a637b4aebe71e1_2_648x500.png" alt="Roberta" data-base62-sha1="nBpYodq9q8rahwXkqbVhwPLInIJ" width="648" height="500" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/a/5/a56cd75fad76991e5a8edcbf13a637b4aebe71e1_2_648x500.png, https://discuss.pytorch.org/uploads/default/original/3X/a/5/a56cd75fad76991e5a8edcbf13a637b4aebe71e1.png 1.5x, https://discuss.pytorch.org/uploads/default/original/3X/a/5/a56cd75fad76991e5a8edcbf13a637b4aebe71e1.png 2x" data-dominant-color="F9FAFB"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">Roberta</span><span class="informations">682×526 22.5 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div><br>
The same thing was encountered on <code>Deberta</code>, but with multiple values<br>
(I could not post the graph, due to restrictions)<br>
Where are there these abnormalities…?, Do transformers/these architechtures work like this only</p>

Ayush_Singhal: <p>Deberta</p>
<p><div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/9/d/9d33662f84a3f6b6a55b4a4346b014e006977b33.png" data-download-href="https://discuss.pytorch.org/uploads/default/9d33662f84a3f6b6a55b4a4346b014e006977b33" title="Deberta"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/9/d/9d33662f84a3f6b6a55b4a4346b014e006977b33_2_690x496.png" alt="Deberta" data-base62-sha1="mqF5gXNTZBjX7Gf2vn0vT2y5PyP" width="690" height="496" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/9/d/9d33662f84a3f6b6a55b4a4346b014e006977b33_2_690x496.png, https://discuss.pytorch.org/uploads/default/original/3X/9/d/9d33662f84a3f6b6a55b4a4346b014e006977b33.png 1.5x, https://discuss.pytorch.org/uploads/default/original/3X/9/d/9d33662f84a3f6b6a55b4a4346b014e006977b33.png 2x" data-dominant-color="F8FAFB"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">Deberta</span><span class="informations">717×516 25.4 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>