Models for the paper Cottention: Linear Transformers With Cosine Attention https://arxiv.org/abs/2409.18747
Gabriel Mongaras
gmongaras
AI & ML interests
None yet
Organizations
Collections
5
Papers
1
models
18
gmongaras/Softmax_Attention_BERT
Feature Extraction
•
Updated
•
7
gmongaras/Cosine_Attention_BERT
Feature Extraction
•
Updated
•
11
gmongaras/Cosine_Attention_GPT_1.2B
Feature Extraction
•
Updated
•
12
gmongaras/Cosine_Attention_GPT_300M
Feature Extraction
•
Updated
•
19
gmongaras/Softmax_Attention_GPT_1.2B
Feature Extraction
•
Updated
•
10
gmongaras/Softmax_Attention_GPT_300M
Feature Extraction
•
Updated
•
10
gmongaras/Yann_UWU
Text Generation
•
Updated
•
23
gmongaras/Meta-Llama-3.1-8B
Text Generation
•
Updated
•
13
gmongaras/reddit_negative_v1_13B
Text Generation
•
Updated
•
19
•
1
gmongaras/Wizard_7B_Squad_v2
Text Generation
•
Updated
•
15
datasets
21
gmongaras/Elon_Tweets_Score
Viewer
•
Updated
•
5.9k
•
32
gmongaras/Elon_Tweets
Viewer
•
Updated
•
5.9k
•
41
gmongaras/Pile_Llama_Tokenized
Updated
•
8
gmongaras/Anime_Subtitle_data2
Viewer
•
Updated
•
1.91M
•
47
gmongaras/Anime_Subtitle_data
Viewer
•
Updated
•
14.6M
•
46
gmongaras/BERT_Base_Cased_128_Dataset_Mapped
Viewer
•
Updated
•
132M
•
211
gmongaras/BERT_Base_Cased_128_Dataset
Viewer
•
Updated
•
134M
•
130
gmongaras/Yann_LeCun_Tweets
Viewer
•
Updated
•
406
•
53
gmongaras/dummy_text_dataset
Viewer
•
Updated
•
2.05k
•
67
gmongaras/EleutherAI_the_pile_deduplicated
Viewer
•
Updated
•
134M
•
123
•
2