gmongaras/Cosine_Attention_GPT_300M
Feature Extraction
•
Updated
•
15
Cosine Attention (Cottention)
Models for the paper Cottention: Linear Transformers With Cosine Attention https://arxiv.org/abs/2409.18747
-
-
gmongaras/Softmax_Attention_GPT_1.2B
Feature Extraction • Updated • 20 -
gmongaras/Softmax_Attention_GPT_300M
Feature Extraction • Updated • 24 -
gmongaras/Cosine_Attention_GPT_1.2B
Feature Extraction • Updated • 21 -
gmongaras/Cosine_Attention_BERT
Feature Extraction • Updated • 17 -
gmongaras/Softmax_Attention_BERT
Feature Extraction • Updated • 24