mkskom PRO

belyakoff's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted 3 papers 5 days ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published 8 days ago • 57

Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models

Paper • 2405.20541 • Published 9 days ago • 15

Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts

Paper • 2405.19893 • Published 9 days ago • 22

upvoted 3 papers 16 days ago

Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documents

Paper • 2310.19923 • Published Oct 30, 2023 • 10

Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings

Paper • 2402.17016 • Published Feb 26 • 4

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published 20 days ago • 138

upvoted 2 papers 18 days ago

RLHF Workflow: From Reward Modeling to Online RLHF

Paper • 2405.07863 • Published 26 days ago • 62

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning

Paper • 2405.12130 • Published 19 days ago • 42

upvoted 2 articles 24 days ago

view article

Article

🕳️ Attention Sinks in LLMs for endless fluency

By •

Oct 9, 2023

• 6

view article

Article

makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch

By •

May 7

• 27

upvoted an article about 1 month ago

view article

Article

Inference for PROs

Sep 22, 2023

• 18

upvoted a paper 3 months ago

Soaring from 4K to 400K: Extending LLM's Context with Activation Beacon

Paper • 2401.03462 • Published Jan 7 • 25