Ali-C137 (Ali Elfilali)

upvoted an article 4 days ago

Article

Improving Prompt Consistency with Structured Generations

5 days ago

• 28

upvoted an article 8 days ago

Article

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

By

•

8 days ago

• 47

upvoted a collection 9 days ago

Vision Language Models Papers 🖼️💬📝

Collection

Papers about vision-language models, most important ones are on top of the list. • 27 items • Updated 4 days ago • 23

upvoted a collection 11 days ago

Phi-3

Collection

Phi-3 family of models • 6 items • Updated 9 days ago • 178

upvoted an article 12 days ago

Article

Fine-tune Llama 3 with ORPO

By

•

12 days ago

• 156

upvoted an article 13 days ago

Article

Design choices for Vision Language Models in 2024

By

•

18 days ago

• 17

upvoted a collection 13 days ago

FineWeb datasets

Collection

1 item • Updated 13 days ago • 7

upvoted an article 15 days ago

Article

Mergoo: Efficiently Build Your Own MoE LLM

By

•

6 days ago

• 28

upvoted an article 16 days ago

Article

From OpenAI to Open LLMs with Messages API

Feb 8

• 1

upvoted a collection 16 days ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated 16 days ago • 459

upvoted a paper 21 days ago

SantaCoder: don't reach for the stars!

Paper • 2301.03988 • Published Jan 9, 2023 • 6

upvoted a paper 22 days ago

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Paper • 2404.03715 • Published 30 days ago • 57

upvoted an article 23 days ago

Article

Mixture of Depth is Vibe

By

•

12 days ago

• 35

upvoted 6 articles 25 days ago

Article

Experiments with Bitnet 1.5 (~ngmi~)

By

•

Mar 30

• 2

Article

DS-MoE: Making MoE Models More Efficient and Less Memory-Intensive

By

•

25 days ago

• 25

Article

Outpainting II - Differential Diffusion

By

•

11 days ago

• 22

Article

Introduction to State Space Models (SSM)

By

•

26 days ago

• 17

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 17

Article

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Mar 20

• 14

upvoted a paper 27 days ago

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published 30 days ago • 66

upvoted a paper 29 days ago

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 98

upvoted an article 29 days ago

Article

Total noob’s intro to Hugging Face Transformers

Mar 22

• 16

upvoted a paper 29 days ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 562

upvoted 3 papers about 1 month ago

Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models

Paper • 2401.01335 • Published Jan 2 • 61

Leveraging Corpus Metadata to Detect Template-based Translation: An Exploratory Case Study of the Egyptian Arabic Wikipedia Edition

Paper • 2404.00565 • Published Mar 31 • 5

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 74

upvoted 2 collections about 1 month ago

DBRX

Collection

DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks. • 3 items • Updated Mar 27 • 85

PALO

Collection

PALO: A Polyglot Large Multimodal Model for 5B People • 6 items • Updated 8 days ago • 2

upvoted a paper about 1 month ago

Larimar: Large Language Models with Episodic Memory Control

Paper • 2403.11901 • Published Mar 18 • 30

upvoted a collection about 1 month ago

Common Corpus

Collection

The largest public domain dataset for training LLMs. • 26 items • Updated Mar 20 • 99

upvoted 6 papers about 2 months ago

upvoted 4 papers 2 months ago

VisionLLaMA: A Unified LLaMA Interface for Vision Tasks

Paper • 2403.00522 • Published Mar 1 • 40

Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation

Paper • 2401.08417 • Published Jan 16 • 25

A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models

Paper • 2309.11674 • Published Sep 20, 2023 • 29

When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method

Paper • 2402.17193 • Published Feb 27 • 23

upvoted 2 collections 2 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 72

nekomata

Collection

The nekomata model series are based on the Qwen series and have been continually pre-trained on Japanese-specific corpora. • 8 items • Updated about 1 month ago • 5

upvoted a paper 2 months ago

FiT: Flexible Vision Transformer for Diffusion Model

Paper • 2402.12376 • Published Feb 19 • 46

upvoted 3 collections 2 months ago

Foundation Models

Collection

2 items • Updated Feb 19 • 3

Models Quantization

Collection

10 items • Updated Feb 19 • 2

Merges

Collection

4 items • Updated Feb 19 • 4

upvoted a paper 3 months ago

Generative Representational Instruction Tuning

Paper • 2402.09906 • Published Feb 15 • 50

upvoted 2 collections 3 months ago

Qwen1.5

Collection

Qwen1.5 is the improved version of Qwen, the large language model series developed by Alibaba Cloud. • 55 items • Updated 5 days ago • 158

GoLLIE

Collection

We present GoLLIE, a Large Language Model trained to follow annotation guidelines that outperforms previous approaches on zero-shot IE. • 4 items • Updated Mar 11 • 15

upvoted a paper 3 months ago

Do Multilingual Language Models Think Better in English?

Paper • 2308.01223 • Published Aug 2, 2023 • 2

upvoted a collection 3 months ago

LLM Hallucination Detection Papers

Collection

Collection of LLM hallucination and evaluation papers that I've been exploring and implementing. Some of them have my comments and annotated doodles. • 12 items • Updated Feb 20 • 12

upvoted 8 papers 3 months ago

Scaling Laws for Downstream Task Performance of Large Language Models

Paper • 2402.04177 • Published Feb 6 • 16

Grandmaster-Level Chess Without Search

Paper • 2402.04494 • Published Feb 7 • 62

Self-Discover: Large Language Models Self-Compose Reasoning Structures

Paper • 2402.03620 • Published Feb 6 • 102

BlackMamba: Mixture of Experts for State-Space Models

Paper • 2402.01771 • Published Feb 1 • 22

Mistral 7B

Paper • 2310.06825 • Published Oct 10, 2023 • 41

Specialized Language Models with Cheap Inference from Limited Domain Data

Paper • 2402.01093 • Published Feb 2 • 45

SemScore: Automated Evaluation of Instruction-Tuned LLMs based on Semantic Textual Similarity

Paper • 2401.17072 • Published Jan 30 • 22

OLMo: Accelerating the Science of Language Models

Paper • 2402.00838 • Published Feb 1 • 74

upvoted a collection 3 months ago

LLM Leaderboard best models ❤️‍🔥

Collection

A daily uploaded list of models with best evaluations on the LLM leaderboard: • 65 items • Updated 5 days ago • 292

Ali Elfilali

AI & ML interests

Organizations

Ali-C137's activity

Improving Prompt Consistency with Structured Generations

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

Fine-tune Llama 3 with ORPO

Design choices for Vision Language Models in 2024

Mergoo: Efficiently Build Your Own MoE LLM

From OpenAI to Open LLMs with Messages API

Mixture of Depth is Vibe

Experiments with Bitnet 1.5 (~ngmi~)

DS-MoE: Making MoE Models More Efficient and Less Memory-Intensive

Outpainting II - Differential Diffusion

Introduction to State Space Models (SSM)

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Total noob’s intro to Hugging Face Transformers