Ali-C137 (Ali Elfilali)

upvoted a collection 5 days ago

Gemma 2 Release

Collection

10 items • Updated 6 days ago • 96

upvoted a paper 7 days ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published 8 days ago • 71

upvoted a paper 10 days ago

Tokenization Falling Short: The Curse of Tokenization

Paper • 2406.11687 • Published 15 days ago • 13

upvoted an article 16 days ago

Article

How to Fine-Tune Custom Embedding Models Using AutoTrain

By

•

May 30

• 10

upvoted a paper 17 days ago

Transformers meet Neural Algorithmic Reasoners

Paper • 2406.09308 • Published 19 days ago • 43

upvoted a collection 18 days ago

Nemotron 4 340B

Collection

Nemotron-4: open models for Synthetic Data Generation (SDG). Includes Base, Instruct, and Reward models. • 4 items • Updated 18 days ago • 147

upvoted an article 18 days ago

Article

AI Watermarking 101: Tools and Techniques

Feb 26

• 8

upvoted a collection 25 days ago

IrokoBench

Collection

a human-translated benchmark dataset for 16 African languages covering three tasks: NLI, MMLU and MGSM • 6 items • Updated May 31 • 14

upvoted a collection 26 days ago

Qwen2

Collection

Qwen2 language models, including pretrained and instruction-tuned models of 5 sizes, including 0.5B, 1.5B, 7B, 57B-A14B, and 72B. • 29 items • Updated 26 days ago • 226

upvoted an article 28 days ago

Article

Uncensor any LLM with abliteration

By

•

20 days ago

• 226

upvoted 3 collections about 1 month ago

upvoted a paper about 1 month ago

An Introduction to Vision-Language Modeling

Paper • 2405.17247 • Published May 27 • 77

upvoted an article about 1 month ago

Article

⚗️ 🔥 Building High-Quality Datasets with distilabel and Prometheus 2

By

•

29 days ago

• 21

upvoted a paper about 1 month ago

Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts

Paper • 2405.11273 • Published May 18 • 17

upvoted 2 articles about 1 month ago

Article

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

May 24

• 20

Article

Let's talk about LLM evaluation

By

•

May 23

• 92

upvoted a paper about 1 month ago

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models

Paper • 2403.13372 • Published Mar 20 • 58

upvoted 2 papers about 2 months ago

What matters when building vision-language models?

Paper • 2405.02246 • Published May 3 • 91

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents

Paper • 2306.16527 • Published Jun 21, 2023 • 44

upvoted 2 articles about 2 months ago

Article

Train custom AI models with the trainer API and adapt them to 🤗

By

•

3 days ago

• 28

Article

PaliGemma – Google's Cutting-Edge Open Vision Language Model

May 14

• 157

upvoted a collection about 2 months ago

PaliGemma Release

Collection

Pretrained and mix checkpoints for PaliGemma • 16 items • Updated 6 days ago • 119

upvoted 5 articles about 2 months ago

Article

Hugging Face x LangChain : A new partner package in LangChain

May 14

• 85

Article

Large-scale Near-deduplication Behind BigCode

May 16, 2023

• 11

Article

Introducing the Open Arabic LLM Leaderboard

May 14

• 53

Article

AI Apps in a Flash with Gradio's Reload Mode

Apr 16

• 17

Article

License to Call: Introducing Transformers Agents 2.0

May 13

• 98

upvoted a paper about 2 months ago

101 Billion Arabic Words Dataset

Paper • 2405.01590 • Published Apr 29 • 3

upvoted 3 articles about 2 months ago

Article

makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch

By

•

May 7

• 29

Article

SeeMoE: Implementing a MoE Vision Language Model from Scratch

By

•

9 days ago

• 30

Article

seemore: Implement a Vision Language Model from Scratch

By

•

9 days ago

• 48

upvoted a paper about 2 months ago

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Paper • 2405.00732 • Published Apr 29 • 116

upvoted 2 articles 2 months ago

Article

Improving Prompt Consistency with Structured Generations

Apr 30

• 48

Article

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

By

•

29 days ago

• 64

upvoted 2 collections 2 months ago

Vision Language Models Papers 🖼️💬📝

Collection

Papers about vision-language models, most important ones are on top of the list. • 27 items • Updated Apr 30 • 27

Phi-3

Collection

Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths. • 22 items • Updated May 31 • 353

upvoted 2 articles 2 months ago

Article

Fine-tune Llama 3 with ORPO

By

•

Apr 22

• 204

Article

Design choices for Vision Language Models in 2024

By

•

Apr 16

• 21

upvoted a collection 2 months ago

🍷 FineWeb datasets

Collection

5 items • Updated 7 days ago • 15

upvoted an article 2 months ago

Article

Mergoo: Efficiently Build Your Own MoE LLM

By

•

30 days ago

• 36

upvoted an article 3 months ago

Article

From OpenAI to Open LLMs with Messages API

Feb 8

• 8

upvoted a collection 3 months ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated Apr 18 • 618

upvoted 2 papers 3 months ago

SantaCoder: don't reach for the stars!

Paper • 2301.03988 • Published Jan 9, 2023 • 7

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Paper • 2404.03715 • Published Apr 4 • 58

upvoted 7 articles 3 months ago

Article

Mixture of Depth is Vibe

By

•

Apr 22

• 40

Article

Experiments with Bitnet 1.5 (~ngmi~)

By

•

Mar 30

• 3

Article

DS-MoE: Making MoE Models More Efficient and Less Memory-Intensive

By

•

Apr 9

• 28

Article

Outpainting II - Differential Diffusion

By

•

Apr 23

• 30

Article

Introduction to State Space Models (SSM)

By

•

22 days ago

• 46

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 22

Article

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Mar 20

• 33

upvoted 2 papers 3 months ago

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published Apr 4 • 75

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 102

upvoted an article 3 months ago

Article

Total noob’s intro to Hugging Face Transformers

Mar 22

• 29

upvoted 4 papers 3 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 574

Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models

Paper • 2401.01335 • Published Jan 2 • 61

Leveraging Corpus Metadata to Detect Template-based Translation: An Exploratory Case Study of the Egyptian Arabic Wikipedia Edition

Paper • 2404.00565 • Published Mar 31 • 6

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 75

Ali Elfilali

AI & ML interests

Articles

Introducing the Open Arabic LLM Leaderboard

Organizations

Ali-C137's activity

How to Fine-Tune Custom Embedding Models Using AutoTrain

AI Watermarking 101: Tools and Techniques

Uncensor any LLM with abliteration

⚗️ 🔥 Building High-Quality Datasets with distilabel and Prometheus 2

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

Let's talk about LLM evaluation

Train custom AI models with the trainer API and adapt them to 🤗

PaliGemma – Google's Cutting-Edge Open Vision Language Model

Hugging Face x LangChain : A new partner package in LangChain

Large-scale Near-deduplication Behind BigCode

Introducing the Open Arabic LLM Leaderboard

AI Apps in a Flash with Gradio's Reload Mode

License to Call: Introducing Transformers Agents 2.0

makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch

SeeMoE: Implementing a MoE Vision Language Model from Scratch

seemore: Implement a Vision Language Model from Scratch

Improving Prompt Consistency with Structured Generations

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

Fine-tune Llama 3 with ORPO

Design choices for Vision Language Models in 2024

Mergoo: Efficiently Build Your Own MoE LLM

From OpenAI to Open LLMs with Messages API

Mixture of Depth is Vibe

Experiments with Bitnet 1.5 (~ngmi~)

DS-MoE: Making MoE Models More Efficient and Less Memory-Intensive

Outpainting II - Differential Diffusion

Introduction to State Space Models (SSM)

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Total noob’s intro to Hugging Face Transformers