Ali-C137 (Ali Elfilali)

upvoted 2 collections 2 days ago

Arabic Aya DPO Datasets

Collection

Our synthetic DPO datasets for Arabic Aya. • 4 items • Updated 3 days ago • 3

Arabic NoRobots DPO Datasets

Collection

Our synthetic DPO datasets for Arabic NoRobots. • 4 items • Updated 3 days ago • 3

upvoted a paper 2 days ago

An Introduction to Vision-Language Modeling

Paper • 2405.17247 • Published 5 days ago • 63

upvoted an article 3 days ago

Article

⚗️ 🔥 Building High-Quality Datasets with distilabel and Prometheus 2

By

•

4 days ago

• 20

upvoted a paper 8 days ago

Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts

Paper • 2405.11273 • Published 14 days ago • 15

upvoted an article 8 days ago

Article

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

9 days ago

• 17

upvoted an article 10 days ago

Article

Let's talk about LLM evaluation

By

•

10 days ago

• 82

upvoted a paper 10 days ago

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models

Paper • 2403.13372 • Published Mar 20 • 57

upvoted a paper 15 days ago

What matters when building vision-language models?

Paper • 2405.02246 • Published 29 days ago • 87

upvoted a paper 17 days ago

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents

Paper • 2306.16527 • Published Jun 21, 2023 • 42

upvoted an article 17 days ago

Article

Train custom AI models with the trainer API and adapt them to 🤗

By

•

7 days ago

• 21

upvoted an article 18 days ago

Article

PaliGemma – Google's Cutting-Edge Open Vision Language Model

19 days ago

• 131

upvoted a collection 18 days ago

PaliGemma Release

Collection

Pretrained and mix checkpoints for PaliGemma • 11 items • Updated 16 days ago • 103

upvoted 3 articles 18 days ago

Article

Hugging Face x LangChain : A new partner package in LangChain

19 days ago

• 70

Article

Large-scale Near-deduplication Behind BigCode

May 16, 2023

• 10

Article

Introducing the Open Arabic LLM Leaderboard

19 days ago

• 47

upvoted 2 articles 19 days ago

Article

AI Apps in a Flash with Gradio's Reload Mode

Apr 16

• 16

Article

License to Call: Introducing Transformers Agents 2.0

20 days ago

• 88

upvoted a paper 25 days ago

101 Billion Arabic Words Dataset

Paper • 2405.01590 • Published Apr 29 • 3

upvoted 2 articles 25 days ago

Article

makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch

By

•

25 days ago

• 25

Article

SeeMoE: Implementing a MoE Vision Language Model from Scratch

By

•

26 days ago

• 24

upvoted an article 27 days ago

Article

seemore: Implement a Vision Language Model from Scratch

By

•

20 days ago

• 43

upvoted a paper 28 days ago

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Paper • 2405.00732 • Published Apr 29 • 115

upvoted 2 articles about 1 month ago

Article

Improving Prompt Consistency with Structured Generations

Apr 30

• 46

Article

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

By

•

Apr 26

• 55

upvoted 2 collections about 1 month ago

Vision Language Models Papers 🖼️💬📝

Collection

Papers about vision-language models, most important ones are on top of the list. • 27 items • Updated Apr 30 • 26

Phi-3

Collection

Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths. • 22 items • Updated 2 days ago • 299

upvoted 2 articles about 1 month ago

Article

Fine-tune Llama 3 with ORPO

By

•

Apr 22

• 193

Article

Design choices for Vision Language Models in 2024

By

•

Apr 16

• 20

upvoted a collection about 1 month ago

FineWeb datasets

Collection

3 items • Updated 3 days ago • 8

upvoted 2 articles about 1 month ago

Article

Mergoo: Efficiently Build Your Own MoE LLM

By

•

26 days ago

• 32

Article

From OpenAI to Open LLMs with Messages API

Feb 8

• 6

upvoted a collection about 1 month ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated Apr 18 • 557

upvoted 2 papers about 2 months ago

SantaCoder: don't reach for the stars!

Paper • 2301.03988 • Published Jan 9, 2023 • 6

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Paper • 2404.03715 • Published Apr 4 • 58

upvoted 7 articles about 2 months ago

Article

Mixture of Depth is Vibe

By

•

Apr 22

• 36

Article

Experiments with Bitnet 1.5 (~ngmi~)

By

•

Mar 30

• 3

Article

DS-MoE: Making MoE Models More Efficient and Less Memory-Intensive

By

•

Apr 9

• 26

Article

Outpainting II - Differential Diffusion

By

•

Apr 23

• 24

Article

Introduction to State Space Models (SSM)

By

•

Apr 8

• 27

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 20

Article

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Mar 20

• 24

upvoted 2 papers about 2 months ago

ReFT: Representation Finetuning for Language Models

Paper • 2404.03592 • Published Apr 4 • 74

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 102

upvoted an article about 2 months ago

Article

Total noob’s intro to Hugging Face Transformers

Mar 22

• 21

upvoted 2 papers about 2 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 567

Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models

Paper • 2401.01335 • Published Jan 2 • 61

upvoted 2 papers 2 months ago

Leveraging Corpus Metadata to Detect Template-based Translation: An Exploratory Case Study of the Egyptian Arabic Wikipedia Edition

Paper • 2404.00565 • Published Mar 31 • 6

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 75

upvoted 2 collections 2 months ago

DBRX

Collection

DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks. • 3 items • Updated Mar 27 • 89

PALO

Collection

PALO: A Polyglot Large Multimodal Model for 5B People • 6 items • Updated Apr 26 • 2

upvoted a paper 2 months ago

Larimar: Large Language Models with Episodic Memory Control

Paper • 2403.11901 • Published Mar 18 • 30

upvoted a collection 2 months ago

Common Corpus

Collection

The largest public domain dataset for training LLMs. • 26 items • Updated Mar 20 • 103

upvoted 7 papers 3 months ago

Ali Elfilali

AI & ML interests

Articles

Introducing the Open Arabic LLM Leaderboard

Organizations

Ali-C137's activity

⚗️ 🔥 Building High-Quality Datasets with distilabel and Prometheus 2

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

Let's talk about LLM evaluation

Train custom AI models with the trainer API and adapt them to 🤗

PaliGemma – Google's Cutting-Edge Open Vision Language Model

Hugging Face x LangChain : A new partner package in LangChain

Large-scale Near-deduplication Behind BigCode

Introducing the Open Arabic LLM Leaderboard

AI Apps in a Flash with Gradio's Reload Mode

License to Call: Introducing Transformers Agents 2.0

makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch

SeeMoE: Implementing a MoE Vision Language Model from Scratch

seemore: Implement a Vision Language Model from Scratch

Improving Prompt Consistency with Structured Generations

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

Fine-tune Llama 3 with ORPO

Design choices for Vision Language Models in 2024

Mergoo: Efficiently Build Your Own MoE LLM

From OpenAI to Open LLMs with Messages API

Mixture of Depth is Vibe

Experiments with Bitnet 1.5 (~ngmi~)

DS-MoE: Making MoE Models More Efficient and Less Memory-Intensive

Outpainting II - Differential Diffusion

Introduction to State Space Models (SSM)

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Total noob’s intro to Hugging Face Transformers