alielfilali01 (Ali El Filali)

upvoted 4 papers about 6 hours ago

MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts

Paper • 2407.21770 • Published Jul 31 • 20

upvoted a paper about 8 hours ago

Kolmogorov-Arnold Transformer

Paper • 2409.10594 • Published 2 days ago • 12

upvoted a paper 1 day ago

Chain of Thought Empowers Transformers to Solve Inherently Serial Problems

Paper • 2402.12875 • Published Feb 20 • 7

upvoted an article 4 days ago

Article

ArabicWeb24: Creating a High Quality Arabic Web-only Pre-training Dataset

By

•

Aug 8

• 9

upvoted a paper 7 days ago

SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation

Paper • 2409.06633 • Published 8 days ago • 14

upvoted 7 papers 8 days ago

Towards a Unified View of Preference Learning for Large Language Models: A Survey

Paper • 2409.02795 • Published 14 days ago • 68

Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning

Paper • 2402.10110 • Published Feb 15 • 3

Spinning the Golden Thread: Benchmarking Long-Form Generation in Language Models

Paper • 2409.02076 • Published 15 days ago • 9

Open-MAGVIT2: An Open-Source Project Toward Democratizing Auto-regressive Visual Generation

Paper • 2409.04410 • Published 12 days ago • 23

Configurable Foundation Models: Building LLMs from a Modular Perspective

Paper • 2409.02877 • Published 14 days ago • 26

LinFusion: 1 GPU, 1 Minute, 16K Image

Paper • 2409.02097 • Published 15 days ago • 31

Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators

Paper • 2403.16950 • Published Mar 25 • 4

upvoted an article 10 days ago

Article

How to train a new language model from scratch using Transformers and Tokenizers

Feb 14, 2020

• 16

upvoted a paper 12 days ago

Nexus: Specialization meets Adaptability for Efficiently Training Mixture of Experts

Paper • 2408.15901 • Published 21 days ago • 1

upvoted a collection 12 days ago

LLaVA-Onevision

Collection

LLaVa_Onevision models for single-image, multi-image, and video scenarios • 7 items • Updated 29 days ago • 7

upvoted 2 papers 13 days ago

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published Apr 29 • 68

Human Feedback is not Gold Standard

Paper • 2309.16349 • Published Sep 28, 2023 • 5

upvoted 2 collections 13 days ago

Jais Family

Collection

The Jais Family of Models • 22 items • Updated 13 days ago • 10

Qwen2-VL

Collection

Vision-language model series based on Qwen2 • 15 items • Updated about 3 hours ago • 106

upvoted a paper 13 days ago

MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark

Paper • 2409.02813 • Published 14 days ago • 27

upvoted a paper 14 days ago

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published 15 days ago • 74

upvoted a collection 14 days ago

OLMoE

Collection

Artifacts for open mixture-of-experts language models. • 13 items • Updated 4 days ago • 18

upvoted a paper 14 days ago

Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming

Paper • 2408.16725 • Published 20 days ago • 49

upvoted 2 collections 15 days ago

Multimodal AI

Collection

Large multimodal models • 10 items • Updated Jul 15 • 1

Visual Understanding

Collection

Accurate & efficient vision models, ops and systems • 15 items • Updated Jul 15 • 1

upvoted a collection 17 days ago

"Physics of Language Models" series

Collection

6 items • Updated 19 days ago • 28

upvoted 2 papers 17 days ago

LoRA: Low-Rank Adaptation of Large Language Models

Paper • 2106.09685 • Published Jun 17, 2021 • 29

Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Models

Paper • 2408.02442 • Published Aug 5 • 17

upvoted a collection 17 days ago

Probably function calling datasets

Collection

Created using the https://huggingface.co/spaces/librarian-bots/dataset-column-search-api Space. • 39 items • Updated Jul 17 • 35

upvoted a paper 21 days ago

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

Paper • 2408.15237 • Published 22 days ago • 36

upvoted an article 22 days ago

Article

Introducing IDEFICS: An Open Reproduction of State-of-the-art Visual Language Model

Aug 22, 2023

• 24

upvoted a paper 22 days ago

Building and better understanding vision-language models: insights and future directions

Paper • 2408.12637 • Published 27 days ago • 109

upvoted an article 22 days ago

Article

Deep Learning over the Internet: Training Language Models Collaboratively

Jul 15, 2021

• 4

upvoted an article 27 days ago

Article

The 5 Most Under-Rated Tools on Hugging Face

28 days ago

• 72

upvoted a paper about 1 month ago

Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers

Paper • 2408.06195 • Published Aug 12 • 54

upvoted an article about 1 month ago

Article

Welcome FalconMamba: The first strong attention-free 7B model

Aug 12

• 95

upvoted a paper about 1 month ago

Better Alignment with Instruction Back-and-Forth Translation

Paper • 2408.04614 • Published Aug 8 • 14

upvoted 3 collections about 1 month ago

🦅🦅 Falcon2

Collection

4 items • Updated about 8 hours ago • 2

🦅 🐍 FalconMamba 7B

Collection

This collection features the FalconMamba 7B base model, the instruction-tuned version, their 4-bit and GGUF variants, and the demo. • 13 items • Updated about 8 hours ago • 25

🐍 ViSpeR

Collection

2 items • Updated about 8 hours ago • 2

upvoted 2 papers about 2 months ago

Qwen2 Technical Report

Paper • 2407.10671 • Published Jul 15 • 153

RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs

Paper • 2407.02552 • Published Jul 2 • 4

upvoted 2 articles about 2 months ago

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16

• 241

Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Jul 23

• 192

upvoted a collection about 2 months ago

Llama 3.1

Collection

This collection hosts the transformers and original repos of the Meta Llama 3.1, Llama Guard 3 and Prompt Guard models • 11 items • Updated Aug 2 • 567

upvoted an article about 2 months ago

Article

TGI Multi-LoRA: Deploy Once, Serve 30 Models

Jul 18

• 42

upvoted a paper 2 months ago

Qwen2-Audio Technical Report

Paper • 2407.10759 • Published Jul 15 • 52

upvoted 2 articles 2 months ago

Article

Welcome Gemma - Google's new open LLM

Feb 21

• 16

Article

RAG chatbot using llama3

By

•

Jul 7

• 66

upvoted a collection 2 months ago

Arabic Matryoshka Embedding Models

Collection

A collection of advanced Arabic Matryoshka Embedding Models designed for efficient and high-performance Arabic NLP, available publicly on Hugging Face • 9 items • Updated Aug 2 • 8

upvoted 2 articles 3 months ago

Article

Formatting Datasets for Chat Template Compatibility

By

•

Jun 28

• 7

Article

Tokenization Is A Dead Weight

By

•

Jun 27

• 16

upvoted a collection 3 months ago

Gemma 2 Release

Collection

15 items • Updated 9 days ago • 166

upvoted 2 papers 3 months ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25 • 82

Tokenization Falling Short: The Curse of Tokenization

Paper • 2406.11687 • Published Jun 17 • 14

upvoted an article 3 months ago

Article

How to Fine-Tune Custom Embedding Models Using AutoTrain

By

•

May 30

• 10

upvoted a paper 3 months ago

Transformers meet Neural Algorithmic Reasoners

Paper • 2406.09308 • Published Jun 13 • 43

Ali El Filali

AI & ML interests

Organizations

alielfilali01's activity

ArabicWeb24: Creating a High Quality Arabic Web-only Pre-training Dataset

How to train a new language model from scratch using Transformers and Tokenizers

Introducing IDEFICS: An Open Reproduction of State-of-the-art Visual Language Model

Deep Learning over the Internet: Training Language Models Collaboratively

The 5 Most Under-Rated Tools on Hugging Face

Welcome FalconMamba: The first strong attention-free 7B model

SmolLM - blazingly fast and remarkably powerful

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

TGI Multi-LoRA: Deploy Once, Serve 30 Models

Welcome Gemma - Google's new open LLM

RAG chatbot using llama3

Formatting Datasets for Chat Template Compatibility

Tokenization Is A Dead Weight

How to Fine-Tune Custom Embedding Models Using AutoTrain