abdullah (Abdullah Abdelrhim)

upvoted 2 papers about 2 hours ago

Iterative Reasoning Preference Optimization

Paper • 2404.19733 • Published about 20 hours ago • 16

Better & Faster Large Language Models via Multi-token Prediction

Paper • 2404.19737 • Published about 20 hours ago • 20

upvoted an article 2 days ago

Article

⚗️ 🧑🏼‍🌾 Let's grow some Domain Specific Datasets together

By

•

2 days ago

• 22

upvoted a paper 2 days ago

AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs

Paper • 2404.16873 • Published 10 days ago • 20

upvoted a collection 5 days ago

Text-to-text Generation Models (LLMs, Llama, GPT, ...)

Collection

699 items • Updated 1 day ago • 7

upvoted an article 5 days ago

Article

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

By

•

5 days ago

• 45

upvoted a paper 8 days ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published 9 days ago • 222

upvoted a paper 9 days ago

Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing

Paper • 2404.12253 • Published 13 days ago • 46

upvoted an article 11 days ago

Article

Fine-tune Llama 3 with ORPO

By

•

9 days ago

• 147

upvoted a collection 23 days ago

Multilingual Models Chat Spaces

Collection

Here you find Chat spaces to interact and test multilingual models but the goal here is to test on Arabic • 2 items • Updated 25 days ago • 1

upvoted 2 papers 23 days ago

Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model

Paper • 2404.04167 • Published 26 days ago • 8

CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues

Paper • 2404.03820 • Published 27 days ago • 20

upvoted a paper 27 days ago

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published 29 days ago • 98

upvoted 2 papers 28 days ago

Leveraging Corpus Metadata to Detect Template-based Translation: An Exploratory Case Study of the Egyptian Arabic Wikipedia Edition

Paper • 2404.00565 • Published Mar 31 • 5

Octopus v2: On-device language model for super agent

Paper • 2404.01744 • Published 29 days ago • 50

upvoted a collection 30 days ago

A little guide to building Large Language Models in 2024

Collection

Resources mentioned by @thomwolf in https://x.com/Thom_Wolf/status/1773340316835131757 • 19 items • Updated 30 days ago • 13

upvoted 2 papers about 1 month ago

Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs

Paper • 2403.20041 • Published Mar 29 • 33

InternLM2 Technical Report

Paper • 2403.17297 • Published Mar 26 • 25

upvoted 2 collections about 1 month ago

🔮 Mixture of Experts

Collection

MoE done using mergekit and LazyMergekit: https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb#scrollTo=d5mYzDo1q96y • 13 items • Updated Mar 22 • 21

Preference Datasets for KTO

Collection

This collection contains a list of curated preference datasets for KTO fine-tuning for intent alignment of LLMs through signals. • 5 items • Updated Mar 19 • 10

upvoted a paper about 1 month ago

QLoRA: Efficient Finetuning of Quantized LLMs

Paper • 2305.14314 • Published May 23, 2023 • 38

upvoted 3 papers about 2 months ago

Algorithmic progress in language models

Paper • 2403.05812 • Published Mar 9 • 16

ORPO: Monolithic Preference Optimization without Reference Model

Paper • 2403.07691 • Published Mar 12 • 52

Adding NVMe SSDs to Enable and Accelerate 100B Model Fine-tuning on a Single GPU

Paper • 2403.06504 • Published Mar 11 • 52

upvoted a collection about 2 months ago

Awesome Document AI

Collection

A collection of open-source document AI 📄 📝 📈 • 27 items • Updated Mar 11 • 33

upvoted 5 papers about 2 months ago

upvoted 7 papers 2 months ago

PALO: A Polyglot Large Multimodal Model for 5B People

Paper • 2402.14818 • Published Feb 22 • 22

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21 • 104

FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models

Paper • 2402.10986 • Published Feb 16 • 73

Reformatted Alignment

Paper • 2402.12219 • Published Feb 19 • 15

GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local Refinements

Paper • 2402.10963 • Published Feb 13 • 9

Speculative Streaming: Fast LLM Inference without Auxiliary Models

Paper • 2402.11131 • Published Feb 16 • 41

Chain-of-Thought Reasoning Without Prompting

Paper • 2402.10200 • Published Feb 15 • 89

upvoted a collection 2 months ago

Qwen1.5

Collection

Qwen1.5 is the improved version of Qwen, the large language model series developed by Alibaba Cloud. • 55 items • Updated 2 days ago • 158

upvoted a paper 2 months ago

OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset

Paper • 2402.10176 • Published Feb 15 • 32

upvoted a collection 3 months ago

Arabic-LLMs

Collection

19 items • Updated Feb 23 • 1

upvoted 9 papers 3 months ago

TravelPlanner: A Benchmark for Real-World Planning with Language Agents

Paper • 2402.01622 • Published Feb 2 • 30

Efficient Exploration for LLMs

Paper • 2402.00396 • Published Feb 1 • 18

Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens

Paper • 2401.17377 • Published Jan 30 • 31

Weaver: Foundation Models for Creative Writing

Paper • 2401.17268 • Published Jan 30 • 39

Efficient Tool Use with Chain-of-Abstraction Reasoning

Paper • 2401.17464 • Published Jan 30 • 15

Soaring from 4K to 400K: Extending LLM's Context with Activation Beacon

Paper • 2401.03462 • Published Jan 7 • 25

Self-Alignment with Instruction Backtranslation

Paper • 2308.06259 • Published Aug 11, 2023 • 37

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Paper • 2401.16380 • Published Jan 29 • 45

SliceGPT: Compress Large Language Models by Deleting Rows and Columns

Paper • 2401.15024 • Published Jan 26 • 62

upvoted a collection 3 months ago

Tiny Series

Collection

Tiny datasets that empower the foundation of Small Language Model! • 11 items • Updated Jan 26 • 31

upvoted 4 papers 3 months ago

Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads

Paper • 2401.10774 • Published Jan 19 • 49

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 134

ChatQA: Building GPT-4 Level Conversational QA Models

Paper • 2401.10225 • Published Jan 18 • 27

Asynchronous Local-SGD Training for Language Modeling

Paper • 2401.09135 • Published Jan 17 • 9

upvoted a collection 4 months ago

Hermes

Collection

Nous' Flagship LLM Series • 19 items • Updated Mar 15 • 76

upvoted 5 papers 4 months ago

Towards Conversational Diagnostic AI

Paper • 2401.05654 • Published Jan 11 • 13

Secrets of RLHF in Large Language Models Part II: Reward Modeling

Paper • 2401.06080 • Published Jan 11 • 23

Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding

Paper • 2401.04398 • Published Jan 9 • 18

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models

Paper • 2401.04658 • Published Jan 9 • 23

What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

Paper • 2312.15685 • Published Dec 25, 2023 • 16

Abdullah Abdelrhim

AI & ML interests

Organizations

abdullah's activity

⚗️ 🧑🏼‍🌾 Let's grow some Domain Specific Datasets together

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

Fine-tune Llama 3 with ORPO