Derrick Mwiti's picture

Derrick Mwiti

mwitiderrick

·

AI & ML interests

None yet

Articles

Sparse LLM Inference on CPU

Organizations

mwitiderrick's activity

upvoted 2 articles 1 day ago

Article

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Mar 9, 2023

• 21

Article

Putting RL back in RLHF

28 days ago

• 53

upvoted 2 articles 7 days ago

Article

Welcome Gemma 2 - Google's new open LLM

13 days ago

• 88

Article

Proximal Policy Optimization (PPO)

Aug 5, 2022

• 6

upvoted a collection 24 days ago

FP8 LLMs for vLLM

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 16 items • Updated 1 day ago • 18

upvoted 2 articles 26 days ago

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 146

Article

A Dive into Pretraining Strategies for Vision-Language Models

Feb 3, 2023

• 30

upvoted an article 27 days ago

Article

Vision Language Models Explained

Apr 11

• 121

upvoted 2 collections 3 months ago

OpenELM Instruct Models

4 items • Updated 21 days ago • 107

📀 Dataset comparison models

1.8B models trained on 350BT to compare different pretraining datasets • 8 items • Updated 27 days ago • 26

upvoted a paper 3 months ago

A Picture is Worth a Thousand Words: Principled Recaptioning Improves Image Generation

Paper • 2310.16656 • Published Oct 25, 2023 • 39

upvoted 2 collections 4 months ago

Compressed LLMs for nm-vllm

LLMs compressed using SparseGPT and GPTQ for optimized inference with nm-vllm https://github.com/neuralmagic/nm-vllm • 18 items • Updated 29 days ago • 9

Sparse Foundational Llama 2 Models

Sparse pre-trained and fine-tuned Llama models made by Neural Magic + Cerebras • 27 items • Updated 25 days ago • 7

upvoted a collection 6 months ago

DeepSparse Sparse LLMs

Useful LLMs for DeepSparse where we've pruned at least 50% of the weights! • 10 items • Updated 28 days ago • 4

upvoted a collection 9 months ago

LLM Leaderboard best models ❤️‍🔥

A daily uploaded list of models with best evaluations on the LLM leaderboard: • 264 items • Updated 17 days ago • 347

upvoted 2 papers 9 months ago

VeRA: Vector-based Random Matrix Adaptation

Paper • 2310.11454 • Published Oct 17, 2023 • 27

Sparse Finetuning for Inference Acceleration of Large Language Models

Paper • 2310.06927 • Published Oct 10, 2023 • 14

upvoted a collection 9 months ago

Sparse Finetuning MPT

Explore our breakthrough in sparse fine-tuning LLMs! Our novel method maintains downstream accuracy even with >70% sparsity. • 13 items • Updated 29 days ago • 3

upvoted a paper 9 months ago

QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models

Paper • 2309.14717 • Published Sep 26, 2023 • 43