mrm8488 (Manuel Romero)

upvoted an article 2 days ago

Article

Uncensor any LLM with abliteration

By

•

2 days ago

• 98

upvoted a collection 8 days ago

sentence-transformers-from-synthetic-data

Collection

Example of using distilabel to generate synthetic triplets data for fine-tuning a Sentence Transformer model • 3 items • Updated 7 days ago • 17

upvoted an article 15 days ago

Article

Synthetic dataset generation techniques: generating custom sentence similarity data

By

•

15 days ago

• 11

upvoted an article 19 days ago

Article

Train custom AI models with the trainer API and adapt them to 🤗

By

•

5 days ago

• 24

upvoted an article 23 days ago

Article

PaliGemma – Google's Cutting-Edge Open Vision Language Model

24 days ago

• 137

upvoted an article 30 days ago

Article

How to Finetune phi-3 on MacBook Pro

By

•

Apr 24

• 58

upvoted a paper about 1 month ago

WildChat: 1M ChatGPT Interaction Logs in the Wild

Paper • 2405.01470 • Published May 2 • 57

upvoted an article about 1 month ago

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 21

upvoted 2 collections about 1 month ago

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 29 items • Updated 7 days ago • 183

Performance LLMs - Base Models

Collection

22 items • Updated Apr 26 • 6

upvoted an article about 1 month ago

Article

seemore: Implement a Vision Language Model from Scratch

By

•

25 days ago

• 44

upvoted a paper about 2 months ago

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published Apr 4 • 17

upvoted an article about 2 months ago

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 246

upvoted a collection about 2 months ago

fuck quadratic attention

Collection

11 items • Updated Apr 24 • 19

upvoted a paper about 2 months ago

TransformerFAM: Feedback attention is working memory

Paper • 2404.09173 • Published Apr 14 • 42

upvoted an article about 2 months ago

Article

Vision Language Models Explained

Apr 11

• 97

upvoted a paper about 2 months ago

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Paper • 2404.03715 • Published Apr 4 • 58

upvoted a paper 2 months ago

Aurora-M: The First Open Source Multilingual Language Model Red-teamed according to the U.S. Executive Order

Paper • 2404.00399 • Published Mar 30 • 39

upvoted 5 collections 3 months ago

upvoted a paper 3 months ago

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21 • 106

upvoted a collection 3 months ago

OpenCodeInterpreter

Collection

18 items • Updated Mar 3 • 74

upvoted 2 papers 3 months ago

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 45

User-LLM: Efficient LLM Contextualization with User Embeddings

Paper • 2402.13598 • Published Feb 21 • 18

upvoted a paper 4 months ago

Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains

Paper • 2402.05140 • Published Feb 6 • 18

upvoted a collection 4 months ago

LLMS - Knowledge / Domain Adaptions

Collection

2 items • Updated Feb 21 • 1

upvoted a paper 4 months ago

Instruction-tuned Language Models are Better Knowledge Learners

Paper • 2402.12847 • Published Feb 20 • 24

upvoted 3 collections 4 months ago

🌌 Cosmopedia

Collection

Resources for Cosmopedia dataset • 5 items • Updated Feb 20 • 8

OLMo Suite

Collection

Artifacts for the first set of OLMo models. • 14 items • Updated 2 days ago • 36

Benchmarks

Collection

15 items • Updated Feb 19 • 2

upvoted 2 papers 4 months ago

In Search of Needles in a 10M Haystack: Recurrent Memory Finds What LLMs Miss

Paper • 2402.10790 • Published Feb 16 • 39

AutoMathText: Autonomous Data Selection with Language Models for Mathematical Texts

Paper • 2402.07625 • Published Feb 12 • 10

upvoted a collection 4 months ago

datasets-SPIN

Collection

Generated synthetic data used to finetune SPIN. • 8 items • Updated Feb 9 • 10

upvoted 4 papers 4 months ago

StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

Paper • 2402.01391 • Published Feb 2 • 41

Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception

Paper • 2401.16158 • Published Jan 29 • 16

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 135

The Rise and Potential of Large Language Model Based Agents: A Survey

Paper • 2309.07864 • Published Sep 14, 2023 • 5

upvoted a collection 4 months ago

Canonical models

Collection

This collection lists all the historical (pre-"Hub") canonical model checkpoints, i.e. repos that were not under an org or user namespace • 68 items • Updated Feb 13 • 13

upvoted a paper 5 months ago

Improving Text Embeddings with Large Language Models

Paper • 2401.00368 • Published Dec 31, 2023 • 74

upvoted 3 collections 5 months ago

MoEs papers reading list

Collection

43 items • Updated 8 days ago • 124

haiku

Collection

🌸 This is a collection of synthetic datasets built to help improve the ability of open language models to better write haikus through the use of DPO • 3 items • Updated 9 days ago • 4

Comparing DPO with IPO and KTO

Collection

A collection of chat models to explore the differences between three alignment techniques: DPO, IPO, and KTO. • 56 items • Updated Jan 9 • 31

upvoted 2 papers 5 months ago

Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization

Paper • 2308.14469 • Published Aug 28, 2023 • 6

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

Paper • 2312.16862 • Published Dec 28, 2023 • 28

upvoted 2 collections 6 months ago

🐍 Mamba fine-tuned models

Collection

A collection with ClibrAIn's Mamba fine-tuned models • 3 items • Updated Dec 18, 2023 • 11

Awesome SFT datasets

Collection

A curated list of interesting datasets to fine-tune language models with. • 43 items • Updated Apr 12 • 94

upvoted 3 papers 6 months ago

UniIR: Training and Benchmarking Universal Multimodal Information Retrievers

Paper • 2311.17136 • Published Nov 28, 2023 • 7

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 174

Exponentially Faster Language Modelling

Paper • 2311.10770 • Published Nov 15, 2023 • 117

upvoted 2 papers 7 months ago

Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model

Paper • 2311.13231 • Published Nov 22, 2023 • 25

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

upvoted a collection 7 months ago

Zephyr 7B

Collection

Models, datasets, and demos associated with Zephyr 7B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 9 items • Updated Apr 12 • 139

upvoted 4 papers 8 months ago

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

Paper • 2310.08659 • Published Oct 12, 2023 • 20

Fast-ELECTRA for Efficient Pre-training

Paper • 2310.07347 • Published Oct 11, 2023 • 2

CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing

Paper • 2305.11738 • Published May 19, 2023 • 3

Offline Prompt Evaluation and Optimization with Inverse Reinforcement Learning

Paper • 2309.06553 • Published Sep 13, 2023 • 4

upvoted a paper 9 months ago

CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages

Paper • 2309.09400 • Published Sep 17, 2023 • 77

Manuel Romero PRO

AI & ML interests

Organizations

mrm8488's activity

Uncensor any LLM with abliteration

Synthetic dataset generation techniques: generating custom sentence similarity data

Train custom AI models with the trainer API and adapt them to 🤗

PaliGemma – Google's Cutting-Edge Open Vision Language Model

How to Finetune phi-3 on MacBook Pro

GaLore: Advancing Large Model Training on Consumer-grade Hardware

seemore: Implement a Vision Language Model from Scratch

Welcome Llama 3 - Meta's new open LLM

Vision Language Models Explained