sroecker (Steffen Röcker)

upvoted a collection about 16 hours ago

BM25S Indices

Collection

https://github.com/xhluca/bm25s • 14 items • Updated about 14 hours ago • 4

upvoted a collection 2 days ago

DeepSeekCoder-V2

Collection

4 items • Updated 5 days ago • 31

upvoted a collection 4 days ago

Small LLMs

Collection

Collection of Fine Tuned Small LLMs • 13 items • Updated 25 days ago • 2

upvoted a collection 5 days ago

FP8 LLMs for vLLM

Collection

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 10 items • Updated about 10 hours ago • 14

upvoted a paper 5 days ago

Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing

Paper • 2406.08464 • Published 7 days ago • 42

upvoted an article 6 days ago

Article

Putting RL back in RLHF

7 days ago

• 36

upvoted a collection 7 days ago

codestral-text2cypher

Collection

codestral finetuned for text2cypher • 3 items • Updated 9 days ago • 2

upvoted a collection 12 days ago

Local Function Calling Gems

Collection

These are the best function calling LLMs one can run on less than 64GB VRAM/Unified Memory. I use these on a M1 Max Macbook 64GB. • 5 items • Updated 13 days ago • 3

upvoted a collection 13 days ago

Qwen2

Collection

Qwen2 language models, including pretrained and instruction-tuned models of 5 sizes, including 0.5B, 1.5B, 7B, 57B-A14B, and 72B. • 29 items • Updated 13 days ago • 190

upvoted a collection 14 days ago

GLM-4

Collection

GLM-4 Open Models • 4 items • Updated 14 days ago • 76

upvoted a collection 15 days ago

DeTikZify

Collection

Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ • 9 items • Updated 16 days ago • 2

upvoted an article 15 days ago

Article

Uncensor any LLM with abliteration

By

•

6 days ago

• 218

upvoted an article 16 days ago

Article

Releasing Common Corpus: the largest public domain dataset for training LLMs

By

•

Mar 20

• 11

upvoted an article 19 days ago

Article

How to directly access 150k+ Hugging Face Datasets with DuckDB and query using GPT-4o

By

•

19 days ago

• 10

upvoted an article 20 days ago

Article

⚗️ 🔥 Building High-Quality Datasets with distilabel and Prometheus 2

By

•

16 days ago

• 20

upvoted a collection 21 days ago

sentence-transformers-from-synthetic-data

Collection

Example of using distilabel to generate synthetic triplets data for fine-tuning a Sentence Transformer model • 4 items • Updated 8 days ago • 18

upvoted an article 22 days ago

Article

Training and Finetuning Embedding Models with Sentence Transformers v3

22 days ago

• 98

upvoted a paper 22 days ago

Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Paper • 2405.04324 • Published May 7 • 14

upvoted a collection 23 days ago

🤖Phi-3

Collection

6 items • Updated 16 days ago • 1

upvoted an article 25 days ago

Article

GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing

By

•

25 days ago

• 9

upvoted 2 collections 25 days ago

DiscoLeo 8B: Llama3 for German

Collection

Continued Pretraining on Llama3 8B to improve German linguistic capabilities. A collection of base and fine-tuned models and variants. • 5 items • Updated 25 days ago • 13

DiscoLeo 8B quants

Collection

A collection of different quantizations of the DiscoLeo models. • 3 items • Updated 25 days ago • 3

upvoted a collection 27 days ago

C4AI Aya 23

Collection

Aya 23 is an open weights research release of an instruction fine-tuned model with highly advanced multilingual capabilities. • 3 items • Updated 27 days ago • 34

upvoted an article 27 days ago

Article

⚗️ 🧑🏼‍🌾 Let's grow some Domain Specific Datasets together

By

•

Apr 29

• 27

upvoted a collection 27 days ago

C4AI Command R Plus

Collection

C4AI Command R+ is an open weights research release of a 104B billion parameter model with highly advanced capabilities. • 3 items • Updated 27 days ago • 20

upvoted an article 27 days ago

Article

Let's talk about LLM evaluation

By

•

27 days ago

• 92

upvoted a collection 28 days ago

Phi-3

Collection

Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths. • 22 items • Updated 19 days ago • 340

upvoted 2 collections 29 days ago

CommonCatalog

Collection

Common Catalog, a dataset with Creative Commons licensed images and machine-generated caption pairs • 8 items • Updated May 16 • 11

M2-BERT Embeddings

Collection

Models and Datasets for M2-BERT and LoCoV1 • 10 items • Updated 28 days ago • 2

upvoted a collection about 1 month ago

Yi-1.5 (2024/05)

Collection

10 items • Updated about 1 month ago • 81

upvoted a paper about 1 month ago

What matters when building vision-language models?

Paper • 2405.02246 • Published May 3 • 89

upvoted 2 collections about 1 month ago

Granite Code Models

Collection

A series of code models trained by IBM licensed under Apache 2.0 license. We release both the base pretrained and instruct models. • 18 items • Updated 19 days ago • 144

SPPO

Collection

Self-Play Preference Optimization • 4 items • Updated May 4 • 2

upvoted an article about 1 month ago

Article

Saving Memory Using Padding-Free Transformer Layers during Finetuning

By

•

8 days ago

• 6

upvoted 2 articles about 2 months ago

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 142

Article

🧑‍⚖️ "Replacing Judges with Juries" using distilabel

By

•

May 3

• 14

upvoted a collection about 2 months ago

llama 3 self-align experiments

Collection

Replicating the pipeline for StarCoder-2 Instruct on Llama-3-8B with some tweaks https://huggingface.co/blog/sc2-instruct • 4 items • Updated May 9 • 6

upvoted 2 articles about 2 months ago

Article

Improving Prompt Consistency with Structured Generations

Apr 30

• 48

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 69

upvoted a collection about 2 months ago

LLaVA-Phi-3-mini

Collection

4 items • Updated Apr 28 • 11

upvoted 3 articles about 2 months ago

Article

Design choices for Vision Language Models in 2024

By

•

Apr 16

• 20

Article

Post-OCR-Correction: 1 billion words dataset of automated OCR correction by LLM

By

•

Apr 26

• 11

Article

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)

By

•

Apr 24

• 51

upvoted a collection about 2 months ago

〽️MistralAI

Collection

A collection of MistralAI models that you can trust in production! • 10 items • Updated 16 days ago • 7

upvoted a collection 5 months ago

Zeroshot Classifiers

Collection

These are my current best zeroshot classifiers. Some of my older models are downloaded more often, but the models in this collection are newer/better. • 11 items • Updated Apr 3 • 81

upvoted a collection 6 months ago

LLM Speculative Decoding

Collection

Tiny language models meant to serve as draft models for speculative decoding. • 6 items • Updated Jan 6 • 2

upvoted a collection 9 months ago

Recent models: last 100 repos, sorted by creation date

Collection

The last 100 repos I have created. Sorted by creation date descending, so the most recently created repos appear at the top. • 121 items • Updated Jan 31 • 455

Steffen Röcker

AI & ML interests

Organizations

sroecker's activity

Putting RL back in RLHF

Uncensor any LLM with abliteration

Releasing Common Corpus: the largest public domain dataset for training LLMs

How to directly access 150k+ Hugging Face Datasets with DuckDB and query using GPT-4o

⚗️ 🔥 Building High-Quality Datasets with distilabel and Prometheus 2

Training and Finetuning Embedding Models with Sentence Transformers v3

GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing

⚗️ 🧑🏼‍🌾 Let's grow some Domain Specific Datasets together

Let's talk about LLM evaluation

Saving Memory Using Padding-Free Transformer Layers during Finetuning

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

🧑‍⚖️ "Replacing Judges with Juries" using distilabel

Improving Prompt Consistency with Structured Generations

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Design choices for Vision Language Models in 2024

Post-OCR-Correction: 1 billion words dataset of automated OCR correction by LLM

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)