Piotr's picture

Piotr

piotr-ai

·

AI & ML interests

None yet

Organizations

None yet

piotr-ai's activity

upvoted a collection 2 days ago

🍃 MINT-1T

Data for "MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens" • 13 items • Updated 2 days ago • 25

upvoted a collection 3 days ago

Llama 3.1

This collection hosts the transformers and original repos of the Meta Llama 3.1, Llama Guard 3 and Prompt Guard models • 11 items • Updated 1 day ago • 384

upvoted an article 10 days ago

Article

SmolLM - blazingly fast and remarkably powerful

11 days ago

• 172

upvoted a paper 10 days ago

Scaling Diffusion Transformers to 16 Billion Parameters

Paper • 2407.11633 • Published 11 days ago • 22

upvoted 2 papers 11 days ago

Qwen2 Technical Report

Paper • 2407.10671 • Published 12 days ago • 147

H2O-Danube3 Technical Report

Paper • 2407.09276 • Published 14 days ago • 18

upvoted a paper 25 days ago

Scaling Synthetic Data Creation with 1,000,000,000 Personas

Paper • 2406.20094 • Published 28 days ago • 84

upvoted a collection 29 days ago

Gemma 2 Release

10 items • Updated 1 day ago • 132

upvoted a paper about 1 month ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25 • 75

upvoted a paper 2 months ago

ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models

Paper • 2405.15738 • Published May 24 • 43

upvoted 2 collections 2 months ago

Aya Datasets

The Aya Collection is a massive multilingual collection for over 100 languages consisting of 513 million instances of prompts and completions. • 5 items • Updated 29 days ago • 9

C4AI Aya 23

Aya 23 is an open weights research release of an instruction fine-tuned model with highly advanced multilingual capabilities. • 3 items • Updated May 23 • 40

upvoted a paper 2 months ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 243

upvoted a collection 2 months ago

Phi-3

Phi-3 family of small language and multi-modal models. Language models are available in short- and long-context lengths. • 23 items • Updated 15 days ago • 378

upvoted a paper 2 months ago

Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Model

Paper • 2405.09215 • Published May 15 • 15

upvoted 5 papers 3 months ago

Better & Faster Large Language Models via Multi-token Prediction

Paper • 2404.19737 • Published Apr 30 • 72

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length

Paper • 2404.08801 • Published Apr 12 • 62

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Paper • 2403.03507 • Published Mar 6 • 180

SpaceByte: Towards Deleting Tokenization from Large Language Modeling

Paper • 2404.14408 • Published Apr 22 • 6

Pre-training Small Base LMs with Fewer Tokens

Paper • 2404.08634 • Published Apr 12 • 33

upvoted a paper 4 months ago

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Paper • 2404.07143 • Published Apr 10 • 98

upvoted a paper 5 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 582

upvoted 2 papers 6 months ago

Grandmaster-Level Chess Without Search

Paper • 2402.04494 • Published Feb 7 • 65

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 138

upvoted a paper 7 months ago

Masked Audio Generation using a Single Non-Autoregressive Transformer

Paper • 2401.04577 • Published Jan 9 • 39

upvoted 2 papers 9 months ago

Ziya2: Data-centric Learning is All LLMs Need

Paper • 2311.03301 • Published Nov 6, 2023 • 16

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 120

upvoted 6 papers 10 months ago

AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model

Paper • 2309.16058 • Published Sep 27, 2023 • 53

Jointly Training Large Autoregressive Multimodal Models

Paper • 2309.15564 • Published Sep 27, 2023 • 8

QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models

Paper • 2309.14717 • Published Sep 26, 2023 • 43

RMT: Retentive Networks Meet Vision Transformers

Paper • 2309.11523 • Published Sep 20, 2023 • 32

LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models

Paper • 2309.12307 • Published Sep 21, 2023 • 84

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset

Paper • 2309.11998 • Published Sep 21, 2023 • 23