rbiswasfc (Raja Biswas)

upvoted a paper 1 day ago

Qwen2 Technical Report

Paper • 2407.10671 • Published 7 days ago • 142

upvoted a collection 3 days ago

xLAM models

Collection

6 items • Updated 4 days ago • 19

upvoted a collection 6 days ago

H2O Danube3

Collection

6 items • Updated 6 days ago • 47

upvoted a paper 19 days ago

Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems

Paper • 2407.01370 • Published 21 days ago • 81

upvoted a paper about 1 month ago

Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling

Paper • 2406.07522 • Published Jun 11 • 35

upvoted a paper about 2 months ago

From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting

Paper • 2309.04269 • Published Sep 8, 2023 • 29

upvoted 3 articles about 2 months ago

Article

Training and Finetuning Embedding Models with Sentence Transformers v3

May 28

• 124

Article

⚗️ 🔥 Building High-Quality Datasets with distilabel and Prometheus 2

By

•

Jun 3

• 21

Article

Benchmarking Text Generation Inference

May 29

• 25

upvoted 2 papers 2 months ago

LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15 • 81

SUTRA: Scalable Multilingual Language Model Architecture

Paper • 2405.06694 • Published May 7 • 36

upvoted 2 articles 3 months ago

Article

Fine-tuning Llama 2 70B using PyTorch FSDP

Sep 13, 2023

• 7

Article

🧑‍⚖️ "Replacing Judges with Juries" using distilabel

By

•

May 3

• 17

upvoted 9 papers 3 months ago

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published Apr 29 • 67

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Paper • 2405.00732 • Published Apr 29 • 116

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Paper • 2405.01535 • Published May 2 • 109

OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework

Paper • 2404.14619 • Published Apr 22 • 124

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Paper • 2404.07143 • Published Apr 10 • 98

Rho-1: Not All Tokens Are What You Need

Paper • 2404.07965 • Published Apr 11 • 80

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 243

CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data

Paper • 2404.15653 • Published Apr 24 • 25

Pre-training Small Base LMs with Fewer Tokens

Paper • 2404.08634 • Published Apr 12 • 33

upvoted an article 3 months ago

Article

CodeGemma - an official Google release for code LLMs

Apr 9

• 98

upvoted 10 papers 4 months ago

DataDreamer: A Tool for Synthetic Data Generation and Reproducible LLM Workflows

Paper • 2402.10379 • Published Feb 16 • 28

Benchmarking Large Language Models on Controllable Generation under Diversified Instructions

Paper • 2401.00690 • Published Jan 1 • 1

upvoted 2 collections 4 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 78

Gemma release

Collection

Groups the Gemma models released by the Google team. • 40 items • Updated 25 days ago • 320

upvoted 8 papers 4 months ago

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 46

MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

Paper • 2402.14905 • Published Feb 22 • 103

Divide-or-Conquer? Which Part Should You Distill Your LLM?

Paper • 2402.15000 • Published Feb 22 • 22

Orca-Math: Unlocking the potential of SLMs in Grade School Math

Paper • 2402.14830 • Published Feb 16 • 24

Do Large Language Models Latently Perform Multi-Hop Reasoning?

Paper • 2402.16837 • Published Feb 26 • 24

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 581

Design2Code: How Far Are We From Automating Front-End Engineering?

Paper • 2403.03163 • Published Mar 5 • 92

Yi: Open Foundation Models by 01.AI

Paper • 2403.04652 • Published Mar 7 • 59

upvoted 4 papers 6 months ago

H2O-Danube-1.8B Technical Report

Paper • 2401.16818 • Published Jan 30 • 16

Weaver: Foundation Models for Creative Writing

Paper • 2401.17268 • Published Jan 30 • 39

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Paper • 2402.00159 • Published Jan 31 • 56

OLMo: Accelerating the Science of Language Models

Paper • 2402.00838 • Published Feb 1 • 75

upvoted a paper 7 months ago

LLM Augmented LLMs: Expanding Capabilities through Composition

Paper • 2401.02412 • Published Jan 4 • 36

upvoted a collection 7 months ago

Zephyr 7B

Collection

Models, datasets, and demos associated with Zephyr 7B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 9 items • Updated Apr 12 • 142

upvoted a paper 7 months ago

Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch

Paper • 2311.03099 • Published Nov 6, 2023 • 28

upvoted a collection 7 months ago

Awesome feedback datasets

Collection

A curated list of datasets with human or AI feedback. Useful for training reward models or applying techniques like DPO. • 19 items • Updated Apr 12 • 60

upvoted a paper 7 months ago

Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models

Paper • 2312.06585 • Published Dec 11, 2023 • 27

upvoted a collection 8 months ago

Detect AI Generated Text

Collection

A collection of papers about detecting text generated by AI • 7 items • Updated Jan 23 • 4

upvoted 7 papers 8 months ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 134

ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs

Paper • 2307.16789 • Published Jul 31, 2023 • 96

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 120

Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection

Paper • 2310.11511 • Published Oct 17, 2023 • 68

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 176

Instruction-Following Evaluation for Large Language Models

Paper • 2311.07911 • Published Nov 14, 2023 • 18

A Survey on Language Models for Code

Paper • 2311.07989 • Published Nov 14, 2023 • 21

Raja Biswas

AI & ML interests

Organizations

rbiswasfc's activity

Training and Finetuning Embedding Models with Sentence Transformers v3

⚗️ 🔥 Building High-Quality Datasets with distilabel and Prometheus 2

Benchmarking Text Generation Inference

Fine-tuning Llama 2 70B using PyTorch FSDP

🧑‍⚖️ "Replacing Judges with Juries" using distilabel

CodeGemma - an official Google release for code LLMs