smajumdar94 (Somshubra Majumdar)

upvoted an article 2 days ago

Article

Powerful ASR + diarization + speculative decoding with Hugging Face Inference Endpoints

6 days ago

• 36

upvoted a paper 7 days ago

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published 7 days ago • 57

upvoted an article 7 days ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

8 days ago

• 63

upvoted an article 17 days ago

Article

Releasing Youtube-Commons: a massive open corpus for conversational and multimodal data

By

•

18 days ago

• 20

upvoted a paper 24 days ago

Best Practices and Lessons Learned on Synthetic Data for Language Models

Paper • 2404.07503 • Published 25 days ago • 25

upvoted a paper 25 days ago

Rho-1: Not All Tokens Are What You Need

Paper • 2404.07965 • Published 25 days ago • 78

upvoted a paper 27 days ago

CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues

Paper • 2404.03820 • Published Apr 4 • 20

upvoted 2 papers about 1 month ago

CodeEditorBench: Evaluating Code Editing Capability of Large Language Models

Paper • 2404.03543 • Published Apr 4 • 15

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

Paper • 2403.15042 • Published Mar 22 • 23

upvoted a paper about 2 months ago

Algorithmic progress in language models

Paper • 2403.05812 • Published Mar 9 • 16

upvoted a collection about 2 months ago

StarChat2 15B

Collection

Model, datasets, and demo for StarChat2 15B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 10 items • Updated 24 days ago • 11

upvoted a paper about 2 months ago

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

Paper • 2403.04692 • Published Mar 7 • 34

upvoted 4 papers 2 months ago

upvoted a paper 3 months ago

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 45

upvoted a collection 3 months ago

OpenMath

Collection

A collection of models and datasets introduced in "OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset" • 15 items • Updated Feb 19 • 26

upvoted 2 papers 3 months ago

Self-Discover: Large Language Models Self-Compose Reasoning Structures

Paper • 2402.03620 • Published Feb 6 • 102

Multi-line AI-assisted Code Authoring

Paper • 2402.04141 • Published Feb 6 • 8

upvoted a collection 3 months ago

Parakeet

Collection

NeMo Parakeet ASR Models attain strong speech recognition accuracy while being efficient for inference. Available in CTC and RNN-Transducer variants. • 5 items • Updated Feb 19 • 9

upvoted a paper 3 months ago

MambaByte: Token-free Selective State Space Model

Paper • 2401.13660 • Published Jan 24 • 47

upvoted 3 papers 4 months ago

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

Paper • 2401.00448 • Published Dec 31, 2023 • 25

WaveCoder: Widespread And Versatile Enhanced Instruction Tuning with Refined Data Generation

Paper • 2312.14187 • Published Dec 20, 2023 • 48

Analyzing and Improving the Training Dynamics of Diffusion Models

Paper • 2312.02696 • Published Dec 5, 2023 • 31

upvoted a paper 5 months ago

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 252

upvoted 2 papers 6 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

FreeU: Free Lunch in Diffusion U-Net

Paper • 2309.11497 • Published Sep 20, 2023 • 63

upvoted 2 papers 7 months ago

Calibrating LLM-Based Evaluator

Paper • 2309.13308 • Published Sep 23, 2023 • 10

Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model

Paper • 2309.13018 • Published Sep 22, 2023 • 9

upvoted 3 papers 8 months ago

A Large-scale Dataset for Audio-Language Representation Learning

Paper • 2309.11500 • Published Sep 20, 2023 • 9

Large-Scale Automatic Audiobook Creation

Paper • 2309.03926 • Published Sep 7, 2023 • 52

NExT-GPT: Any-to-Any Multimodal LLM

Paper • 2309.05519 • Published Sep 11, 2023 • 74

upvoted 2 papers 10 months ago

Instruction Mining: High-Quality Instruction Data Selection for Large Language Models

Paper • 2307.06290 • Published Jul 12, 2023 • 9

Retentive Network: A Successor to Transformer for Large Language Models

Paper • 2307.08621 • Published Jul 17, 2023 • 166

Somshubra Majumdar

AI & ML interests

Organizations

smajumdar94's activity

Powerful ASR + diarization + speculative decoding with Hugging Face Inference Endpoints

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Releasing Youtube-Commons: a massive open corpus for conversational and multimodal data

Best Practices and Lessons Learned on Synthetic Data for Language Models

Rho-1: Not All Tokens Are What You Need

CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues

CodeEditorBench: Evaluating Code Editing Capability of Large Language Models

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

Algorithmic progress in language models

StarChat2 15B

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Genie: Generative Interactive Environments

OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

OpenMath

Self-Discover: Large Language Models Self-Compose Reasoning Structures

Multi-line AI-assisted Code Authoring

Parakeet

MambaByte: Token-free Selective State Space Model

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

WaveCoder: Widespread And Versatile Enhanced Instruction Tuning with Refined Data Generation

Analyzing and Improving the Training Dynamics of Diffusion Models

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Zephyr: Direct Distillation of LM Alignment

FreeU: Free Lunch in Diffusion U-Net

Calibrating LLM-Based Evaluator

Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model

A Large-scale Dataset for Audio-Language Representation Learning

Large-Scale Automatic Audiobook Creation

NExT-GPT: Any-to-Any Multimodal LLM

Instruction Mining: High-Quality Instruction Data Selection for Large Language Models

Retentive Network: A Successor to Transformer for Large Language Models