smajumdar94 (Somshubra Majumdar)

upvoted a paper 17 days ago

Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory

Paper • 2405.08707 • Published 18 days ago • 25

upvoted an article 28 days ago

Article

Powerful ASR + diarization + speculative decoding with Hugging Face Inference Endpoints

May 1

• 53

upvoted a paper about 1 month ago

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published Apr 29 • 63

upvoted 2 articles about 1 month ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 69

Article

Releasing Youtube-Commons: a massive open corpus for conversational and multimodal data

By

•

Apr 18

• 20

upvoted 4 papers about 2 months ago

upvoted a paper 2 months ago

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

Paper • 2403.15042 • Published Mar 22 • 24

upvoted a paper 3 months ago

Algorithmic progress in language models

Paper • 2403.05812 • Published Mar 9 • 17

upvoted a collection 3 months ago

StarChat2 15B

Collection

Model, datasets, and demo for StarChat2 15B. For code to train the models, see: https://github.com/huggingface/alignment-handbook • 10 items • Updated Apr 12 • 12

upvoted 6 papers 3 months ago

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

Paper • 2403.04692 • Published Mar 7 • 36

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Paper • 2403.03507 • Published Mar 6 • 176

Genie: Generative Interactive Environments

Paper • 2402.15391 • Published Feb 23 • 67

OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement

Paper • 2402.14658 • Published Feb 22 • 78

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21 • 105

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 45

upvoted a collection 4 months ago

OpenMath

Collection

A collection of models and datasets introduced in "OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset" • 15 items • Updated Feb 19 • 28

upvoted 2 papers 4 months ago

Self-Discover: Large Language Models Self-Compose Reasoning Structures

Paper • 2402.03620 • Published Feb 6 • 102

Multi-line AI-assisted Code Authoring

Paper • 2402.04141 • Published Feb 6 • 8

upvoted a collection 4 months ago

Parakeet

Collection

NeMo Parakeet ASR Models attain strong speech recognition accuracy while being efficient for inference. Available in CTC and RNN-Transducer variants. • 6 items • Updated 25 days ago • 12

upvoted a paper 4 months ago

MambaByte: Token-free Selective State Space Model

Paper • 2401.13660 • Published Jan 24 • 47

upvoted 4 papers 5 months ago

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

Paper • 2401.00448 • Published Dec 31, 2023 • 25

WaveCoder: Widespread And Versatile Enhanced Instruction Tuning with Refined Data Generation

Paper • 2312.14187 • Published Dec 20, 2023 • 49

Analyzing and Improving the Training Dynamics of Diffusion Models

Paper • 2312.02696 • Published Dec 5, 2023 • 31

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 253

upvoted 2 papers 7 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 116

FreeU: Free Lunch in Diffusion U-Net

Paper • 2309.11497 • Published Sep 20, 2023 • 63

upvoted 3 papers 8 months ago

Calibrating LLM-Based Evaluator

Paper • 2309.13308 • Published Sep 23, 2023 • 10

Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model

Paper • 2309.13018 • Published Sep 22, 2023 • 9

A Large-scale Dataset for Audio-Language Representation Learning

Paper • 2309.11500 • Published Sep 20, 2023 • 9

upvoted 2 papers 9 months ago

Large-Scale Automatic Audiobook Creation

Paper • 2309.03926 • Published Sep 7, 2023 • 52

NExT-GPT: Any-to-Any Multimodal LLM

Paper • 2309.05519 • Published Sep 11, 2023 • 74

upvoted 2 papers 11 months ago

Instruction Mining: High-Quality Instruction Data Selection for Large Language Models

Paper • 2307.06290 • Published Jul 12, 2023 • 9

Retentive Network: A Successor to Transformer for Large Language Models

Paper • 2307.08621 • Published Jul 17, 2023 • 167

Somshubra Majumdar

AI & ML interests

Organizations

smajumdar94's activity

Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory

Powerful ASR + diarization + speculative decoding with Hugging Face Inference Endpoints

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Releasing Youtube-Commons: a massive open corpus for conversational and multimodal data

Best Practices and Lessons Learned on Synthetic Data for Language Models

Rho-1: Not All Tokens Are What You Need

CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues

CodeEditorBench: Evaluating Code Editing Capability of Large Language Models

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

Algorithmic progress in language models

StarChat2 15B

PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Genie: Generative Interactive Environments

OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

OpenMath

Self-Discover: Large Language Models Self-Compose Reasoning Structures

Multi-line AI-assisted Code Authoring

Parakeet

MambaByte: Token-free Selective State Space Model

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

WaveCoder: Widespread And Versatile Enhanced Instruction Tuning with Refined Data Generation

Analyzing and Improving the Training Dynamics of Diffusion Models

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Zephyr: Direct Distillation of LM Alignment

FreeU: Free Lunch in Diffusion U-Net

Calibrating LLM-Based Evaluator

Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model

A Large-scale Dataset for Audio-Language Representation Learning

Large-Scale Automatic Audiobook Creation

NExT-GPT: Any-to-Any Multimodal LLM

Instruction Mining: High-Quality Instruction Data Selection for Large Language Models

Retentive Network: A Successor to Transformer for Large Language Models