Arunkumar Venkataramanan's picture

29 94

Arunkumar Venkataramanan

ArunkumarVR

·

https://arunkumarramanan.github.io

ArunkumarRamanan

AI & ML interests

AGI Research: Reasoning, Safety & Alignment (Superalignment), Generative AI (GenAI), Multi-Modal Foundation Models (FMs), Large Language Models (LLMs), Transformers & Diffusion Models, Open LLM Training, Optimization & Finetuning, Serving & Inference

Organizations

ArunkumarVR's activity

upvoted a collection 2 days ago

PaliGemma Release

Pretrained and mix checkpoints for PaliGemma • 10 items • Updated 2 days ago • 80

upvoted an article 2 days ago

Article

PaliGemma – Google's Cutting-Edge Open Vision Language Model

3 days ago

• 84

upvoted an article 16 days ago

Article

Making thousands of open LLMs bloom in the Vertex AI Model Garden

Apr 10

• 16

upvoted a collection 19 days ago

[lecture artifacts] aligning open language models

artifacts referenced in the talk timeline! Slides: https://docs.google.com/presentation/d/1quMyI4BAx4rvcDfk8jjv063bmHg4RxZd9mhQloXpMn0/edit?usp=sharin • 63 items • Updated 29 days ago • 41

upvoted 2 articles 26 days ago

Article

Welcome Llama 3 - Meta's new open LLM

29 days ago

• 238

Article

Fine-tune Llama 3 with ORPO

By

•

24 days ago

• 175

upvoted a collection 29 days ago

Meta Llama 3

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated 29 days ago • 516

upvoted an article about 1 month ago

Article

CodeGemma - an official Google release for code LLMs

Apr 9

• 95

upvoted 2 collections about 2 months ago

MoEs papers reading list

41 items • Updated 4 days ago • 122

DBRX

DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks. • 3 items • Updated Mar 27 • 89

upvoted a paper 3 months ago

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 566

upvoted 3 collections 3 months ago

💫 StarCoder2

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 72

OpenCodeInterpreter

18 items • Updated Mar 3 • 73

OpenMath

A collection of models and datasets introduced in "OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset" • 15 items • Updated Feb 19 • 28

upvoted 3 papers 3 months ago

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning

Paper • 2402.06619 • Published Feb 9 • 47

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 34

Neural Network Diffusion

Paper • 2402.13144 • Published Feb 20 • 92

upvoted 2 collections 3 months ago

Whisper Release

Whisper includes both English-only and multilingual checkpoints for ASR and ST, ranging from 38M params for the tiny models to 1.5B params for large. • 12 items • Updated Sep 13, 2023 • 47

Gemma release

Groups the Gemma models released by the Google team. • 40 items • Updated 2 days ago • 302

upvoted 2 papers 3 months ago

DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Paper • 2402.03300 • Published Feb 5 • 61

Self-Discover: Large Language Models Self-Compose Reasoning Structures

Paper • 2402.03620 • Published Feb 6 • 102

upvoted a collection 3 months ago

Leaderboards and benchmarks ✨

Cool leaderboard spaces collection for models across modalities! Text, vision, audio, ... • 61 items • Updated 3 days ago • 59

upvoted a paper 3 months ago

StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

Paper • 2402.01391 • Published Feb 2 • 41

upvoted 6 collections 4 months ago

DPO vs KTO vs IPO

A collection of datasets and models used for the Aligning LLMs with Direct Preference Optimization Methods blogpost • 2 items • Updated Jan 16 • 11

Handbook v0.1 models and datasets

Models and datasets for v0.1 of the alignment handbook • 6 items • Updated Nov 10, 2023 • 23

Constitutional AI

A collection of datasets and models that accompany the Constitutional AI recipe. See hf.co/blog/constitutional-ai for more details. • 9 items • Updated Feb 1 • 4

Paloma

Dataset and baseline models for Paloma, a benchmark of language model fit to 585 textual domains • 8 items • Updated Feb 1 • 13

Tulu V2 Suite

The set of models associated with the paper "Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2" • 19 items • Updated Feb 1 • 43

OLMo Suite

Artifacts for the first set of OLMo models. • 12 items • Updated 1 day ago • 35