ucalyptus (Sayantan Das)

upvoted a paper 11 days ago

Text2SQL is Not Enough: Unifying AI and Databases with TAG

Paper • 2408.14717 • Published 13 days ago • 23

upvoted a paper 12 days ago

Diffusion Models Are Real-Time Game Engines

Paper • 2408.14837 • Published 13 days ago • 113

upvoted an article 27 days ago

Article

Welcome FalconMamba: The first strong attention-free 7B model

28 days ago

• 90

upvoted a paper 27 days ago

Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers

Paper • 2408.06195 • Published 28 days ago • 49

upvoted a collection about 1 month ago

Gemma 2 2B Release

Collection

The 2.6B parameter version of Gemma 2. • 6 items • Updated Jul 31 • 74

upvoted an article about 1 month ago

Article

Google releases Gemma 2 2B, ShieldGemma and Gemma Scope

Jul 31

• 58

upvoted an article about 2 months ago

Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Jul 23

• 184

upvoted a collection about 2 months ago

xLAM models

Collection

xLAM: A Family of Large Action Models to Empower AI Agent Systems • 9 items • Updated about 6 hours ago • 36

upvoted an article about 2 months ago

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16

• 237

upvoted a collection 2 months ago

LLM Compiler

Collection

Meta LLM Compiler is a state-of-the-art LLM that builds upon Code Llama with improved performance for code optimization and compiler reasoning. • 4 items • Updated Jun 27 • 145

upvoted an article 3 months ago

Article

Uncensor any LLM with abliteration

By

•

Jun 13

• 304

upvoted 2 collections 3 months ago

Mistral Bangla

Collection

A collection of Bangla Mistral 7B models fine-tuned for context-based question answering and Bengali retrieval-augmented generation. • 5 items • Updated May 25 • 1

Bangla Llama

Collection

A collection of Bangla Llama 3 8B models fine-tuned for context-based question answering and Bengali retrieval-augmented generation. • 6 items • Updated May 26 • 3

upvoted 2 papers 3 months ago

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published May 19 • 149

Executable Code Actions Elicit Better LLM Agents

Paper • 2402.01030 • Published Feb 1 • 27

upvoted 2 articles 4 months ago

Article

Unlocking Longer Generation with Key-Value Cache Quantization

May 16

• 28

Article

Synthetic dataset generation techniques: generating custom sentence similarity data

By

•

May 23

• 14

upvoted a collection 4 months ago

🚀GGUF

Collection

Llama.cpp compatible models, can be used on CPUs and GPUs! • 692 items • Updated about 22 hours ago • 30

upvoted 4 articles 4 months ago

Article

Hugging Face x LangChain : A new partner package in LangChain

May 14

• 103

Article

Train custom AI models with the trainer API and adapt them to 🤗

By

•

Jun 29

• 33

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 75

Article

Hugging Face + Google Visual Blocks

By

•

May 16

• 21

upvoted a collection 4 months ago

Prem

Collection

Finetunes and Quantizations of the Prem LLMs • 11 items • Updated May 13 • 2

upvoted an article 4 months ago

Article

Merge Large Language Models with mergekit

By

•

Jan 9

• 63

upvoted a collection 4 months ago

fuck quadratic attention

Collection

11 items • Updated Apr 24 • 20

upvoted 4 papers 4 months ago

CLLMs: Consistency Large Language Models

Paper • 2403.00835 • Published Feb 28 • 3

A Primer on the Inner Workings of Transformer-based Language Models

Paper • 2405.00208 • Published Apr 30 • 10

Can Large Language Models be Trusted for Evaluation? Scalable Meta-Evaluation of LLMs as Evaluators via Agent Debate

Paper • 2401.16788 • Published Jan 30 • 1

Octopus v4: Graph of language models

Paper • 2404.19296 • Published Apr 30 • 118

upvoted an article 5 months ago

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 157

upvoted 2 papers 5 months ago

PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training

Paper • 2309.10400 • Published Sep 19, 2023 • 25

Llama 2: Open Foundation and Fine-Tuned Chat Models

Paper • 2307.09288 • Published Jul 18, 2023 • 239

upvoted an article 5 months ago

Article

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)

By

•

Apr 24

• 55

upvoted a paper 5 months ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 250

upvoted 3 articles 5 months ago

Article

AI Apps in a Flash with Gradio's Reload Mode

Apr 16

• 20

Article

Towards Encrypted Large Language Models with FHE

Aug 2, 2023

• 8

Article

Fine-tune Llama 3 with ORPO

By

•

Apr 22

• 218

upvoted a paper 5 months ago

Learning to Route Among Specialized Experts for Zero-Shot Generalization

Paper • 2402.05859 • Published Feb 8 • 5

upvoted 2 collections 5 months ago

Zephyr ORPO

Collection

Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook • 3 items • Updated Apr 12 • 16

SDXL LoRA

Collection

A few SDXL-LoRA models I've trained • 20 items • Updated Jan 22 • 6

upvoted an article 5 months ago

Article

CodeGemma - an official Google release for code LLMs

Apr 9

• 98

upvoted 9 papers 5 months ago

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 103

Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction

Paper • 2404.02905 • Published Apr 3 • 63

LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model

Paper • 2404.01331 • Published Mar 29 • 24

H2O-Danube-1.8B Technical Report

Paper • 2401.16818 • Published Jan 30 • 16

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 77

upvoted a paper 6 months ago

PERL: Parameter Efficient Reinforcement Learning from Human Feedback

Paper • 2403.10704 • Published Mar 15 • 56

upvoted a collection 6 months ago

DRAGON Models

Collection

Production-grade RAG-optimized 6-7B parameter models - "Delivering RAG on ..." the leading foundation base models • 20 items • Updated 14 days ago • 44

upvoted 8 papers 6 months ago

RAFT: Adapting Language Model to Domain Specific RAG

Paper • 2403.10131 • Published Mar 15 • 65

KTO: Model Alignment as Prospect Theoretic Optimization

Paper • 2402.01306 • Published Feb 2 • 12

Evolutionary Optimization of Model Merging Recipes

Paper • 2403.13187 • Published Mar 19 • 49

WebArena: A Realistic Web Environment for Building Autonomous Agents

Paper • 2307.13854 • Published Jul 25, 2023 • 22

IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages

Paper • 2403.01926 • Published Mar 4 • 1

Unifying Vision, Text, and Layout for Universal Document Processing

Paper • 2212.02623 • Published Dec 5, 2022 • 10

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 590

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 96

Sayantan Das

AI & ML interests

Organizations

ucalyptus's activity

Welcome FalconMamba: The first strong attention-free 7B model

Google releases Gemma 2 2B, ShieldGemma and Gemma Scope

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

SmolLM - blazingly fast and remarkably powerful

Uncensor any LLM with abliteration

Unlocking Longer Generation with Key-Value Cache Quantization

Synthetic dataset generation techniques: generating custom sentence similarity data

Hugging Face x LangChain : A new partner package in LangChain

Train custom AI models with the trainer API and adapt them to 🤗

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Hugging Face + Google Visual Blocks

Merge Large Language Models with mergekit

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)

AI Apps in a Flash with Gradio's Reload Mode

Towards Encrypted Large Language Models with FHE

Fine-tune Llama 3 with ORPO

CodeGemma - an official Google release for code LLMs