ucalyptus (Sayantan Das)

upvoted an article 3 days ago

Article

Uncensor any LLM with abliteration

By

•

about 4 hours ago

• 107

upvoted 2 collections 8 days ago

Mistral Bangla

Collection

A collection of Bangla Mistral 7B models fine-tuned for context-based question answering and Bengali retrieval-augmented generation. • 5 items • Updated 13 days ago • 1

Bangla Llama

Collection

A collection of Bangla Llama 3 8B models fine-tuned for context-based question answering and Bengali retrieval-augmented generation. • 6 items • Updated 12 days ago • 2

upvoted a paper 8 days ago

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published 19 days ago • 137

upvoted a paper 9 days ago

Executable Code Actions Elicit Better LLM Agents

Paper • 2402.01030 • Published Feb 1 • 21

upvoted an article 14 days ago

Article

Unlocking Longer Generation with Key-Value Cache Quantization

23 days ago

• 12

upvoted an article 15 days ago

Article

Synthetic dataset generation techniques: generating custom sentence similarity data

By

•

15 days ago

• 11

upvoted a collection 17 days ago

🚀GGUF

Collection

Llama.cpp compatible models, can be used on CPUs and GPUs! • 665 items • Updated 2 days ago • 23

upvoted 2 articles 19 days ago

Article

Hugging Face x LangChain : A new partner package in LangChain

25 days ago

• 73

Article

Train custom AI models with the trainer API and adapt them to 🤗

By

•

6 days ago

• 24

upvoted an article 21 days ago

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 43

upvoted an article 22 days ago

Article

Hugging Face + Google Visual Blocks

By

•

22 days ago

• 19

upvoted a collection 27 days ago

Prem

Collection

Finetunes and Quantizations of the Prem LLMs • 11 items • Updated 25 days ago • 2

upvoted an article 27 days ago

Article

Merge Large Language Models with mergekit

By

•

Jan 9

• 26

upvoted a collection 28 days ago

fuck quadratic attention

Collection

11 items • Updated Apr 24 • 19

upvoted a paper 29 days ago

CLLMs: Consistency Large Language Models

Paper • 2403.00835 • Published Feb 28 • 3

upvoted 3 papers about 1 month ago

A Primer on the Inner Workings of Transformer-based Language Models

Paper • 2405.00208 • Published Apr 30 • 8

Can Large Language Models be Trusted for Evaluation? Scalable Meta-Evaluation of LLMs as Evaluators via Agent Debate

Paper • 2401.16788 • Published Jan 30 • 1

Octopus v4: Graph of language models

Paper • 2404.19296 • Published Apr 30 • 115

upvoted an article about 1 month ago

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 136

upvoted 2 papers about 1 month ago

PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training

Paper • 2309.10400 • Published Sep 19, 2023 • 23

Llama 2: Open Foundation and Fine-Tuned Chat Models

Paper • 2307.09288 • Published Jul 18, 2023 • 235

upvoted an article about 1 month ago

Article

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)

By

•

Apr 24

• 51

upvoted a paper about 1 month ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 239

upvoted 3 articles about 2 months ago

Article

AI Apps in a Flash with Gradio's Reload Mode

Apr 16

• 16

Article

Towards Encrypted Large Language Models with FHE

Aug 2, 2023

• 5

Article

Fine-tune Llama 3 with ORPO

By

•

Apr 22

• 196

upvoted a paper about 2 months ago

Learning to Route Among Specialized Experts for Zero-Shot Generalization

Paper • 2402.05859 • Published Feb 8 • 5

upvoted 2 collections about 2 months ago

Zephyr ORPO

Collection

Models and datasets to align LLMs with Odds Ratio Preference Optimisation (ORPO). Recipes here: https://github.com/huggingface/alignment-handbook • 3 items • Updated Apr 12 • 15

SDXL LoRA

Collection

A few SDXL-LoRA models I've trained • 20 items • Updated Jan 22 • 6

upvoted an article about 2 months ago

Article

CodeGemma - an official Google release for code LLMs

Apr 9

• 97

upvoted a paper about 2 months ago

Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws

Paper • 2404.05405 • Published Apr 8 • 4

upvoted 9 papers 2 months ago

Mixture-of-Depths: Dynamically allocating compute in transformer-based language models

Paper • 2404.02258 • Published Apr 2 • 102

Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction

Paper • 2404.02905 • Published Apr 3 • 60

LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model

Paper • 2404.01331 • Published Mar 29 • 22

H2O-Danube-1.8B Technical Report

Paper • 2401.16818 • Published Jan 30 • 16

The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 75

PERL: Parameter Efficient Reinforcement Learning from Human Feedback

Paper • 2403.10704 • Published Mar 15 • 55

upvoted a collection 3 months ago

DRAGON Models

Collection

Production-grade RAG-optimized 6-7B parameter models - "Delivering RAG on ..." the leading foundation base models • 11 items • Updated Feb 3 • 42

upvoted 9 papers 3 months ago

RAFT: Adapting Language Model to Domain Specific RAG

Paper • 2403.10131 • Published Mar 15 • 65

KTO: Model Alignment as Prospect Theoretic Optimization

Paper • 2402.01306 • Published Feb 2 • 11

Evolutionary Optimization of Model Merging Recipes

Paper • 2403.13187 • Published Mar 19 • 46

WebArena: A Realistic Web Environment for Building Autonomous Agents

Paper • 2307.13854 • Published Jul 25, 2023 • 20

IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages

Paper • 2403.01926 • Published Mar 4 • 1

Unifying Vision, Text, and Layout for Universal Document Processing

Paper • 2212.02623 • Published Dec 5, 2022 • 10

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 567

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 94

Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models

Paper • 2402.17177 • Published Feb 27 • 87

upvoted a collection 3 months ago

Data-efficient LLMs

Collection

dataset pruning for advancing the capabilities of LLMs • 26 items • Updated 5 days ago • 1

upvoted 6 papers 3 months ago

Datasets for Large Language Models: A Comprehensive Survey

Paper • 2402.18041 • Published Feb 28 • 2

Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for Enhanced Video Forgery Detection

Paper • 2306.06881 • Published Jun 12, 2023 • 1

FaceForensics++: Learning to Detect Manipulated Facial Images

Paper • 1901.08971 • Published Jan 25, 2019 • 1

Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

Paper • 2203.05482 • Published Mar 10, 2022 • 5

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 45

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21 • 106

upvoted a collection 3 months ago

Papers about model merging

Collection

referenced in the mergekit repo: https://github.com/cg123/mergekit • 4 items • Updated Feb 13 • 13

upvoted a collection 4 months ago

Model Merging Papers

Collection

Collection of relevant papers about model merging • 13 items • Updated Apr 2 • 5

Sayantan Das

AI & ML interests

Organizations

ucalyptus's activity

Uncensor any LLM with abliteration

Unlocking Longer Generation with Key-Value Cache Quantization

Synthetic dataset generation techniques: generating custom sentence similarity data

Hugging Face x LangChain : A new partner package in LangChain

Train custom AI models with the trainer API and adapt them to 🤗

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Hugging Face + Google Visual Blocks

Merge Large Language Models with mergekit

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)

AI Apps in a Flash with Gradio's Reload Mode

Towards Encrypted Large Language Models with FHE

Fine-tune Llama 3 with ORPO

CodeGemma - an official Google release for code LLMs