Marc Sun's picture

Marc Sun

marcsun13

·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

reacted to sayakpaul's post with 🔥 2 days ago

Commits speak louder than words 🤪 * 4 new video models * Multiple image models, including SANA & Flux Control * New quantizers -> GGUF & TorchAO * New training scripts Enjoy this holiday-special Diffusers release 🤗 Notes: https://github.com/huggingface/diffusers/releases/tag/v0.32.0

updated a model 2 days ago

hf-internal-testing/tiny-flux-dev-pipe-sharded-checkpoint-DDUF

updated a Space 23 days ago

DDUF/dduf-check

View all activity

Articles

Introducing SynthID Text

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

Accelerate 1.0.0

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

quanto: a pytorch quantization toolkit

Overview of natively supported quantization schemes in 🤗 Transformers

Making LLMs lighter with AutoGPTQ and transformers

Organizations

marcsun13's activity

liked 2 Spaces 2 months ago

BitNet.cpp

Running on L40S

SynthID Text

Watermarking LLM-generated text with SynthID Text

liked a Space 3 months ago

QuantizationTorchAODraft

liked 3 models 4 months ago

HF1BitLLM/Llama3-8B-1.58-Sigmoid-k100-10B-tokens

Text Generation • Updated Sep 18, 2024 • 21 • 10

HF1BitLLM/Llama3-8B-1.58-Linear-10B-tokens

Text Generation • Updated Sep 18, 2024 • 337 • 9

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19, 2024 • 2.59k • 166

liked a Space 4 months ago

Mapping the AI OS community

liked a Space 5 months ago

Wllama

Run GGUF directly on your browser!

liked 2 models 6 months ago

meta-llama/Llama-3.1-405B-Instruct-FP8

Text Generation • Updated Sep 25, 2024 • 34.2k • 183

google/gemma-2-9b

Text Generation • Updated Aug 7, 2024 • 119k • 619

liked 2 models 7 months ago

neuralmagic/Meta-Llama-3-8B-Instruct-FP8

Text Generation • Updated Jul 18, 2024 • 10k • 18

ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-2Bit-1x16

Text Generation • Updated May 31, 2024 • 26 • 3

liked 5 models 9 months ago

meta-llama/Meta-Llama-3-70B-Instruct

Text Generation • Updated 21 days ago • 68k • 1.45k

meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • Updated Sep 27, 2024 • 1.06M • • 3.74k

meta-llama/Meta-Llama-3-8B

Text Generation • Updated Sep 27, 2024 • 476k • 5.94k

mistralai/Mixtral-8x22B-v0.1

Text Generation • Updated Oct 3, 2024 • 3.55M • 205

google/flan-t5-xxl

Text2Text Generation • Updated Jul 27, 2023 • 719k • 1.22k

liked a Space 10 months ago

Compute Pipeline Size

liked a Space 11 months ago

Running on CPU Upgrade

LoRA Studio

Browse and run thousands of community trained LoRAs

liked a model 11 months ago

facebook/blenderbot-400M-distill

Text2Text Generation • Updated Mar 30, 2023 • 49.7k • • 408