Sylvain Gugger's picture

251 3

Sylvain Gugger

sgugger

·

sgugger

AI & ML interests

None yet

Articles

Fine-tuning Llama 2 70B using PyTorch FSDP

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Introducing RWKV — An RNN with the advantages of a transformer

How 🤗 Accelerate runs very large models thanks to PyTorch

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

Accelerate Large Model Training using DeepSpeed

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

Course Launch Community Event

Introducing 🤗 Accelerate

Organizations

sgugger's activity

liked a model over 1 year ago

tiiuae/falcon-40b

Text Generation • Updated Aug 9 • 149k • 2.42k

liked a model about 2 years ago

facebook/opt-13b

Text Generation • Updated Jan 24, 2023 • 25.2k • 65

liked a Space over 2 years ago

Github Release