Sylvain Gugger's picture

251 3

Sylvain Gugger

sgugger

·

sgugger

AI & ML interests

None yet

Articles

Fine-tuning Llama 2 70B using PyTorch FSDP

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Introducing RWKV — An RNN with the advantages of a transformer

How 🤗 Accelerate runs very large models thanks to PyTorch

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

Accelerate Large Model Training using DeepSpeed

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

Course Launch Community Event

Introducing 🤗 Accelerate

Organizations

sgugger's activity

New activity in albert/albert-xlarge-v1 over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

New activity in sgugger/finetuned-bert over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

New activity in funnel-transformer/large over 1 year ago

Adding `safetensors` variant of this model

#2 opened over 1 year ago by

New activity in tiiuae/falcon-40b-instruct over 1 year ago

Revert in-library PR

#67 opened over 1 year ago by

New activity in Helsinki-NLP/opus-mt-tc-big-en-tr over 1 year ago

Fix weights by putting the right value in `lm_head.weight`

#4 opened over 1 year ago by

New activity in Helsinki-NLP/opus-tatoeba-en-tr over 1 year ago

Fix weights by putting the right value in `lm_head.weight`

#3 opened over 1 year ago by

New activity in Helsinki-NLP/opus-tatoeba-es-zh over 1 year ago

Fix weights by putting the right value in `lm_head.weight`

#3 opened over 1 year ago by

New activity in Helsinki-NLP/opus-tatoeba-fr-it over 1 year ago

Fix weights by putting the right value in `lm_head.weight`

#3 opened over 1 year ago by

New activity in Helsinki-NLP/opus-tatoeba-he-fr over 1 year ago

Fix weights by putting the right value in `lm_head.weight`

#2 opened over 1 year ago by

New activity in Helsinki-NLP/opus-tatoeba-he-it over 1 year ago

Fix weights by putting the right value in `lm_head.weight`

#2 opened over 1 year ago by

New activity in Helsinki-NLP/opus-tatoeba-it-he over 1 year ago

Fix weights by putting the right value in `lm_head.weight`

#2 opened over 1 year ago by

New activity in funnel-transformer/xlarge-base over 1 year ago

Adding `safetensors` variant of this model

#1 opened over 1 year ago by

New activity in google-bert/bert-base-uncased over 1 year ago

Update README.md

#46 opened over 1 year ago by

New activity in tiiuae/falcon-40b over 1 year ago

Revert in-library PR

#90 opened over 1 year ago by

New activity in tiiuae/falcon-7b over 1 year ago

OSError: tiiuae/falcon-7b does not appear to have a file named configuration_RW.py

#62 opened over 1 year ago by

New activity in tiiuae/falcon-7b-instruct over 1 year ago

Revert in-library PR

#63 opened over 1 year ago by

New activity in tiiuae/falcon-7b over 1 year ago

Revert in-library PR

#66 opened over 1 year ago by

New activity in sgugger/bert-finetuned-mrpc over 1 year ago

Adding `safetensors` variant of this model

#3 opened over 1 year ago by

New activity in FacebookAI/xlm-mlm-ende-1024 over 1 year ago

Adding `safetensors` variant of this model

#2 opened over 1 year ago by

New activity in FacebookAI/xlm-mlm-tlm-xnli15-1024 over 1 year ago

Adding `safetensors` variant of this model

#2 opened over 1 year ago by