Hugging Face's logo
Matthew Douglas's picture
TFLOPS icon 189.2 TFLOPS
6 34 182

Matthew Douglas

mdouglas
SquishSquish's profile picture Akash20000's profile picture 21world's profile picture
·

AI & ML interests

LLMs, quantization, NLP, embeddings, hardware, DevEx

Recent Activity

liked a model about 2 months ago
meta-llama/Llama-3.2-1B
upvoted a collection about 2 months ago
Llama 3.2

Articles

Organizations

Hugging Face's profile picture Hugging Face Discord Community's profile picture LLHF's profile picture llmc's profile picture SLLHF's profile picture Hugging Quants's profile picture blhf's profile picture

mdouglas's activity

New activity in hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16 2 months ago

update the config.json and the weights

1
#1 opened 3 months ago by Rudra-ai
New activity in google/gemma-2-27b-it 4 months ago

4 bit and 8 bit bnb quants only generate empty strings or one token repeated endlessly

1
#32 opened 4 months ago by nicorinn-google

4bit-quantized gemma-2-27b-it generates only pad tokens, like '<pad><pad><pad><pad><pad><pad><pad><pad><pad>'.

3
#29 opened 4 months ago by kshinoda

Update bitsandbytes examples

1
#33 opened 4 months ago by mdouglas
New activity in hugging-quants/Meta-Llama-3.1-8B-BNB-NF4 4 months ago

Update `license`
#1 opened 4 months ago by alvarobartt
New activity in mdouglas/guanamyra-small about 1 year ago

Adding `safetensors` variant of this model
#1 opened about 1 year ago by SFconvertbot