Hugging Face's logo

JosephusCheung
/
GuanacoOnConsumerHardware

Text Generation
Transformers
llama
Inference Endpoints
Model card Files
JosephusCheung commited on
Commit
7e39dfd
•
1 Parent(s): 7166e5b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -4,7 +4,7 @@ license: gpl-3.0
4
 
5
  Try Multimodal version with Colab Free T4 demo:
6
 
7
- [![Open In Colab](hhttps://huggingface.co/JosephusCheung/GuanacoVQAOnConsumerHardware)
8
 
9
  This repository is for Guanaco model with 4-bit quantized weights. The model benefits from two novel techniques introduced by GPTQ: quantizing columns in order of decreasing activation size and performing sequential quantization within a single Transformer block. These innovations enable compact, consumer-level multilingual models to function effectively.
10
 
 
4
 
5
  Try Multimodal version with Colab Free T4 demo:
6
 
7
+ ![Open In Colab](hhttps://huggingface.co/JosephusCheung/GuanacoVQAOnConsumerHardware)
8
 
9
  This repository is for Guanaco model with 4-bit quantized weights. The model benefits from two novel techniques introduced by GPTQ: quantizing columns in order of decreasing activation size and performing sequential quantization within a single Transformer block. These innovations enable compact, consumer-level multilingual models to function effectively.
10