Hugging Face's logo

cognitivecomputations
/
laserxtral-GGUF

Text Generation
Transformers
GGUF
mixtral
text-generation-inference
Model card Files Community
Kearm commited on
Commit
4453ce8
•
1 Parent(s): fc26a52

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -1,6 +1,7 @@
1
  ---
2
  license: cc-by-nc-2.0
3
  pipeline_tag: text-generation
 
4
  library_name: transformers
5
  ---
6
  ## GGUF Quantizations of laserxtral
@@ -16,4 +17,7 @@ This repo contains GGUF format model files for our laserxtral model.
16
  | Name | Quant method | Bits | Size |
17
  | ---- | ---- | ---- | ---- |
18
  | [cognitivecomputations_laserxtral-Q2_K.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q2_K.gguf) | Q2_K | 2 | 8.8 GB |
19
- | [cognitivecomputations_laserxtral-Q4_K_M.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q4_K_M.gguf) | Q4_K_M | 4 | 14.6 GB |
 
 
 
 
1
  ---
2
  license: cc-by-nc-2.0
3
  pipeline_tag: text-generation
4
+ inference: false
5
  library_name: transformers
6
  ---
7
  ## GGUF Quantizations of laserxtral
 
17
  | Name | Quant method | Bits | Size |
18
  | ---- | ---- | ---- | ---- |
19
  | [cognitivecomputations_laserxtral-Q2_K.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q2_K.gguf) | Q2_K | 2 | 8.8 GB |
20
+ | [cognitivecomputations_laserxtral-Q3_K_M.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q3_K_M.gguf) | Q3_K_M | 3 | 11.6 GB |
21
+ | [cognitivecomputations_laserxtral-Q4_K_M.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q4_K_M.gguf) | Q4_K_M | 4 | 14.6 GB |
22
+ | [cognitivecomputations_laserxtral-Q5_K_M.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q5_K_M.gguf) | Q5_K_M | 5 | 17.1 GB |
23
+ | [cognitivecomputations_laserxtral-Q6_K.gguf](https://huggingface.co/cognitivecomputations/laserxtral-GGUF/blob/main/cognitivecomputations_laserxtral-Q6_K.gguf) | Q6_K | 6 | 19.8 GB |