Hugging Face's logo

Mihaiii
/
Pallas-0.5-frankenmerge

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Model card Files Community
1
Mihaiii commited on
Commit
2dd4f55
·
1 Parent(s): fd592d4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -39,4 +39,12 @@ slices:
39
  layer_range: [55, 56]
40
  merge_method: passthrough
41
  dtype: bfloat16
42
- ```
 
 
 
 
 
 
 
 
 
39
  layer_range: [55, 56]
40
  merge_method: passthrough
41
  dtype: bfloat16
42
+ ```
43
+
44
+ Quants:
45
+
46
+ [Pallas-0.5-frankenmerge-GGUF](https://huggingface.co/TheBloke/Pallas-0.5-frankenmerge-GGUF)
47
+
48
+ [Pallas-0.5-frankenmerge-GPTQ](https://huggingface.co/TheBloke/Pallas-0.5-frankenmerge-GPTQ)
49
+
50
+ [Pallas-0.5-frankenmerge-AWQ](https://huggingface.co/TheBloke/Pallas-0.5-frankenmerge-AWQ)