Hugging Face's logo

altomek
/
CodeRosa-70B-AB1

Text Generation
Transformers
Safetensors
English
llama
Merge
Eval Results
Inference Endpoints
text-generation-inference
Model card Files Community
1
altomek commited on
Commit
e7ba366
•
1 Parent(s): 0f8cfbc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -43,6 +43,8 @@ I use max_seq_len 8K with alpha_value 2.65.
43
 
44
  ### Quants
45
 
 
 
46
  - [4.5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-4.5bpw-EXL2)
47
  - [4bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-4bpw-EXL2)
48
  - [3.92bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.92bpw-EXL2) --> 40GB VRAM
 
43
 
44
  ### Quants
45
 
46
+ - [6bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-6bpw-EXL2)
47
+ - [5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-5bpw-EXL2)
48
  - [4.5bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-4.5bpw-EXL2)
49
  - [4bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-4bpw-EXL2)
50
  - [3.92bpw](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.92bpw-EXL2) --> 40GB VRAM