SpiridonSunRotator commited on
Commit
3cec4db
1 Parent(s): d30df0a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - cohere
5
+ - conversational
6
+ - 10languages
7
+ - text-generation-inference
8
+ - Inference Endpoints
9
+ ---
10
+ Official [AQLM](https://arxiv.org/abs/2401.06118) quantization of [CohereForAI/c4ai-command-r-v01
11
+ ](https://huggingface.co/CohereForAI/c4ai-command-r-plus).
12
+
13
+ For this quantization, we used 1 codebook of 16 bits.
14
+
15
+ Results:
16
+
17
+ in progress ...