GGUF
Inference Endpoints
jan-hq commited on
Commit
580697f
1 Parent(s): 0f5a6f1

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ ---
4
+
5
+ ## Overview
6
+
7
+ C4AI Command-R is a research release of a 35 billion parameter highly performant generative model. Command-R is a large language model with open weights optimized for a variety of use cases including reasoning, summarization, and question answering. Command-R has the capability for multilingual generation evaluated in 10 languages and highly performant RAG capabilities.
8
+
9
+ ## Variants
10
+
11
+ | No | Variant | Cortex CLI command |
12
+ | --- | --- | --- |
13
+ | 1 | [35b-gguf](https://huggingface.co/cortexhub/command-r/tree/35B-gguf) | `cortex run command-r:35b-gguf` |
14
+
15
+ ## Use it with Jan (UI)
16
+
17
+ 1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
18
+ 2. Use in Jan model Hub:
19
+ ```
20
+ cortexhub/command-r
21
+ ```
22
+
23
+ ## Use it with Cortex (CLI)
24
+
25
+ 1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
26
+ 2. Run the model with command:
27
+ ```
28
+ cortex run command-r
29
+ ```
30
+
31
+ ## Credits
32
+
33
+ - **Author:** Cohere For AI: [cohere.for.ai](https://cohere.for.ai/)
34
+ - **Converter:** [Homebrew](https://www.homebrew.ltd/)
35
+ - **Original License:** [Licence](https://cohere.com/c4ai-cc-by-nc-license)