jan-hq commited on
Commit
3b26054
·
verified ·
1 Parent(s): 7b52ab0

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -0
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ ## Overview
6
+
7
+ [IBM Granite 3.0](https://huggingface.co/collections/ibm-granite/granite-30-models-66fdb59bbb54785c3512114f), the third generation of the Granite series of large language models (LLMs) and complementary tools. Reflecting our focus on the balance between powerful and practical, the new IBM Granite 3.0 models deliver state-of-the-art performance relative to model size while maximizing safety, speed and cost-efficiency for enterprise use cases.
8
+
9
+ ## Variants
10
+
11
+ | No | Variant | Cortex CLI command |
12
+ | --- | --- | --- |
13
+ | 1 | [gguf](https://huggingface.co/cortexso/granite-3.0/tree/main) | `cortex run granite-3.0:gguf` |
14
+ | 2 | [main/default](https://huggingface.co/cortexso/granite-3.0/tree/main) | `cortex run granite-3.0` |
15
+
16
+ ## Use it with Jan (UI)
17
+
18
+ 1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
19
+ 2. Use in Jan model Hub:
20
+ ```
21
+ cortexso/granite-3.0
22
+ ```
23
+
24
+ ## Use it with Cortex (CLI)
25
+
26
+ 1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
27
+ 2. Run the model with command:
28
+ ```
29
+ cortex run granite-3.0
30
+ ```
31
+
32
+ ## Credits
33
+
34
+ - **Author:** IBM
35
+ - **Converter:** [Homebrew](https://www.homebrew.ltd/)
36
+ - **Original License:** [License](https://www.apache.org/licenses/LICENSE-2.0)
37
+ - **Papers:** [Granite 3.0 Blog](https://www.ibm.com/new/ibm-granite-3-0-open-state-of-the-art-enterprise-models)