File size: 610 Bytes
9f05117 2edee70 d2fe8ac 9f05117 d2fe8ac 9f05117 8694241 9f05117 eda5e53 9f05117 d2fe8ac 9f05117 d2fe8ac 9f05117 eda5e53 9f05117 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 |
---
license: apache-2.0
---
Download a Model
```
cortex models pull tinyllama
```
Start the Engine
```
cortex engines
```
Start model
```
cortex models start tinyllama
```
Chat
```
cortex chat
```
Model Structure
```
1.1b-chat-v1.0-gguf-Q2_K
1.1b-chat-v1.0-gguf-Q4_K_M
1.1b-chat-v1.0-gguf-Q6_K
1.1b-chat-v1.0-gguf-Q8_0
1.1b-chat-v1.0-tensorrtllm-windows-ada-int4
1.1b-chat-v1.0-tensorrtllm-windows-turing-int4
1.1b-chat-v1.0-tensorrtllm-windows-ampere-int4
1.1b-chat-v1.0-tensorrtllm-windows-ada-fp16
1.1b-chat-v1.0-tensorrtllm-windows-turing-fp16
1.1b-chat-v1.0-tensorrtllm-windows-ampere-fp16
``` |