README.md

---
license: apache-2.0
---

## Overview

OpenHermes 2.5 Mistral 7B is a state of the art Mistral Fine-tune, a continuation of OpenHermes 2 model, which trained on additional code datasets.

## Variants

| No | Variant | Cortex CLI command |
| --- | --- | --- |
| 1 | [7b-onnx](https://huggingface.co/cortexhub/openhermes-2.5/tree/7b-onnx) | `cortex run openhermes-2.5:7b-onnx` |
| 2 | [7b-tensorrt-llm-linux-ada](https://huggingface.co/cortexhub/openhermes-2.5/tree/7b-tensorrt-llm-linux-ada) | `cortex run openhermes-2.5:7b-tensorrt-llm-linux-ada` |
| 3 | [7b-tensorrt-llm-windows-ada](https://huggingface.co/cortexhub/openhermes-2.5/tree/7b-tensorrt-llm-windows-ada) | `cortex run openhermes-2.5:7b-tensorrt-llm-windows-ada` |
| 4 | [7b-tensorrt-llm-windows-ampere](https://huggingface.co/cortexhub/openhermes-2.5/tree/7b-tensorrt-llm-windows-ampere) | `cortex run openhermes-2.5:7b-tensorrt-llm-windows-ampere` |
| 5 | [tensorrt-llm](https://huggingface.co/cortexhub/openhermes-2.5/tree/7b-tensorrt-llm-windows-ada) | `cortex run openhermes-2.5:tensorrt-llm` |

## Use it with Jan (UI)

1. Install **Jan** using [Quickstart](https://jan.ai/docs/quickstart)
2. Use in Jan model Hub:
    ```
    cortexhub/openhermes-2.5
    ```
    
## Use it with Cortex (CLI)

1. Install **Cortex** using [Quickstart](https://cortex.jan.ai/docs/quickstart)
2. Run the model with command:
    ```
    cortex run openhermes-2.5
    ```
    
## Credits

- **Author:** Nous Research
- **Converter:** [Homebrew](https://www.homebrew.ltd/)
- **Original License:** [Licence](https://huggingface.co/datasets/choosealicense/licenses/blob/main/markdown/apache-2.0.md)
- **Papers:** [Openhermes 2.5](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)