phi3 / README.md
HoangHa's picture
Update README.md
89f3e10 verified
|
raw
history blame
1.58 kB
metadata
license: ms-pl

Overview

The Phi-3, state-of-the-art open model trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties. The model belongs to the Phi-3 family with the 4B, 7B version in two variants 8K and 128K which is the context length (in tokens) that it can support.

Variants

No Variant Cortex CLI command
1 mini-onnx cortex run phi3:mini-onnx
2 mini-gguf cortex run phi3:mini-gguf
3 medium-gguf cortex run phi3:medium-gguf
4 medium-onnx cortex run phi3:medium-onnx

Use it with Jan (UI)

  1. Install Jan using Quickstart
  2. Use in Jan model Hub:
    cortexhub/phi3
    

Use it with Cortex (CLI)

  1. Install Cortex using Quickstart
  2. Run the model with command:
    cortex run phi3
    

Credits