cortexso/llama2

Overview

Meta developed and publicly released the Llama 2 family of large language models (LLMs), a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. Our fine-tuned LLMs, called Llama-2-Chat, are optimized for dialogue use cases.

Variants

No	Variant	Cortex CLI command
1	7B-onnx-int4-dml	cortex run llama2:7B-onnx-int4-dml

Use it with Jan (UI)

1. Install Jan using Quickstart
2. Use in Jan model Hub:

   cortexso/llama2
   

Use it with Cortex (CLI)

1. Install Cortex using Quickstart
2. Run the model with command:

   cortex run llama2
   

Credits

• Author: Meta
• Converter: Homebrew
• Original License: License
• Papers: Llama-2 Blog