|
|
--- |
|
|
language: |
|
|
- code |
|
|
license: llama2 |
|
|
tags: |
|
|
- llama-2 |
|
|
- mlx |
|
|
- 4-bit |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
|
|
|
# CodeLlama-7b-Python-hf-4bit-mlx |
|
|
This model was converted to MLX format from [`codellama/CodeLlama-7b-Python-hf`](). |
|
|
Refer to the [original model card](https://huggingface.co/codellama/CodeLlama-7b-Python-hf) for more details on the model. |
|
|
## Use with mlx |
|
|
```bash |
|
|
pip install mlx |
|
|
git clone https://github.com/ml-explore/mlx-examples.git |
|
|
cd mlx-examples/llms/hf_llm |
|
|
python generate.py --model mlx-community/CodeLlama-7b-Python-hf-4bit-mlx --prompt "My name is" |
|
|
``` |
|
|
|
