File size: 343 Bytes
e91b126 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
pipeline_tag: text-generation
tags:
- Neuron
- Optimum-Neuron
- AWS
---
Compiled Meta-Llama-3-8B-Instruct using optimum-neuron
```shell
optimum-cli export neuron --model NousResearch/Meta-Llama-3-8B-Instruct --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16 ./models/NousResearch/Meta-Llama-3-8B-Instruct```
|