cszhzleo
/

Mistral-7B-Instruct-v0.2-nc2-bs1-token1024-neuron-218

Text Generation

Transformers

mistral

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.2-nc2-bs1-token1024-neuron-218 / README.md

cszhzleo

Update README.md

b5ca200 verified 7 months ago

preview code

raw

history blame contribute delete

330 Bytes

metadata

pipeline_tag: text-generation
tags:
  - Neuron
  - Optimum-Neuron
  - AWS

Compiled Mistral-7B-Instruct-v0.2 using optimum-neuron

optimum-cli export neuron  --model mistralai/Mistral-7B-Instruct-v0.2 --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/mistralai/Mistral-7B-Instruct-v0.2