cszhzleo/CodeLlama-7b-Instruct-hf-nc2-bs1-token1024-neuron-218

Compiled CodeLlama-7b-Instruct-hf using optimum-neuron

optimum-cli export neuron  --model codellama/CodeLlama-7b-Instruct-hf --batch_size 1 --sequence_length 1024 --num_cores 2 --auto_cast_type fp16  ./models/codellama/CodeLlama-7b-Instruct-hf