aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config /llama.json

Commit History

Add more llama config

2d87237
verified

dacorvo HF staff commited on Apr 9, 2024

Added Llama-70b batch_size 4 to inference cache

593822e
verified

dacorvo HF staff commited on Mar 8, 2024

Create inference-cache-config/llama.json

1960ccb
verified

philschmid commited on Mar 5, 2024