aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config /mistral.json

Commit History

Add more batch_size for mistral on smaller instances

545cd4d
verified

dacorvo HF Staff commited on May 31, 2024

Update Mistral cached configurations

ee458f5
verified

dacorvo HF Staff commited on May 31, 2024

Add Mistral-v2

20e585f
verified

dacorvo HF Staff commited on Apr 9, 2024

Remove variants from main mistral config

ef07aca
verified

dacorvo HF Staff commited on Mar 21, 2024

Added teknium/OpenHermes-2.5-Mistral-7B

1518247
verified

dacorvo HF Staff commited on Mar 8, 2024

Create mistral.json

b5d0afd
verified

philschmid commited on Mar 5, 2024