aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config /mistral.json

Commit History

Update inference-cache-config/mistral.json

8ea3b57
verified

dacorvo HF staff commited on Sep 27, 2024

Update inference-cache-config/mistral.json

6c4c814
verified

dacorvo HF staff commited on Sep 26, 2024

Add more batch_size for mistral on smaller instances

545cd4d
verified

dacorvo HF staff commited on May 31, 2024

Update Mistral cached configurations

ee458f5
verified

dacorvo HF staff commited on May 31, 2024

Add Mistral-v2

20e585f
verified

dacorvo HF staff commited on Apr 9, 2024

Remove variants from main mistral config

ef07aca
verified

dacorvo HF staff commited on Mar 21, 2024

Added teknium/OpenHermes-2.5-Mistral-7B

1518247
verified

dacorvo HF staff commited on Mar 8, 2024

Create mistral.json

b5d0afd
verified

philschmid commited on Mar 5, 2024