aws-neuron

/

optimum-neuron-cache

like 7

Hi @qkasper0, although the cache of sdxl models is now supported by optimum neuron, there is a recent regression in the weight/neff separation since neuron SDK 2.18.0 which is mandatory for our caching mechanism. The Annapurna team is fixing it, Optimum team will add the cache as soon as the issue is fixed: https://github.com/aws-neuron/aws-neuron-sdk/issues/859.