Is there an option to run a model with text-generation-inference from HF? I had the error:
RuntimeError: weight model.layers.0.self_attn.rotary_emb.inv_freq does not exist
All these models are failing with same error in TGI...
· Sign up or log in to comment
