Usage with transformers?
#1
by
kye
- opened
How can I use this on transformers models or is it custom install?
Thank you for your interest in SPHINX!
SPHINX currently does not support in transformer. Please refer to the Github URL: https://github.com/Alpha-VLLM/LLaMA2-Accessory/tree/main/SPHINX#inference for environment preparation and model inference.