Add Modeling for Jais Architecture to the Transformers repo
#2
by
beratcmn
- opened
Adding modelling for Jais similar to LLama models (https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py) would be very beneficial for custom engine integrations. By adding a modelling we can use engines such as VLLM and Text Generation Inference much more efficiently.
beratcmn
changed discussion title from
Add Modeling for Jais Architecture
to Add Modeling for Jais Architecture to the Transformers repo
It is in plans. Will update next month.