Question Answering
Transformers
PyTorch
English
llama
text-generation
biology
medical
Inference Endpoints
text-generation-inference

OpenVINO IR model

#1
by fakezeta - opened

Hi,
thank you for your work: I find it excellent!

I converted your model to OpenVINO IR with the information to use it in LocalAI

fakezeta/Llama3-Aloe-8B-Alpha-ov-int8

High Performance Artificial Intelligence @ Barcelona Supercomputing Center org

That's great! Thanks.
Stay tuned as we will soon update Aloe Alpha 8B model to use the new tokenizer.

I'll hold my breath!

G-AshwinKumar changed discussion status to closed

Sign up or log in to comment