Text Generation
Transformers
Safetensors
English
llama
conversational
Inference Endpoints
text-generation-inference

GPU setting value

#31
by WRBEAR - opened

I've tried using your AI development platform, but it seems that it's not utilizing GPU at all.

What settings do I need to change to run it locally using GPU?

upstage org

Can you provide more details? Thank you!

hunkim changed discussion status to closed

Sign up or log in to comment