Inference server recommandation

by DeltaWhiplash - opened Sep 11, 2024

Sep 11, 2024

Hello I have an amd APU with ubuntu 24.04LTS
What inference software do you recommands for Q8 ?

Arcee AI org Sep 11, 2024

People like using ollama: https://ollama.com/

Sep 19, 2024

Oh I didn't see it's avaiable
Thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment