Are any of the LLM's GPU accelerated in V3 at this time?

#1
by BoscoTheDog - opened

Just curious. I keep looking for a small GPU accelerated model with a large context to do summaries of documents.

Sign up or log in to comment