Are any of the LLM's GPU accelerated in V3 at this time?
#1
by
BoscoTheDog
- opened
Just curious. I keep looking for a small GPU accelerated model with a large context to do summaries of documents.
Just curious. I keep looking for a small GPU accelerated model with a large context to do summaries of documents.