Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Column Request(s): VRAM usage, avg speed per inference,
#13
by
russ771
- opened
Stats like these would help people like me that want to make things smaller, more performant, and increase widespread use for average consumers.
...and (max) context window length, for people who need to use large prompts.
Hi! Most information you could want related to this will be in the LLM performance leaderboard
clefourrier
changed discussion status to
closed