mradermacher/model_requests
Updated
•
88
bndp
bndp
·
AI & ML interests
None yet
Recent Activity
reacted
to
csabakecskemeti's
post
with 👍
29 days ago
I'm collecting llama-bench results for inference with a llama 3.1 8B q4 and q8 reference models on varoius GPUs. The results are average of 5 executions.
The system varies (different motherboard and CPU ... but that probably that has little effect on the inference performance).
https://devquasar.com/gpu-gguf-inference-comparison/
the exact models user are in the page
I'd welcome results from other GPUs is you have access do anything else you've need in the post. Hopefully this is useful information everyone.
upvoted
an
article
about 1 month ago
Open R1: How to use OlympicCoder locally for coding?
Organizations
None yet
bndp's activity
liked
a
model
about 1 month ago
liked
a
Space
about 1 month ago
liked
2
models
about 2 months ago
liked
a
Space
about 2 months ago