[REQUEST] More granular hardware details used against models

#88
by FamilyOrang - opened

I've noticed that the current hardware survey is not as granular as I thought, especially when local LLMs and local AI are trending right now. I want almost every CPU model added to account hardware details, and also add new features, like having separate setups or PCs, because I think most people have 2 or 3 PCs or different devices, and we should show ternary TOPS, int4 TOPS, int8 TOPS, uint4 TOPS, uint8 TOPS, FP4 TFLOPS, FP8 TFLOPS, FP16 TFLOPS, BF16 TFLOPS and FP32 TFLOPS. If I have the time to do it, I'll try to add more CPU models first, because I can only select "Ryzen Zen 2 3000 (Ryzen 5)" for AMD, not "Ryzen 5 3600".

image

For TOPS or TFLOPS, we should show int8 TOPS and BF16 TFLOPS on the main profile page.

Sign up or log in to comment