Benchs are a clean sheet.

#2
by Nexesenex - opened

Yours :

MiquMaid-v1-70B.q3_k_m.gguf,-,Hellaswag,89.25,,400,2024-02-01 01:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,Hellaswag,88,,1000,2024-02-01 01:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,Hellaswag_Bin,82.25,,400,2024-02-01 01:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,Hellaswag_Bin,85,,1000,2024-02-01 01:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,Arc-Challenge,56.85618729,,299,2024-02-01 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,Arc-Easy,76.31578947,,570,2024-02-01 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,MMLU,49.84025559,,313,2024-02-01 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,Thruthful-QA,40.88127295,,817,2024-02-01 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,Winogrande,79.0845,,1267,2024-02-01 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,
MiquMaid-v1-70B.q3_k_m.gguf,-,wikitext,3.8595,512,512,2024-02-01 01:40:00,70b,Mistral_Medium,32768,,,GGUF,NeverSleep,NeverSleep,655

Original's :

miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,Hellaswag,88.75,,400,2024-01-29 01:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,Hellaswag,88.1,,1000,2024-01-29 01:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,Hellaswag_Bin,82,,400,2024-01-29 01:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,Hellaswag_Bin,85.1,,1000,2024-01-29 01:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,Arc-Challenge,57.19063545,,299,2024-01-29 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,Arc-Easy,77.19298246,,570,2024-01-29 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,MMLU,50.15974441,,313,2024-01-29 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,Thruthful-QA,41.49326805,,817,2024-01-29 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,Winogrande,78.8477,,1267,2024-01-29 05:40:00,,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf,-,wikitext,3.8380,512,512,2024-01-29 01:40:00,RBF1000000,70b,Mistral_Medium,32768,,,GGUF,miqudev,Nexesenex,655

Remains for me to enjoy it, now! Thanks!

NeverSleep org

Thanks for the benchmark, I appreciate it!

Sign up or log in to comment