| GGUF Quants with iMatrix for the following model : https://huggingface.co/TomGrc/FusionNet_34Bx2_MoE_v0.1 | |
| --- | |
| Benchs of the previous version (https://huggingface.co/TomGrc/FusionNet_34Bx2_MoE) : | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,Arc-Challenge,54.18060201,,299,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,Arc-Easy,75.08771930,,570,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,Hellaswag,83,400,2024-01-27 00:00:00,,70b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,Hellaswag_Bin,78.25,400,2024-01-27 00:00:00,,70b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,MMLU,40.25559105,,313,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,Thruthful-QA,43.08445532,,817,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,Winogrande,77.6638,,1267,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,wikitext,6.1287,512,81,2024-01-27 00:00:00,,70b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| - fusionnet_34bx2_moe.Q2_K.gguf,-,wikitext,5.8446,4096,21,2024-01-27 00:00:00,,70b,Llama_2,4096,,,GGUF,TomGrc,TheBloke, | |
| Benchs of this version : | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,Arc-Challenge,58.86287625,,299,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,Arc-Easy,77.19298246,,570,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,Hellaswag,85,400,2024-01-27 00:00:00,,70b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,Hellaswag_Bin,79.5,400,2024-01-27 00:00:00,,70b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,MMLU,42.49201278,,313,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,Thruthful-QA,45.16523868,,817,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,Winogrande,79.0055,,1267,2024-01-27 05:40:00,,01.3b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,wikitext,5.8015,512,512,2024-01-27 00:00:00,,70b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, | |
| - FusionNet_34Bx2_MoE_v0.1-b2054-iMat-c32_ch500-Q2_K.gguf,-,wikitext,10.0340,4096,21,2024-01-27 00:00:00,,70b,Llama_2,4096,,,GGUF,TomGrc,Nexesenex, |