Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

GGUF Quants with iMatrix for https://huggingface.co/brucethemoose/Yi-34B-200K-DARE-merge-v7

iMatrix made with 2500 batches of 32 tokens made on wiki.train.raw

Benchs made with LlamaCPP :

  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Hellaswag,85.25,,400,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Hellaswag_Bin,80,,400,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Arc-Challenge,57.19063545,,299,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Arc-Easy,79.12280702,,570,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,MMLU,38.91285591,,1159,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Thruthful-QA,33.41493268,19.8590,817,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,Winogrande,78.1373,,1267,2024-01-26 05:40:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,5.1353,512,512,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.5414,2048,2048,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.3967,4096,4096,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
  • Yi-34B-200K-DARE-merge-v7-AR-b1952-iMat-c32_ch2500-Q4_K_M.gguf,-,wikitext,4.4457,8192,8192,2024-01-26 00:00:00,,34b,Yi,2000000,,,GGUF,Brucethemoose,Nexesenex,
Downloads last month
115
GGUF
Model size
34.4B params
Architecture
llama
Unable to determine this model's library. Check the docs .