view post Post 1007 @FinancialSupport and I just released a new version of the Italian LLMs leaderboard FinancialSupport/open_ita_llm_leaderboard using the super useful https://huggingface.co/demo-leaderboard template from @clefourrier . We’ve evaluated over 50 models (base, merged, fine-tuned, etc.) from:- Major companies like Meta, Mistral, Google ... - University groups such as https://huggingface.co/sapienzanlp or https://huggingface.co/swap-uniba- Italian Companies like https://huggingface.co/MoxoffSpA , https://huggingface.co/FairMind or https://huggingface.co/raicrits - Various communities and individuals All models were tested on #Italian benchmarks #mmlu #arc-c #hellaswag, which we contributed to the opensource lm-evaluation-harness library from https://huggingface.co/EleutherAI. Plus, you can now submit your model for automatic evaluation, thanks to to https://huggingface.co/seeweb sponsored computation.Curious about the top Italian models? Check out the leaderboard and submit your model! FinancialSupport/open_ita_llm_leaderboard
view post Post 1509 @mik3ml just released ReDiX/wikipediaQA-ita an interesting synthetic dataset originated from wikipedia using a fine tuned version of mistral-7B specific for the Italian language 🇮🇹 .