Mistral-7B-v0.2-instruct-onmt-awq-gemm / mmlu_results_mistral-instruct-v0.2-onmt-awq-gemm.txt
vince62s's picture
Upload 4 files
39553d6
ACC-abstract_algebra: 0.3000
ACC-anatomy: 0.5481
ACC-astronomy: 0.5987
ACC-business_ethics: 0.5200
ACC-clinical_knowledge: 0.6642
ACC-college_biology: 0.6597
ACC-college_chemistry: 0.4300
ACC-college_computer_science: 0.5200
ACC-college_mathematics: 0.3300
ACC-college_medicine: 0.5838
ACC-college_physics: 0.4706
ACC-computer_security: 0.7000
ACC-conceptual_physics: 0.5149
ACC-econometrics: 0.3947
ACC-electrical_engineering: 0.5655
ACC-elementary_mathematics: 0.3810
ACC-formal_logic: 0.3889
ACC-global_facts: 0.3800
ACC-high_school_biology: 0.6258
ACC-high_school_chemistry: 0.4926
ACC-high_school_computer_science: 0.6100
ACC-high_school_european_history: 0.7273
ACC-high_school_geography: 0.7424
ACC-high_school_government_and_politics: 0.8394
ACC-high_school_macroeconomics: 0.5641
ACC-high_school_mathematics: 0.3185
ACC-high_school_microeconomics: 0.6807
ACC-high_school_physics: 0.3113
ACC-high_school_psychology: 0.7817
ACC-high_school_statistics: 0.4537
ACC-high_school_us_history: 0.7353
ACC-high_school_world_history: 0.7595
ACC-human_aging: 0.6368
ACC-human_sexuality: 0.7328
ACC-international_law: 0.7769
ACC-jurisprudence: 0.7315
ACC-logical_fallacies: 0.7423
ACC-machine_learning: 0.4286
ACC-management: 0.7184
ACC-marketing: 0.8547
ACC-medical_genetics: 0.6700
ACC-miscellaneous: 0.7752
ACC-moral_disputes: 0.6618
ACC-moral_scenarios: 0.3385
ACC-nutrition: 0.6699
ACC-philosophy: 0.6656
ACC-prehistory: 0.6543
ACC-professional_accounting: 0.4645
ACC-professional_law: 0.4374
ACC-professional_medicine: 0.5993
ACC-professional_psychology: 0.6209
ACC-public_relations: 0.6727
ACC-security_studies: 0.7347
ACC-sociology: 0.6716
ACC-us_foreign_policy: 0.7900
ACC-virology: 0.4759
ACC-world_religions: 0.8187
ACC-all: 0.5849
[2023-12-26 21:44:27,219 INFO] total run time 2379.34