Adding Evaluation Results

README.md

@@ -1,12 +1,7 @@
 ---
-License: agpl-3.0
-Language:
-- En
-Pipeline_tag: text-generation
-Base_model: google/gemma-2-9b
-Tags:
-- Chat
 license: agpl-3.0
+tags:
+- chat
 datasets:
 - NewEden/Claude-Instruct-5K
 - anthracite-org/kalo-opus-instruct-22k-no-refusal
@@ -16,8 +11,108 @@ datasets:
 - Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned
 - anthracite-org/kalo_opus_misc_240827
 - anthracite-org/kalo_misc_part2
-tags:
-- chat
+License: agpl-3.0
+Language:
+- En
+Pipeline_tag: text-generation
+Base_model: google/gemma-2-9b
+Tags:
+- Chat
+model-index:
+- name: Odin-9B
+  results:
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: IFEval (0-Shot)
+      type: HuggingFaceH4/ifeval
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: inst_level_strict_acc and prompt_level_strict_acc
+      value: 36.92
+      name: strict accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Delta-Vector/Odin-9B
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: BBH (3-Shot)
+      type: BBH
+      args:
+        num_few_shot: 3
+    metrics:
+    - type: acc_norm
+      value: 34.83
+      name: normalized accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Delta-Vector/Odin-9B
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MATH Lvl 5 (4-Shot)
+      type: hendrycks/competition_math
+      args:
+        num_few_shot: 4
+    metrics:
+    - type: exact_match
+      value: 12.54
+      name: exact match
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Delta-Vector/Odin-9B
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: GPQA (0-shot)
+      type: Idavidrein/gpqa
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: acc_norm
+      value: 12.19
+      name: acc_norm
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Delta-Vector/Odin-9B
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MuSR (0-shot)
+      type: TAUR-Lab/MuSR
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: acc_norm
+      value: 17.56
+      name: acc_norm
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Delta-Vector/Odin-9B
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MMLU-PRO (5-shot)
+      type: TIGER-Lab/MMLU-Pro
+      config: main
+      split: test
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 33.85
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Delta-Vector/Odin-9B
+      name: Open LLM Leaderboard
 ---
 
 ![](https://huggingface.co/Delta-Vector/Odin-9B/resolve/main/FinalOdin9B.jpg)
@@ -207,3 +302,17 @@ The training was done for 4 epochs. We used  8 x [H100s](https://www.nvidia.com/
 ## Safety
 
 Nein. 
+
+# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
+Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Delta-Vector__Odin-9B)
+
+|      Metric       |Value|
+|-------------------|----:|
+|Avg.               |24.65|
+|IFEval (0-Shot)    |36.92|
+|BBH (3-Shot)       |34.83|
+|MATH Lvl 5 (4-Shot)|12.54|
+|GPQA (0-shot)      |12.19|
+|MuSR (0-shot)      |17.56|
+|MMLU-PRO (5-shot)  |33.85|
+