adarshxs commited on
Commit
3b895d0
·
verified ·
1 Parent(s): c32fb95

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -11
README.md CHANGED
@@ -19,6 +19,18 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [google/gemma-2b](https://huggingface.co/google/gemma-2b) on the [samvaad-hi-v1 dataset](https://huggingface.co/datasets/sarvamai/samvaad-hi-v1).
21
 
 
 
 
 
 
 
 
 
 
 
 
 
22
 
23
  ### Training hyperparameters
24
 
@@ -43,16 +55,5 @@ The following hyperparameters were used during training:
43
  - Pytorch 2.0.1+cu118
44
  - Datasets 2.16.1
45
  - Tokenizers 0.15.0
46
- # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
47
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Tensoic__Gemma-2B-Samvaad)
48
 
49
- | Metric |Value|
50
- |---------------------------------|----:|
51
- |Avg. |42.55|
52
- |AI2 Reasoning Challenge (25-Shot)|46.59|
53
- |HellaSwag (10-Shot) |68.17|
54
- |MMLU (5-Shot) |33.09|
55
- |TruthfulQA (0-shot) |39.95|
56
- |Winogrande (5-shot) |61.64|
57
- |GSM8k (5-shot) | 5.84|
58
 
 
19
 
20
  This model is a fine-tuned version of [google/gemma-2b](https://huggingface.co/google/gemma-2b) on the [samvaad-hi-v1 dataset](https://huggingface.co/datasets/sarvamai/samvaad-hi-v1).
21
 
22
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
23
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Tensoic__Gemma-2B-Samvaad)
24
+
25
+ | Metric |Value|
26
+ |---------------------------------|----:|
27
+ |Avg. |42.55|
28
+ |AI2 Reasoning Challenge (25-Shot)|46.59|
29
+ |HellaSwag (10-Shot) |68.17|
30
+ |MMLU (5-Shot) |33.09|
31
+ |TruthfulQA (0-shot) |39.95|
32
+ |Winogrande (5-shot) |61.64|
33
+ |GSM8k (5-shot) | 5.84|
34
 
35
  ### Training hyperparameters
36
 
 
55
  - Pytorch 2.0.1+cu118
56
  - Datasets 2.16.1
57
  - Tokenizers 0.15.0
 
 
58
 
 
 
 
 
 
 
 
 
 
59