psinger commited on
Commit
ef8775e
1 Parent(s): 326b21d

Upload model card

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -15,7 +15,7 @@ thumbnail: https://h2o.ai/etc.clientlibs/h2o/clientlibs/clientlib-site/resources
15
 
16
  This model was trained using [H2O LLM Studio](https://github.com/h2oai/h2o-llmstudio).
17
  - Base model: [openlm-research/open_llama_13b](https://huggingface.co/openlm-research/open_llama_13b)
18
- - Dataset preparation: [OpenAssistant/oasst1](https://github.com/h2oai/h2o-llmstudio/blob/1935d84d9caafed3ee686ad2733eb02d2abfce57/app_utils/utils.py#LL1896C5-L1896C28) personalized
19
 
20
  ## Usage
21
 
@@ -173,6 +173,16 @@ LlamaForCausalLM(
173
 
174
  This model was trained using H2O LLM Studio and with the configuration in [cfg.yaml](cfg.yaml). Visit [H2O LLM Studio](https://github.com/h2oai/h2o-llmstudio) to learn how to train your own large language models.
175
 
 
 
 
 
 
 
 
 
 
 
176
  ## Disclaimer
177
 
178
  Please read this disclaimer carefully before using the large language model provided in this repository. Your use of the model signifies your agreement to the following terms and conditions.
 
15
 
16
  This model was trained using [H2O LLM Studio](https://github.com/h2oai/h2o-llmstudio).
17
  - Base model: [openlm-research/open_llama_13b](https://huggingface.co/openlm-research/open_llama_13b)
18
+
19
 
20
  ## Usage
21
 
 
173
 
174
  This model was trained using H2O LLM Studio and with the configuration in [cfg.yaml](cfg.yaml). Visit [H2O LLM Studio](https://github.com/h2oai/h2o-llmstudio) to learn how to train your own large language models.
175
 
176
+
177
+ ## Model Validation
178
+
179
+ Model validation results using [EleutherAI lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness).
180
+
181
+ ```bash
182
+ CUDA_VISIBLE_DEVICES=0 python main.py --model hf-causal-experimental --model_args pretrained=h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-13b --tasks openbookqa,arc_easy,winogrande,hellaswag,arc_challenge,piqa,boolq --device cuda &> eval.log
183
+ ```
184
+
185
+
186
  ## Disclaimer
187
 
188
  Please read this disclaimer carefully before using the large language model provided in this repository. Your use of the model signifies your agreement to the following terms and conditions.