ringoreality commited on
Commit
12c73e8
1 Parent(s): 9d69232

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -28,7 +28,7 @@ It is also possible to evaluate the model with https://github.com/EleutherAI/lm-
28
  ## Training
29
  - For the Llama2 training data, we refer the user to https://huggingface.co/meta-llama/Llama-2-70b-hf.
30
  - For continued pretraining, 4.2B climate domain tokens (tokenized by the Llama tokenizer) are used.
31
- - For instruction finetuning, about 1.1B instruction-finetuning tokens (both in the climate domain but also general domain) are used.
32
 
33
  ## Environmental Impact
34
  - **Hardware Type:** H100
 
28
  ## Training
29
  - For the Llama2 training data, we refer the user to https://huggingface.co/meta-llama/Llama-2-70b-hf.
30
  - For continued pretraining, 4.2B climate domain tokens (tokenized by the Llama tokenizer) are used.
31
+ - For instruction finetuning, about 272K instruction-completion pairs (both in the climate domain but also general domain) are used.
32
 
33
  ## Environmental Impact
34
  - **Hardware Type:** H100