KoconJan commited on
Commit
db4cdbb
1 Parent(s): fc612ca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -4,9 +4,9 @@ Author: Jan Kocoń     🔗[LinkedIn](https://www.linkedin.com/in
4
 
5
  Changes concerning [Neuronovo/neuronovo-7B-v0.2](https://huggingface.co/Neuronovo/neuronovo-7B-v0.2):
6
 
7
- 1. **Training Dataset**: In addition to the "Intel/orca_dpo_pairs" dataset, this version incorporates a new dataset "mlabonne/chatml_dpo_pairs." The combined datasets enhance the model's capabilities in dialogues and interactive scenarios, further specializing it in natural language understanding and response generation.
8
 
9
- 2. **Tokenizer and Formatting**: The tokenizer now originates directly from the "Neuronovo/neuronovo-7B-v0.2" model.
10
 
11
  3. **Training Configuration**: The training approach has shifted from using `max_steps=200` to `num_train_epochs=1`. This represents a change in the training strategy, focusing on epoch-based training rather than a fixed number of steps.
12
 
 
4
 
5
  Changes concerning [Neuronovo/neuronovo-7B-v0.2](https://huggingface.co/Neuronovo/neuronovo-7B-v0.2):
6
 
7
+ 1. **Training Dataset**: In addition to the [Intel/orca_dpo_pairs](Intel/orca_dpo_pairs) dataset, this version incorporates a [mlabonne/chatml_dpo_pairs](https://huggingface.co/datasets/mlabonne/chatml_dpo_pairs). The combined datasets enhance the model's capabilities in dialogues and interactive scenarios, further specializing it in natural language understanding and response generation.
8
 
9
+ 2. **Tokenizer and Formatting**: The tokenizer now originates directly from the [Neuronovo/neuronovo-7B-v0.2](https://huggingface.co/Neuronovo/neuronovo-7B-v0.2) model.
10
 
11
  3. **Training Configuration**: The training approach has shifted from using `max_steps=200` to `num_train_epochs=1`. This represents a change in the training strategy, focusing on epoch-based training rather than a fixed number of steps.
12