Kevin Sydney
commited on
Commit
•
384b817
1
Parent(s):
db9094d
Set eval_sample_packing to false in mistral config.yaml (#1003)
Browse filesWithout eval_sampling_packing set to false, ValueError occurs with eval dataset split is too small for sample_packing.
examples/mistral/config.yml
CHANGED
@@ -17,6 +17,7 @@ output_dir: ./out
|
|
17 |
sequence_len: 8192
|
18 |
sample_packing: true
|
19 |
pad_to_sequence_len: true
|
|
|
20 |
|
21 |
wandb_project:
|
22 |
wandb_entity:
|
|
|
17 |
sequence_len: 8192
|
18 |
sample_packing: true
|
19 |
pad_to_sequence_len: true
|
20 |
+
eval_sample_packing: false
|
21 |
|
22 |
wandb_project:
|
23 |
wandb_entity:
|