abuelnasr commited on
Commit
b223c1d
1 Parent(s): e2c7077

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ Model config:
14
  * **layer_norm_epsilon:** 1e-05
15
  * **dropout:** 0.0
16
  * **max_sequence_length:** 4096
17
- * **original_max_sequence_length:** 4096
18
  * **rope_max_wavelength:** 10000.0
19
  * **rope_scaling_type:** None
20
  * **rope_scaling_short_factor:** None
 
14
  * **layer_norm_epsilon:** 1e-05
15
  * **dropout:** 0.0
16
  * **max_sequence_length:** 4096
17
+ * **training_sequence_length:** 4096
18
  * **rope_max_wavelength:** 10000.0
19
  * **rope_scaling_type:** None
20
  * **rope_scaling_short_factor:** None