Update README.md

README.md

@@ -27,6 +27,36 @@ Trained on wikipedia datasets:
 - [Graphcore/wikipedia-bert-128](https://huggingface.co/datasets/Graphcore/wikipedia-bert-128)
 - [Graphcore/wikipedia-bert-512](https://huggingface.co/datasets/Graphcore/wikipedia-bert-512)
 
+## Fine-tuning with these weights
+
+These weights can be used in either `transformers` or [`optimum-graphcore`](https://github.com/huggingface/optimum-graphcore).
+
+For example, to fine-tune the GLUE task SST2 with `optimum-graphcore` you can do:
+
+```
+export TOKENIZERS_PARALLELISM=true
+python examples/text-classification/run_glue.py \
+  --model_name_or_path bert-base-uncased \
+  --ipu_config_name Graphcore/bert-base-ipu \
+  --task_name sst2 \
+  --do_train \
+  --do_eval \
+  --max_seq_length 128 \
+  --per_device_train_batch_size 1 \
+  --per_device_eval_batch_size 4 \
+  --gradient_accumulation_steps 32 \
+  --pod_type pod4 \
+  --learning_rate 2e-5 \
+  --lr_scheduler_type linear \
+  --warmup_ratio 0.25 \
+  --num_train_epochs 3 \
+  --seed 1984 \
+  --save_steps -1 \
+  --dataloader_num_workers 64 \
+  --dataloader_drop_last \
+  --overwrite_output_dir \
+  --output_dir /tmp/sst2
+```
 
 ## Training procedure
 
@@ -133,35 +163,4 @@ The following hyperparameters were used during phase 2 training:
 - Transformers 4.17.0.dev0
 - Pytorch 1.10.0+cpu
 - Datasets 1.18.3.dev0
-- Tokenizers 0.10.3
-
-## Fine-tuning with these weights
-
-These weights can be used in either `transformers` or [`optimum-graphcore`](https://github.com/huggingface/optimum-graphcore).
-
-For example, to fine-tune the GLUE task SST2 with `optimum-graphcore` you can do:
-
-```
-export TOKENIZERS_PARALLELISM=true
-python examples/text-classification/run_glue.py \
-  --model_name_or_path bert-base-uncased \
-  --ipu_config_name Graphcore/bert-base-ipu \
-  --task_name sst2 \
-  --do_train \
-  --do_eval \
-  --max_seq_length 128 \
-  --per_device_train_batch_size 1 \
-  --per_device_eval_batch_size 4 \
-  --gradient_accumulation_steps 32 \
-  --pod_type pod4 \
-  --learning_rate 2e-5 \
-  --lr_scheduler_type linear \
-  --warmup_ratio 0.25 \
-  --num_train_epochs 3 \
-  --seed 1984 \
-  --save_steps -1 \
-  --dataloader_num_workers 64 \
-  --dataloader_drop_last \
-  --overwrite_output_dir \
-  --output_dir /tmp/sst2
-```
+- Tokenizers 0.10.3