superspray
commited on
Commit
•
e6d6c12
1
Parent(s):
ef20824
Update README.md
Browse files
README.md
CHANGED
@@ -1 +1,27 @@
|
|
1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Question & Answering Model for 'Save Your Minutes' from Dobby-AI
|
2 |
+
Distilbert_Base fine-tuned on SQuAD2.0 and custom QA dataset
|
3 |
+
|
4 |
+
This model is [twmkn9/distilbert-base-uncased-squad2] trained on additional custom dataset as:
|
5 |
+
```
|
6 |
+
!python3 run_squad.py --model_type distilbert \
|
7 |
+
--model_name_or_path /content/distilbert_base_384 \
|
8 |
+
--do_lower_case \
|
9 |
+
--output_dir /content/model/\
|
10 |
+
--do_train \
|
11 |
+
--train_file $data_dir/additional_qa.json\
|
12 |
+
--version_2_with_negative \
|
13 |
+
--do_lower_case \
|
14 |
+
--num_train_epochs 3 \
|
15 |
+
--weight_decay 0.01 \
|
16 |
+
--learning_rate 3e-5 \
|
17 |
+
--max_grad_norm 0.5 \
|
18 |
+
--adam_epsilon 1e-6 \
|
19 |
+
--max_seq_length 512 \
|
20 |
+
--doc_stride 128 \
|
21 |
+
--threads 12 \
|
22 |
+
--logging_steps 50 \
|
23 |
+
--save_steps 1000 \
|
24 |
+
--overwrite_output_dir \
|
25 |
+
--per_gpu_train_batch_size 4
|
26 |
+
```
|
27 |
+
We used Google Colab for training the model,
|