superspray commited on
Commit
e6d6c12
1 Parent(s): ef20824

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -1 +1,27 @@
1
- dd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Question & Answering Model for 'Save Your Minutes' from Dobby-AI
2
+ Distilbert_Base fine-tuned on SQuAD2.0 and custom QA dataset
3
+
4
+ This model is [twmkn9/distilbert-base-uncased-squad2] trained on additional custom dataset as:
5
+ ```
6
+ !python3 run_squad.py --model_type distilbert \
7
+ --model_name_or_path /content/distilbert_base_384 \
8
+ --do_lower_case \
9
+ --output_dir /content/model/\
10
+ --do_train \
11
+ --train_file $data_dir/additional_qa.json\
12
+ --version_2_with_negative \
13
+ --do_lower_case \
14
+ --num_train_epochs 3 \
15
+ --weight_decay 0.01 \
16
+ --learning_rate 3e-5 \
17
+ --max_grad_norm 0.5 \
18
+ --adam_epsilon 1e-6 \
19
+ --max_seq_length 512 \
20
+ --doc_stride 128 \
21
+ --threads 12 \
22
+ --logging_steps 50 \
23
+ --save_steps 1000 \
24
+ --overwrite_output_dir \
25
+ --per_gpu_train_batch_size 4
26
+ ```
27
+ We used Google Colab for training the model,