| Visible device: cuda | |
| Seed used: 0 | |
| Batch size: 64 | |
| Epochs: 40 | |
| Learning rate: 1e-05 | |
| Entropy weight: 0.01 | |
| Regularization weight: 0.0 | |
| Only use multiwoz like domains: False | |
| Vectorizer: Data set used is multiwoz21 | |
| We filter state by active domains: True | |
| Vectorizer: Data set used is multiwoz21 | |
| Embedding semantic descriptions: True | |
| Embedded descriptions successfully. Size: torch.Size([338, 768]) | |
| Data set used for descriptions: multiwoz21 | |
| We use Roberta to embed actions. | |
| Didnt load a model | |
| Start training | |
| Epoch: 0 | |
| Precision: 0 | |
| Recall: 0 | |
| F1: 0 | |
| Best Precision: 0.0 | |
| Best Recall: 0.0 | |
| Best F1: 0.0 | |
| Epoch: 1 | |
| Precision: 0 | |
| Recall: 0 | |
| F1: 0 | |
| Best Precision: 0.0 | |
| Best Recall: 0.0 | |
| Best F1: 0.0 | |
| Epoch: 2 | |
| Average actions: 2.4348959922790527 | |
| Average target actions: 2.28125 | |
| Precision: 0.043010752688172046 | |
| Recall: 0.0425531914893617 | |
| F1: 0.04278074866310161 | |
| <<dialog policy>> epoch 2: saved network to mdl | |
| Best Precision: 0.043010752688172046 | |
| Best Recall: 0.0425531914893617 | |
| Best F1: 0.04278074866310161 | |
| Epoch: 3 | |
| Precision: 0.043010752688172046 | |
| Recall: 0.0425531914893617 | |
| F1: 0.04278074866310161 | |
| Best Precision: 0.043010752688172046 | |
| Best Recall: 0.0425531914893617 | |
| Best F1: 0.04278074866310161 | |
| Epoch: 4 | |
| Average actions: 2.4114584922790527 | |
| Average target actions: 2.7890625 | |
| Precision: 0.07058823529411765 | |
| Recall: 0.06382978723404255 | |
| F1: 0.06703910614525138 | |
| <<dialog policy>> epoch 4: saved network to mdl | |
| Best Precision: 0.07058823529411765 | |
| Best Recall: 0.06382978723404255 | |
| Best F1: 0.06703910614525138 | |
| Epoch: 5 | |
| Precision: 0.07058823529411765 | |
| Recall: 0.06382978723404255 | |
| F1: 0.06703910614525138 | |
| Best Precision: 0.07058823529411765 | |
| Best Recall: 0.06382978723404255 | |
| Best F1: 0.06703910614525138 | |
| Epoch: 6 | |
| Average actions: 2.1536459922790527 | |
| Average target actions: 2.5859375 | |
| Precision: 0.049079754601226995 | |
| Recall: 0.0425531914893617 | |
| F1: 0.045584045584045586 | |
| Best Precision: 0.07058823529411765 | |
| Best Recall: 0.06382978723404255 | |
| Best F1: 0.06703910614525138 | |
| Epoch: 7 | |
| Precision: 0.049079754601226995 | |
| Recall: 0.0425531914893617 | |
| F1: 0.045584045584045586 | |
| Best Precision: 0.07058823529411765 | |
| Best Recall: 0.06382978723404255 | |
| Best F1: 0.06703910614525138 | |
| Epoch: 8 | |
| Average actions: 2.15625 | |
| Average target actions: 2.5520834922790527 | |
| Precision: 0.07547169811320754 | |
| Recall: 0.06382978723404255 | |
| F1: 0.06916426512968299 | |
| <<dialog policy>> epoch 8: saved network to mdl | |
| Best Precision: 0.07547169811320754 | |
| Best Recall: 0.06382978723404255 | |
| Best F1: 0.06916426512968299 | |
| Epoch: 9 | |
| Precision: 0.07547169811320754 | |
| Recall: 0.06382978723404255 | |
| F1: 0.06916426512968299 | |
| Best Precision: 0.07547169811320754 | |
| Best Recall: 0.06382978723404255 | |
| Best F1: 0.06916426512968299 | |
| Epoch: 10 | |
| Average actions: 2.0572915077209473 | |
| Average target actions: 2.3489584922790527 | |
| Precision: 0.04516129032258064 | |
| Recall: 0.03723404255319149 | |
| F1: 0.04081632653061224 | |
| Best Precision: 0.07547169811320754 | |
| Best Recall: 0.06382978723404255 | |
| Best F1: 0.06916426512968299 | |
| Epoch: 11 | |
| Precision: 0.04516129032258064 | |
| Recall: 0.03723404255319149 | |
| F1: 0.04081632653061224 | |
| Best Precision: 0.07547169811320754 | |
| Best Recall: 0.06382978723404255 | |
| Best F1: 0.06916426512968299 | |
| Epoch: 12 | |
| Average actions: 1.984375 | |
| Average target actions: 2.5520834922790527 | |
| Precision: 0.08666666666666667 | |
| Recall: 0.06914893617021277 | |
| F1: 0.07692307692307691 | |
| <<dialog policy>> epoch 12: saved network to mdl | |
| Best Precision: 0.08666666666666667 | |
| Best Recall: 0.06914893617021277 | |
| Best F1: 0.07692307692307691 | |
| Epoch: 13 | |
| Precision: 0.08666666666666667 | |
| Recall: 0.06914893617021277 | |
| F1: 0.07692307692307691 | |
| Best Precision: 0.08666666666666667 | |
| Best Recall: 0.06914893617021277 | |
| Best F1: 0.07692307692307691 | |
| Epoch: 14 | |
| Average actions: 2.0416665077209473 | |
| Average target actions: 2.3828125 | |
| Precision: 0.05228758169934641 | |
| Recall: 0.0425531914893617 | |
| F1: 0.046920821114369494 | |
| Best Precision: 0.08666666666666667 | |
| Best Recall: 0.06914893617021277 | |
| Best F1: 0.07692307692307691 | |
| Epoch: 15 | |
| Precision: 0.05228758169934641 | |
| Recall: 0.0425531914893617 | |
| F1: 0.046920821114369494 | |
| Best Precision: 0.08666666666666667 | |
| Best Recall: 0.06914893617021277 | |
| Best F1: 0.07692307692307691 | |
| Epoch: 16 | |
| Average actions: 2.1666665077209473 | |
| Average target actions: 2.2135417461395264 | |
| Precision: 0.1346153846153846 | |
| Recall: 0.11170212765957446 | |
| F1: 0.12209302325581395 | |
| <<dialog policy>> epoch 16: saved network to mdl | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 17 | |
| Precision: 0.1346153846153846 | |
| Recall: 0.11170212765957446 | |
| F1: 0.12209302325581395 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 18 | |
| Average actions: 1.7734375 | |
| Average target actions: 2.5520834922790527 | |
| Precision: 0.0661764705882353 | |
| Recall: 0.047872340425531915 | |
| F1: 0.05555555555555556 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 19 | |
| Precision: 0.0661764705882353 | |
| Recall: 0.047872340425531915 | |
| F1: 0.05555555555555556 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 20 | |
| Average actions: 2.1328125 | |
| Average target actions: 2.6197917461395264 | |
| Precision: 0.1346153846153846 | |
| Recall: 0.11170212765957446 | |
| F1: 0.12209302325581395 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 21 | |
| Precision: 0.1346153846153846 | |
| Recall: 0.11170212765957446 | |
| F1: 0.12209302325581395 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 22 | |
| Average actions: 1.9296875 | |
| Average target actions: 2.1119792461395264 | |
| Precision: 0.08391608391608392 | |
| Recall: 0.06382978723404255 | |
| F1: 0.07250755287009063 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 23 | |
| Precision: 0.08391608391608392 | |
| Recall: 0.06382978723404255 | |
| F1: 0.07250755287009063 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 24 | |
| Average actions: 2.2213540077209473 | |
| Average target actions: 2.3151042461395264 | |
| Precision: 0.09815950920245399 | |
| Recall: 0.0851063829787234 | |
| F1: 0.09116809116809117 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 25 | |
| Precision: 0.09815950920245399 | |
| Recall: 0.0851063829787234 | |
| F1: 0.09116809116809117 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 26 | |
| Average actions: 2.1171875 | |
| Average target actions: 2.7890625 | |
| Precision: 0.12987012987012986 | |
| Recall: 0.10638297872340426 | |
| F1: 0.11695906432748537 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 27 | |
| Precision: 0.12987012987012986 | |
| Recall: 0.10638297872340426 | |
| F1: 0.11695906432748537 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 28 | |
| Average actions: 1.7734375 | |
| Average target actions: 2.484375 | |
| Precision: 0.08823529411764706 | |
| Recall: 0.06382978723404255 | |
| F1: 0.07407407407407407 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 29 | |
| Precision: 0.08823529411764706 | |
| Recall: 0.06382978723404255 | |
| F1: 0.07407407407407407 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 30 | |
| Average actions: 2.1822915077209473 | |
| Average target actions: 2.3489584922790527 | |
| Precision: 0.10126582278481013 | |
| Recall: 0.0851063829787234 | |
| F1: 0.09248554913294797 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 31 | |
| Precision: 0.10126582278481013 | |
| Recall: 0.0851063829787234 | |
| F1: 0.09248554913294797 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 32 | |
| Average actions: 2.0442707538604736 | |
| Average target actions: 2.6197917461395264 | |
| Precision: 0.12345679012345678 | |
| Recall: 0.10638297872340426 | |
| F1: 0.11428571428571428 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 33 | |
| Precision: 0.12345679012345678 | |
| Recall: 0.10638297872340426 | |
| F1: 0.11428571428571428 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 34 | |
| Average actions: 1.8307292461395264 | |
| Average target actions: 2.5859375 | |
| Precision: 0.11510791366906475 | |
| Recall: 0.0851063829787234 | |
| F1: 0.09785932721712538 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 35 | |
| Precision: 0.11510791366906475 | |
| Recall: 0.0851063829787234 | |
| F1: 0.09785932721712538 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11170212765957446 | |
| Best F1: 0.12209302325581395 | |
| Epoch: 36 | |
| Average actions: 2.2838540077209473 | |
| Average target actions: 2.3489584922790527 | |
| Precision: 0.1286549707602339 | |
| Recall: 0.11702127659574468 | |
| F1: 0.12256267409470752 | |
| <<dialog policy>> epoch 36: saved network to mdl | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11702127659574468 | |
| Best F1: 0.12256267409470752 | |
| Epoch: 37 | |
| Precision: 0.1286549707602339 | |
| Recall: 0.11702127659574468 | |
| F1: 0.12256267409470752 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11702127659574468 | |
| Best F1: 0.12256267409470752 | |
| Epoch: 38 | |
| Average actions: 1.9479167461395264 | |
| Average target actions: 2.7552084922790527 | |
| Precision: 0.12337662337662338 | |
| Recall: 0.10106382978723404 | |
| F1: 0.1111111111111111 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11702127659574468 | |
| Best F1: 0.12256267409470752 | |
| Epoch: 39 | |
| Precision: 0.12337662337662338 | |
| Recall: 0.10106382978723404 | |
| F1: 0.1111111111111111 | |
| Best Precision: 0.1346153846153846 | |
| Best Recall: 0.11702127659574468 | |
| Best F1: 0.12256267409470752 | |