bert-base-ner-atc-en-atco2-1h / classification_report
Jzuluaga's picture
updating the repo with the fine-tuned model
60d9bc5
************* Report B/I tags*************
precision recall f1-score support
B-O 0.71 0.61 0.66 3106
B-callsign 0.85 0.89 0.87 2951
B-command 0.69 0.73 0.71 2357
B-value 0.58 0.55 0.56 3055
I-O 0.73 0.53 0.61 5403
I-callsign 0.92 0.92 0.92 8397
I-command 0.62 0.71 0.66 2795
I-value 0.73 0.85 0.78 7817
accuracy 0.76 35881
macro avg 0.73 0.72 0.72 35881
weighted avg 0.76 0.76 0.75 35881
************ Report with merged classes ***********
precision recall f1-score support
O 0.80 0.63 0.70 8509
callsign 0.93 0.95 0.94 11348
command 0.70 0.78 0.74 5152
value 0.77 0.85 0.81 10872
accuracy 0.82 35881
macro avg 0.80 0.80 0.80 35881
weighted avg 0.82 0.82 0.81 35881
JACCARD ERROR RATE (JER): [51.10824742 22.8462217 44.672 60.66494966 55.62913907 14.40397351
50.74626866 35.74402169]
JER - WEIGHTED : 37.89041510368749