lbourdois's picture
Add multilingual to the language tag
ac46010
metadata
language:
  - en
  - de
  - fr
  - it
  - nl
  - multilingual
license: mit
tags:
  - punctuation prediction
  - punctuation
datasets: wmt/europarl
metrics:
  - f1
widget:
  - text: Ho sentito che ti sei laureata il che mi fa molto piacere
    example_title: Italian
  - text: Tous les matins vers quatre heures mon p�re ouvrait la porte de ma chambre
    example_title: French
  - text: Ist das eine Frage Frau M�ller
    example_title: German
  - text: My name is Clara and I live in Berkeley California
    example_title: English

Work in progress

Classification report over all languages

             precision    recall  f1-score   support

           0       0.99      0.99      0.99  47903344
           .       0.94      0.95      0.95   2798780
           ,       0.85      0.84      0.85   3451618
           ?       0.88      0.85      0.87     88876
           -       0.61      0.32      0.42    157863
           :       0.72      0.52      0.60    103789

    accuracy                           0.98  54504270
   macro avg       0.83      0.75      0.78  54504270
weighted avg       0.98      0.98      0.98  54504270