Create README.md

README.md

@@ -0,0 +1,21 @@
+# Roberta-Pubhealth model
+
+This model is a fine-tuned version of [RoBERTa Base](https://huggingface.co/roberta-base) on the health_fact dataset.
+It achieves the following results on the evaluation set:
+- accuracy: 
+- micro f1:
+- macro f1:
+- weighted f1:
+- model efficiency: 
+
+## Dataset desctiption
+[PUBHEALTH](https://huggingface.co/datasets/health_fact)is a comprehensive dataset for explainable automated fact-checking of public health claims. Each instance in the PUBHEALTH dataset has an associated veracity label (true, false, unproven, mixture). Furthermore each instance in the dataset has an explanation text field. The explanation is a justification for which the claim has been assigned a particular veracity label.
+
+## Training hyperparameters
+
+The model are trained with the following tuned config:
+- model: roberta base
+- batch size: 32
+- learning rate: 5e-5
+- number of epochs: 5
+- warmup steps: 500