AyoubChLin
commited on
Commit
•
f4a78ef
1
Parent(s):
5f6aa97
Update README.md
Browse files
README.md
CHANGED
@@ -14,28 +14,28 @@ tags:
|
|
14 |
- news classification
|
15 |
---
|
16 |
|
17 |
-
#
|
18 |
This is a Huggingface model fine-tuned on the CNN news dataset for zero-shot text classification task using DistilBART-MNLI. The model achieved an f1 score of 93% and an accuracy of 93% on the CNN test dataset with a maximum length of 128 tokens.
|
19 |
|
20 |
-
|
21 |
This work was done by [CHERGUELAINE Ayoub](https://www.linkedin.com/in/ayoub-cherguelaine/) & [BOUBEKRI Faycal](https://www.linkedin.com/in/faycal-boubekri-832848199/)
|
22 |
|
23 |
-
|
24 |
[valhalla/distilbart-mnli-12-1](https://huggingface.co/valhalla/distilbart-mnli-12-1)
|
25 |
|
26 |
-
|
27 |
The model architecture is based on the DistilBART-MNLI transformer model. DistilBART is a smaller and faster version of BART that is pre-trained on a large corpus of text and fine-tuned on downstream natural language processing tasks.
|
28 |
|
29 |
-
|
30 |
The CNN news dataset was used for fine-tuning the model. This dataset contains news articles from the CNN website and is labeled into 6 categories, including politics, health, entertainment, tech, travel, world, and sports.
|
31 |
|
32 |
-
|
33 |
The model was fine-tuned for 1 epoch on a maximum length of 256 tokens. The training took approximately 6 hours to complete.
|
34 |
|
35 |
-
|
36 |
The model achieved an f1 score of 93% and an accuracy of 93% on the CNN test dataset with a maximum length of 128 tokens.
|
37 |
|
38 |
-
|
39 |
The model can be used for zero-shot text classification tasks on news articles. It can be accessed via the Huggingface Transformers library using the following code:
|
40 |
|
41 |
```python
|
@@ -51,5 +51,5 @@ classifier = pipeline(
|
|
51 |
device=0
|
52 |
)
|
53 |
```
|
54 |
-
|
55 |
We would like to acknowledge the Huggingface team for their open-source implementation of transformer models and the CNN news dataset for providing the labeled dataset for fine-tuning.
|
|
|
14 |
- news classification
|
15 |
---
|
16 |
|
17 |
+
# distilBART-MNLI for ZeroShot-Text-Classification fine tuned on cnn news article
|
18 |
This is a Huggingface model fine-tuned on the CNN news dataset for zero-shot text classification task using DistilBART-MNLI. The model achieved an f1 score of 93% and an accuracy of 93% on the CNN test dataset with a maximum length of 128 tokens.
|
19 |
|
20 |
+
### Authors
|
21 |
This work was done by [CHERGUELAINE Ayoub](https://www.linkedin.com/in/ayoub-cherguelaine/) & [BOUBEKRI Faycal](https://www.linkedin.com/in/faycal-boubekri-832848199/)
|
22 |
|
23 |
+
#### Original Model
|
24 |
[valhalla/distilbart-mnli-12-1](https://huggingface.co/valhalla/distilbart-mnli-12-1)
|
25 |
|
26 |
+
#### Model Architecture
|
27 |
The model architecture is based on the DistilBART-MNLI transformer model. DistilBART is a smaller and faster version of BART that is pre-trained on a large corpus of text and fine-tuned on downstream natural language processing tasks.
|
28 |
|
29 |
+
#### Dataset
|
30 |
The CNN news dataset was used for fine-tuning the model. This dataset contains news articles from the CNN website and is labeled into 6 categories, including politics, health, entertainment, tech, travel, world, and sports.
|
31 |
|
32 |
+
#### Fine-tuning Parameters
|
33 |
The model was fine-tuned for 1 epoch on a maximum length of 256 tokens. The training took approximately 6 hours to complete.
|
34 |
|
35 |
+
#### Evaluation Metrics
|
36 |
The model achieved an f1 score of 93% and an accuracy of 93% on the CNN test dataset with a maximum length of 128 tokens.
|
37 |
|
38 |
+
### Usage
|
39 |
The model can be used for zero-shot text classification tasks on news articles. It can be accessed via the Huggingface Transformers library using the following code:
|
40 |
|
41 |
```python
|
|
|
51 |
device=0
|
52 |
)
|
53 |
```
|
54 |
+
#### Acknowledgments
|
55 |
We would like to acknowledge the Huggingface team for their open-source implementation of transformer models and the CNN news dataset for providing the labeled dataset for fine-tuning.
|