Text Classification
Transformers
PyTorch
Safetensors
English
bert
Inference Endpoints
Edit model card

Model Card for Model ID

This modelcard aims to be a base template for new models. It has been generated using this raw template.

Model Details

Model Description

  • Developed by: CHERGUELAINE Ayoub & BOUBEKRI Faycal
  • Shared by [optional]: HuggingFace
  • Model type: Language model
  • Language(s) (NLP): en
  • License: [More Information Needed]
  • Finetuned from model [optional]: ESG-Bert

Model Sources [optional]

Recommendations

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Training Details

Training Data

(AyoubChLin/20NewsGroup-AgNews-CnnNews)[https://huggingface.co/datasets/AyoubChLin/20NewsGroup-AgNews-CnnNews]

Fine-tuning hyper-parameters
  • learning_rate = 4e-5
  • batch_size = 8
  • max_seq_length = 256
  • num_train_epochs = 2.0

Testing Data

CNN-NEWS-Article

ag_news

Metrics

Accuracy

Results


CNN-NEWS-Article 0.957791 / LOSS : 0.197338


ag_news 0.9417105 / LOSS : 0.25715


Summary

Downloads last month
8
Safetensors
Model size
109M params
Tensor type
I64
·
F32
·

Datasets used to train AyoubChLin/news-ESG-Bert