Edit model card

Daijobu.ai - Komainu - Content Moderator

Komainu Content Moderator

Model created by Daijobu.ai. Daijobu.ai drives your business AI transformation. Learn More.

Model description

This model can identify 9 types of contents to be moderated.

Category Output Definition
sexual 0 Content meant to arouse sexual excitement, such as the description of sexual activity, or that promotes sexual services (excluding sex education and wellness).
hate 1 Content that expresses, incites, or promotes hate based on race, gender, ethnicity, religion, nationality, sexual orientation, disability status, or caste.
violence 2 Content that promotes or glorifies violence or celebrates the suffering or humiliation of others.
harassment 3 Content that may be used to torment or annoy individuals in real life, or make harassment more likely to occur.
self-harm 4 Content that promotes, encourages, or depicts acts of self-harm, such as suicide, cutting, and eating disorders.
sexual/minors 5 Sexual content that includes an individual who is under 18 years old.
hate/threatening 6 Hateful content that also includes violence or serious harm towards the targeted group.
violence/graphic 7 Violent content that depicts death, violence, or serious physical injury in extreme graphic detail.
fake news 8 Fake news
OK 9 OK

Intended uses & limitations

English language only. This model is a demonstrator, not intended for commercial or production use. Use with care.

Framework versions

  • Transformers 4.40.2
  • Pytorch 2.2.2+cu121
  • Datasets 2.19.1
  • Tokenizers 0.19.1

Credits

This model is a fine-tuned version of cross-encoder/nli-deberta-v3-base on Daijobu.ai's content moderation dataset.

Downloads last month
14
Safetensors
Model size
184M params
Tensor type
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for DaijobuAI/komainu-content-moderator

Finetuned
(1)
this model