Daijobu.ai - Komainu - Content Moderator
Model created by Daijobu.ai. Daijobu.ai drives your business AI transformation. Learn More.
Model description
This model can identify 9 types of contents to be moderated.
Category | Output | Definition |
---|---|---|
sexual | 0 |
Content meant to arouse sexual excitement, such as the description of sexual activity, or that promotes sexual services (excluding sex education and wellness). |
hate | 1 |
Content that expresses, incites, or promotes hate based on race, gender, ethnicity, religion, nationality, sexual orientation, disability status, or caste. |
violence | 2 |
Content that promotes or glorifies violence or celebrates the suffering or humiliation of others. |
harassment | 3 |
Content that may be used to torment or annoy individuals in real life, or make harassment more likely to occur. |
self-harm | 4 |
Content that promotes, encourages, or depicts acts of self-harm, such as suicide, cutting, and eating disorders. |
sexual/minors | 5 |
Sexual content that includes an individual who is under 18 years old. |
hate/threatening | 6 |
Hateful content that also includes violence or serious harm towards the targeted group. |
violence/graphic | 7 |
Violent content that depicts death, violence, or serious physical injury in extreme graphic detail. |
fake news | 8 |
Fake news |
OK | 9 |
OK |
Intended uses & limitations
English language only. This model is a demonstrator, not intended for commercial or production use. Use with care.
Framework versions
- Transformers 4.40.2
- Pytorch 2.2.2+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1
Credits
This model is a fine-tuned version of cross-encoder/nli-deberta-v3-base on Daijobu.ai's content moderation dataset.
- Downloads last month
- 14
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for DaijobuAI/komainu-content-moderator
Base model
cross-encoder/nli-deberta-v3-base