Update README.md
Browse files
README.md
CHANGED
|
@@ -43,14 +43,14 @@ As the scores range from 0 to 1, a performance measure such as RMSE may be chall
|
|
| 43 |
|
| 44 |
With a correlation of approximately 65 for the 560m model and approximately 80 for the 3b model, the output is highly correlated with the judges' scores.
|
| 45 |
|
| 46 |
-
Now we will focus on the MAE (Mean Absolute Error) score to measure the average gap of the estimation error.
|
| 47 |
-
|
| 48 |
-
| Model | Language | Obsecene
|
| 49 |
-
|
| 50 |
-
| [Bloomz-560m-guardrail](https://huggingface.co/cmarkea/bloomz-560m-guardrail) | French | 0.06
|
| 51 |
-
| [Bloomz-560m-guardrail](https://huggingface.co/cmarkea/bloomz-560m-guardrail) | English | 0.06
|
| 52 |
-
| [Bloomz-3b-guardrail](https://huggingface.co/cmarkea/bloomz-3b-guardrail) | French | 0.05
|
| 53 |
-
| [Bloomz-3b-guardrail](https://huggingface.co/cmarkea/bloomz-3b-guardrail) | English | 0.05
|
| 54 |
|
| 55 |
How to Use Blommz-3b-guardrail
|
| 56 |
--------------------------------
|
|
|
|
| 43 |
|
| 44 |
With a correlation of approximately 65 for the 560m model and approximately 80 for the 3b model, the output is highly correlated with the judges' scores.
|
| 45 |
|
| 46 |
+
Now we will focus on the MAE (Mean Absolute Error) score to measure the average gap of the estimation error with the error standard deviation.
|
| 47 |
+
|
| 48 |
+
| Model | Language | Obsecene | Sexual explicit | Identity attack | Insult | Threat | Mean |
|
| 49 |
+
|-------------------------------------------------------------------------------|----------|:------------------:|-----------------------|----------------------|--------------------|--------------------|--------------------|
|
| 50 |
+
| [Bloomz-560m-guardrail](https://huggingface.co/cmarkea/bloomz-560m-guardrail) | French | 0.06 ± 0.09 | 0.03 ± 0.07 | 0.03 ± 0.07 | 0.13 ± 0.13 | 0.04 ± 0.06 | 0.06 ± 0.08 |
|
| 51 |
+
| [Bloomz-560m-guardrail](https://huggingface.co/cmarkea/bloomz-560m-guardrail) | English | 0.06 ± 0.09 | 0.03 ± 0.08 | 0.03 ± 0.08 | 0.14 ± 0.13 | 0.04 ± 0.07 | 0.06 ± 0.09 |
|
| 52 |
+
| [Bloomz-3b-guardrail](https://huggingface.co/cmarkea/bloomz-3b-guardrail) | French | 0.05 ± 0.08 | 0.02 ± 0.06 | 0.02 ± 0.06 | 0.11 ± 0.11 | 0.03 ± 0.05 | 0.05 ± 0.07 |
|
| 53 |
+
| [Bloomz-3b-guardrail](https://huggingface.co/cmarkea/bloomz-3b-guardrail) | English | 0.05 ± 0.08 | 0.03 ± 0.07 | 0.02 ± 0.06 | 0.12 ± 0.11 | 0.03 ± 0.05 | 0.05 ± 0.07 |
|
| 54 |
|
| 55 |
How to Use Blommz-3b-guardrail
|
| 56 |
--------------------------------
|