Minibase commited on
Commit
b8a851f
·
verified ·
1 Parent(s): c83dc9e

Upload benchmarks.txt with huggingface_hub

Browse files
Files changed (1) hide show
  1. benchmarks.txt +42 -0
benchmarks.txt ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ================================================================================
2
+ DETOXIFY-MEDIUM MODEL BENCHMARK RESULTS
3
+ ================================================================================
4
+
5
+ 📊 EXECUTIVE SUMMARY
6
+ --------------------------------------------------
7
+ Benchmark Date: 2025-09-18 13:17:58
8
+ Model: Detoxify-Medium
9
+ Dataset: ParaDetox (https://github.com/s-nlp/paradetox)
10
+ Total Samples: 1011
11
+
12
+ 🎯 OVERALL PERFORMANCE METRICS
13
+ --------------------------------------------------
14
+ Toxicity Reduction: 0.178
15
+ Semantic Preservation: 0.561
16
+ Fluency: 0.929
17
+ Average Latency: 160.2ms
18
+ Original Toxicity: 0.196
19
+ Final Toxicity: 0.018
20
+
21
+ 📈 DATASET BREAKDOWN
22
+ --------------------------------------------------
23
+
24
+ 🔹 PARADETOX TOXIC NEUTRAL
25
+ Samples: 1000
26
+ Toxicity Reduction: 0.044
27
+ Semantic Preservation: 0.645
28
+ Fluency: 0.922
29
+ Latency: 156.2ms
30
+ Original Toxicity: 0.051
31
+ Final Toxicity: 0.007
32
+
33
+ 🔹 PARADETOX HIGH TOXICITY
34
+ Samples: 11
35
+ Toxicity Reduction: 0.313
36
+ Semantic Preservation: 0.477
37
+ Fluency: 0.936
38
+ Latency: 164.3ms
39
+ Original Toxicity: 0.342
40
+ Final Toxicity: 0.029
41
+
42
+ ================================================================================