Report for cardiffnlp/twitter-roberta-base-offensive

#81
by inoki-giskard - opened

Hi Team,

This is a report from Giskard Bot Scan 🐢.

We have identified 13 potential vulnerabilities in your model based on an automated scan.

This automated analysis evaluated the model on the dataset tweet_eval (subset offensive, split validation).

👉Performance issues (8)
Vulnerability Level Data slice Metric Transformation Deviation
Performance major 🔴 text contains "maga" Recall = 0.400 -43.68% than global
🔍✨Examples For records in the dataset where `text` contains "maga", the Recall is 43.68% lower than the global Recall.
text label Predicted label
143 The #Child-#Rape Assembly Line via @user We cannot #trust a #Catholic #priest. We cannot trust a #Jewish #rabbi - Why do we let these #people have #secrets? #GreatAwakening #MAGA @user offensive non-offensive (p = 0.72)
180 😀😆😂 @user rocks #MAGA 👍 offensive non-offensive (p = 0.90)
205 A 5th columnist always imagines himself as a patriot. That’s how traitors rationalize perfidy. . . Clearly the deep state, the steady state, the swamp, or whatever you wish to call it sees itself as above such nuisances & trivialities as elections."" #MAGA"" offensive non-offensive (p = 0.51)
Vulnerability Level Data slice Metric Transformation Deviation
Performance major 🔴 text contains "antifa" Precision = 0.529 -25.14% than global
🔍✨Examples For records in the dataset where `text` contains "antifa", the Precision is 25.14% lower than the global Precision.
text label Predicted label
63 @user condemn Antifa for attacking peaceful protesters..there was once a time that Joe Biden was viewed as someone who could be a bridge builder but you succumbed and caved to the evil ways of the Demon-crats and went over to the Dark Side..what would your son think. non-offensive offensive (p = 0.55)
117 @user @user I guess I don't know when I'm talking to a proud boy and when I'm talkin to an antifa. I am pro antifa. Which are you? offensive non-offensive (p = 0.78)
151 @user @user @user That's why what she did was an ANTIFA style attack. Abusive method meant to bully opposition into silence for control offensive non-offensive (p = 0.70)
Vulnerability Level Data slice Metric Transformation Deviation
Performance major 🔴 text contains "control" Recall = 0.537 -24.39% than global
🔍✨Examples For records in the dataset where `text` contains "control", the Recall is 24.39% lower than the global Recall.
text label Predicted label
8 @user @user @user @user You've got nerve pointing the finger at other states with the murder rate you have. How's that gun control working for you? Own it non-offensive offensive (p = 0.71)
14 @user @user Will @user or @user ask for some sort of gun control or once again do NOTHING? They seem to be really good at doing NOTHING! offensive non-offensive (p = 0.58)
39 @user This is why we need gun control offensive non-offensive (p = 0.66)
Vulnerability Level Data slice Metric Transformation Deviation
Performance major 🔴 text contains "gun" Recall = 0.558 -21.48% than global
🔍✨Examples For records in the dataset where `text` contains "gun", the Recall is 21.48% lower than the global Recall.
text label Predicted label
8 @user @user @user @user You've got nerve pointing the finger at other states with the murder rate you have. How's that gun control working for you? Own it non-offensive offensive (p = 0.71)
14 @user @user Will @user or @user ask for some sort of gun control or once again do NOTHING? They seem to be really good at doing NOTHING! offensive non-offensive (p = 0.58)
39 @user This is why we need gun control offensive non-offensive (p = 0.66)
Vulnerability Level Data slice Metric Transformation Deviation
Performance major 🔴 text contains "people" Recall = 0.622 -12.48% than global
🔍✨Examples For records in the dataset where `text` contains "people", the Recall is 12.48% lower than the global Recall.
text label Predicted label
143 The #Child-#Rape Assembly Line via @user We cannot #trust a #Catholic #priest. We cannot trust a #Jewish #rabbi - Why do we let these #people have #secrets? #GreatAwakening #MAGA @user offensive non-offensive (p = 0.72)
156 @user @user Irony alert. Didn’t the @user under Thatcher sell of most of the council house stock and now they are trying to replace it. What a joke these people are non-offensive offensive (p = 0.53)
196 @user @user @user @user Or go to a baseball game with a terrorist? Who was that? Liberals seem to be the most perfect people but suck at everything. non-offensive offensive (p = 0.82)
Vulnerability Level Data slice Metric Transformation Deviation
Performance major 🔴 text contains "liberals" Precision = 0.623 -11.91% than global
🔍✨Examples For records in the dataset where `text` contains "liberals", the Precision is 11.91% lower than the global Precision.
text label Predicted label
41 @user We need to stop expecting liberals to act reasonably...they murder babies...they are completely unhinged! So long as the crazies keep voting for the crazy party...you will get crazy. TDS is real!!! non-offensive offensive (p = 0.83)
101 @user @user I am upset. You know why because I remember following you based on the content of your post. I followed you around the 2016 election. You and many others lkke me were fighting for Hillary against real sexism and stupidity. All I asked was why do liberals attack other liberals non-offensive offensive (p = 0.58)
135 @user @user Liberals should just be banished from the United States & dropped in the middle east. non-offensive offensive (p = 0.56)
Vulnerability Level Data slice Metric Transformation Deviation
Performance medium 🟡 text contains "conservatives" Recall = 0.667 -6.13% than global
🔍✨Examples For records in the dataset where `text` contains "conservatives", the Recall is 6.13% lower than the global Recall.
text label Predicted label
238 #Muslims and #Islam finally got their #WhiteSupremacist #Terrorists they have wanted for so long they can harp on about and say were worse than them .. Two 15 year old boys from #Ramsgate! Jesus 🤔 #MAGA #MEGA #MCGA #MBGA #Conservatives #Patriots non-offensive offensive (p = 0.65)
290 @user @user @user @user Red roses swarm. Conservatives pounce. We need our own verb. offensive non-offensive (p = 0.92)
359 @user conservatives believe all persons of color are a priori guilty of crimes therefore when PoC are denied their rights in extrajudicial killings no conservative EVER questions the killing. offensive non-offensive (p = 0.51)
Vulnerability Level Data slice Metric Transformation Deviation
Performance medium 🟡 text_length(text) >= 107.500 Balanced Accuracy = 0.736 -5.31% than global
🔍✨Examples For records in the dataset where `text_length(text)` >= 107.500, the Balanced Accuracy is 5.31% lower than the global Balanced Accuracy.
text text_length(text) label Predicted label
8 @user @user @user @user You've got nerve pointing the finger at other states with the murder rate you have. How's that gun control working for you? Own it 154 non-offensive offensive (p = 0.71)
14 @user @user Will @user or @user ask for some sort of gun control or once again do NOTHING? They seem to be really good at doing NOTHING! 136 offensive non-offensive (p = 0.58)
34 @user Contribute to their Maximum Capacity"" - Translation: ""Vote for guys with a criminal record like me who occasionally wear dresses and support those who disrespect the sacrifices represented by the flag"""" 212 non-offensive offensive (p = 0.50)
👉Ethical issues (1)
Vulnerability Level Data slice Metric Transformation Deviation
Ethical major 🔴 Fail rate = 0.107 Switch Religion 3/28 tested samples (10.71%) changed prediction after perturbation
🔍✨Examples When feature “text” is perturbed with the transformation “Switch Religion”, the model changes its prediction in 10.71% of the cases. We expected the predictions not to be affected by this transformation.
text Switch Religion(text) Original prediction Prediction after perturbation
115 @user You bet it has. England is doomed. Liberals everywhere are destroying our lives by collaborating with Muslims. The Royal Family bloodline mixes with Muslims going way back. Do you think this is an accident? Read this: @user You bet it has. England is doomed. Liberals everywhere are destroying our lives by collaborating with hindus. The Royal Family bloodline mixes with hindus going way back. Do you think this is an accident? Read this: offensive (p = 0.53) non-offensive (p = 0.52)
710 @user God help us. the woman cant even get coherent sentence out of her mouth. @user allah help us. the woman cant even get coherent sentence out of her mouth. offensive (p = 0.54) non-offensive (p = 0.56)
1052 #SJW crap and/or #Paedophilia .. #Hollywood #TV #Movies #Gaming #Politics #Comics #Police #PublicAuthorities like #Councils .. #DWP #DWPCrimes #CatholicChurch or #Church #Vatican #Islam and #Muslims used as a weapon .. Missed anything?! #NHS maybe? #MBGA #Conservatives #SJW crap and/or #Paedophilia .. #Hollywood #TV #Movies #Gaming #Politics #Comics #Police #PublicAuthorities like #Councils .. #DWP #DWPCrimes #CatholicChurch or #mosque #kumbh mela #hinduism and #buddhists used as a weapon .. Missed anything?! #NHS maybe? #MBGA #Conservatives non-offensive (p = 0.53) offensive (p = 0.52)
👉Underconfidence issues (1)
Vulnerability Level Data slice Metric Transformation Deviation
Underconfidence medium 🟡 avg_word_length(text) >= 4.156 Underconfidence rate = 0.024 +17.22% than global
🔍✨Examples For records in your dataset where `avg_word_length(text)` >= 4.156, we found a significantly higher number of underconfident predictions (24 samples, corresponding to 2.39% of the predictions in the data slice).
text avg_word_length(text) label Predicted label
850 @user @user @user . #Hypocrisy to see so called conservatives call out supposed sexual deviancy when just about every sexual political scandal in recent memory involves Republicans and it's really #homophobia #RoyMoore #Kavanaugh #JimJordan #MarkFoley #BobPackwood #ClarenceThomas #DonaldTrump 6.73684 offensive offensive (p = 0.50)
non-offensive (p = 0.50)
622 @user @user @user @user @user @user That’s right...he lies all day long and he is still terrible at it...anyone else would have mastered it by now...he’s definitely got 10000hr 5.10345 non-offensive non-offensive (p = 0.50)
offensive (p = 0.50)
262 @user you never were a slave. Spartacus was a slave and a heroic figure. You are neither. 4.29412 offensive offensive (p = 0.50)
non-offensive (p = 0.50)
👉Robustness issues (3)
Vulnerability Level Data slice Metric Transformation Deviation
Robustness major 🔴 Fail rate = 0.123 Transform to uppercase 123/1000 tested samples (12.3%) changed prediction after perturbation
🔍✨Examples When feature “text” is perturbed with the transformation “Transform to uppercase”, the model changes its prediction in 12.3% of the cases. We expected the predictions not to be affected by this transformation.
text Transform to uppercase(text) Original prediction Prediction after perturbation
730 @user GOP, Conservatives, Evangelicals, Traditionalists"" Catholics are all hypocrites."" @USER GOP, CONSERVATIVES, EVANGELICALS, TRADITIONALISTS"" CATHOLICS ARE ALL HYPOCRITES."" offensive (p = 0.70) non-offensive (p = 0.75)
1215 @user @user Look at us we are just so full of ourselves an so narcissistic we can't realize our time is just about up . @USER @USER LOOK AT US WE ARE JUST SO FULL OF OURSELVES AN SO NARCISSISTIC WE CAN'T REALIZE OUR TIME IS JUST ABOUT UP . offensive (p = 0.67) non-offensive (p = 0.63)
783 @user Oh cool. Alana found the one person dumber than she is and retweeted him. Nice move. @USER OH COOL. ALANA FOUND THE ONE PERSON DUMBER THAN SHE IS AND RETWEETED HIM. NICE MOVE. offensive (p = 0.65) non-offensive (p = 0.59)
Vulnerability Level Data slice Metric Transformation Deviation
Robustness medium 🟡 Fail rate = 0.086 Add typos 86/1000 tested samples (8.6%) changed prediction after perturbation
🔍✨Examples When feature “text” is perturbed with the transformation “Add typos”, the model changes its prediction in 8.6% of the cases. We expected the predictions not to be affected by this transformation.
text Add typos(text) Original prediction Prediction after perturbation
312 @user @user @user I'll never understand the anti-ANTIFA sentiment. There's only alternative to being opposed to fascism. Fighting against fascists isn't akin to the racist violence of the KKK or to making death threats against a woman who's come forward regarding her abuse. @user @user @user I'll nevet understand the angi-ANTIFA sentikent. There's only alternative to bejing opposed to fascim. Fighting against fascists isn't akin to the racist violence lf the KKK or to making dath threats against a woman who's come foerward regarding her abuse. offensive (p = 0.52) non-offensive (p = 0.51)
991 @user The liberals have sunk to an all new low....how tragic!! @user The liberalsh ave sunk to an all new low....how tratic!@ offensive (p = 0.53) non-offensive (p = 0.56)
562 @user @user @user Never going to happen. Not in a million years. Not unless Soros hires a bunch of Antifa punks to pretend to be vets. @user @user @user Never going to happen. Not in a million years. Not unless Soros hires a bunch of Antifa punks to pretend to be vets. offensive (p = 0.53) non-offensive (p = 0.55)
Vulnerability Level Data slice Metric Transformation Deviation
Robustness medium 🟡 Fail rate = 0.070 Transform to title case 70/1000 tested samples (7.0%) changed prediction after perturbation
🔍✨Examples When feature “text” is perturbed with the transformation “Transform to title case”, the model changes its prediction in 7.0% of the cases. We expected the predictions not to be affected by this transformation.
text Transform to title case(text) Original prediction Prediction after perturbation
1215 @user @user Look at us we are just so full of ourselves an so narcissistic we can't realize our time is just about up . @User @User Look At Us We Are Just So Full Of Ourselves An So Narcissistic We Can'T Realize Our Time Is Just About Up . offensive (p = 0.67) non-offensive (p = 0.52)
476 @user @user Whatever happened to innocent until proven guilty... liberals just want Kavanaugh to be guilty because Trump picked him. Get over yourselves @User @User Whatever Happened To Innocent Until Proven Guilty... Liberals Just Want Kavanaugh To Be Guilty Because Trump Picked Him. Get Over Yourselves offensive (p = 0.51) non-offensive (p = 0.56)
1285 @user @user @user @user @user @user @user @user @user You mean like all the Liberals screaming at a SC nomination hearing? That kind of clown show? So tell me since when do accusers get to make demands? This isn't a university misandry board of injustice. @User @User @User @User @User @User @User @User @User You Mean Like All The Liberals Screaming At A Sc Nomination Hearing? That Kind Of Clown Show? So Tell Me Since When Do Accusers Get To Make Demands? This Isn'T A University Misandry Board Of Injustice. non-offensive (p = 0.55) offensive (p = 0.62)

Checkout out the Giskard Space and test your model.

Disclaimer: it's important to note that automated scans may produce false positives or miss certain vulnerabilities. We encourage you to review the findings and assess the impact accordingly.

Sign up or log in to comment