Report for lvwerra/distilbert-imdb

#150
by ZeroCommand - opened
Giskard org

Hi Team,

This is a report from Giskard Bot Scan 🐢.

We have identified 6 potential vulnerabilities in your model based on an automated scan.

This automated analysis evaluated the model on the dataset imdb (subset plain_text, split test).

Giskard org
👉Performance issues (6)

For records in the dataset where text contains "awful", the Recall is 22.52% lower than the global Recall.

Level Data slice Metric Deviation
major 🔴 text contains "awful" Recall = 0.718 -22.52% than global

Taxonomy

avid-effect:performance:P0204
🔍✨Examples
text label Predicted label
37 The only reason this movie is not given a 1 (awful) vote is that the acting of both Ida Lupino and Robert Ryan is superb. Ida Lupino who is lovely, as usual, becomes increasingly distraught as she tries various means to rid herself of a madman. Robert Ryan is terrifying as the menacing stranger whose character, guided only by his disturbed mind, changes from one minute to the next. Seemingly simple and docile, suddenly he becomes clever and threatening. Ms. Lupino's character was in more danger from that house she lived in and her own stupidity than by anyone who came along. She could not manage to get out of her of her own house: windows didn't open, both front and back doors locked and unlocked from the inside with a key. You could not have designed a worse fire-trap if you tried. She did not take the precaution of having even one extra key. Nor could she figure out how to summon help from nearby neighbors or get out of her own basement while she was locked in and out of sight of her captor. I don't know what war her husband was killed in, but if it was World War II, the furnishings in her house, the styles of the clothes, especially the children and the telephone company repairman's car are clearly anachronistic. I recommend watching this movie just to see what oddities you can find. NEGATIVE POSITIVE (p = 0.57)
252 Breaking Dawn starts in a Californian college as Professor Simon (associate producer Joe Morton) tells his students that they have to perform an intensive six week study of a mental patient in Cape State Hospital as a crucial part of their education, fail & they will never become qualified Doctors. A bright, young, attractive & intelligent student named Eve (Kelly Overton) is given a particularly difficult patient to study. His name is Don Wake (James Haven) & is a convicted killer, he was found covered in blood besides the dead body of a woman (Diane Verona) & her young daughter (Jenette McCurdy). At first Don won't even look at Eve much less talk to her, but like the trooper she is Eve persists in trying to figure him out. Eventually Don begins to talk but what he says frightens Eve, he says that someone is watching her & mentions the name Malachay. Eve then begins to see a dark shadowy figure at her every turn, as Don churns out the conspiracy theories & bizarre statements Eve slowly begins to lose her mind as the line between fantasy & reality becomes more & more blurred. Is there something more to the supposed nonsense that Don talks other than being the insane ravings of a psychiatric patient...?

Written & directed by Mark Edwin Robinson I have nothing but negative feelings towards Breaking Dawn. Now, we all like a good twist ending, the sort of ending which catches us unawares, surprises us, works well with the rest of the film & stays in our memory like the cool twist endings to The Sixth Sense (1999) & Fight Club (1999) to name just two good examples & to a lesser extent the endings to films such as Scream (1996) where the identity of the killer comes a nice surprise & isn't that obvious. Then, of course, there are films whose endings spoil everything that has gone before & as an example lets take, oh I don't know lets say Breaking Dawn because I have never seen such an awful ending to a film, never. Breaking Dawn starts out as a decent psychological horror thriller with spooky things starting to happen to Eve, it's not the most action packed film ever by any stretch of the imagination but it holds ones interest, it's not the most absorbing film ever either but it is more than watchable & it's not that bad a film until the twist ending, I have to keep mentioning it because everything else up to that point (which was OK to be fair to it) suddenly becomes irrelevant. I am sure there are people out there who think they have this muddled mess of an ending figured out down to the last detail, all I can say is that no one will be able to explain this thing in a satisfactory way to me & as far as I'm concerned it doesn't make a bit of sense & never will. Breaking Dawn is crap & it's a waste of time watching it to be rewarded with the lamest ending in film history, it's as simple & straight forward as that.

Director Robinson doesn't half make a mess of what could have been a decent thriller, maybe he thought what he had shot would play out OK or maybe it was ruined in the editing room but I'd imagine it was more likely down to a rubbish script as he tries to tie all the absurdities together within the space of a few muddled minutes & give us all a happier than happy final shot. He builds the tension quite well during the first 80 odd minutes but it's all for nought at the end of the day.

Technically Breaking Dawn is fine & it is generally well made throughout. The acting is pretty good, Overton is nice & easy on the eyes & puts in a decent performance. Was it just me or did the guy who played Don look like John Morghen star of such Italian sleaze classics as Cannibal Apocalypse (1980), City of the Living Dead (1980), The House on the Edge of the Park (1980), Cannibal Ferox (1981), Stagefright (1987) & The Church (1989)? OK, maybe it was just me...

Breaking Dawn is rubbish, I hated it all because of the final few minutes. Don't get me wrong it wasn't exactly getting me excited up to that point but it was OK. Definitely one to avoid as far as I'm concerned although it seems to have it's fair share of positive comments on the IMDb...
NEGATIVE POSITIVE (p = 0.97)
1042 I was out-of-town, visiting an old friend. After dinner, talking, he expressed some reservations about his daughter's boy friend. She's 15, beautiful, smart, athletic, and the young man is also from an excellent family, nice, also athletic (if not as smart). I told him he might just be feeling the normal fatherly concerns; however, a few minutes later the young man arrived, with his DVD of this flick, which he had apparently been anxious for some time to share with the others.

These folks have a bona fide home theater set-up, with a screen something in excess of 4 feet, and the two young folks preceded to view it, while the young swain proceeded to extol its virtues almost frame-by-frame.

I saw enough in a few moments (and with some fascination in its awfulness) to endorse all of the most critical comments I've seen in scanning some here.

I told my friend I wouldn't go so far as to disqualify the young suitor solely on the basis of his liking this opus -- but it certainly seems to warrant his bearing close watch.

Some flicks are so-bad-they're-good: the classic "Plan 9 from Outer Space;" and, in my opinion, the wonderfully awful Bruce Jenner/Village People work, "Can't Stop the Music."

However, this one remains firmly simply in the awful category.

Second/third/fourth "bananas" -- even the best of these (e.g. Tim Conway, Don Knotts, everybody with Seinfeld) have great difficulty in carrying a later starring series (or, as here, film). And these were great supporting characters in their original situations.

The "Eddie" character, really at about the 5th- or 6th-banana level in the prior Griswald movies, and never added a whole lot to these, in my opinion. Randy Quaid is a capable actor who has delivered some good performances. His contribution to the prior "Vacation" pic's was average, at best. Both he and the other cast members, many of whom have done some good work in the past, accomplished nothing for their efforts here, except to derive a few years' house payments or some IRA contributions.

This whole presentation --- story, performances (from lead to support) couldn't be worse.
NEGATIVE POSITIVE (p = 0.81)

For records in the dataset where text contains "worse", the Recall is 11.7% lower than the global Recall.

Level Data slice Metric Deviation
major 🔴 text contains "worse" Recall = 0.818 -11.70% than global

Taxonomy

avid-effect:performance:P0204

Sign up or log in to comment