Spaces:
Running
Running
Report for Sydelabs/detectors_legit_user
#138
by
giskard-bot
- opened
Hi Team,
This is a report from Giskard Bot Scan 🐢.
We have identified 1 potential vulnerabilities in your model based on an automated scan.
This automated analysis evaluated the model on the dataset sst2 (subset default, split validation).
👉Performance issues (1)
For records in the dataset where text contains "film", the Accuracy is 18.16% lower than the global Accuracy.
| Level | Data slice | Metric | Deviation |
|---|---|---|---|
| major 🔴 | text contains "film" |
Accuracy = 0.402 | -18.16% than global |
Taxonomy
avid-effect:performance:P0204🔍✨Examples
| text | label | Predicted label |
|
|---|---|---|---|
| 5 | although laced with humor and a few fanciful touches , the film is a refreshingly serious look at young women . | LABEL_1 | LABEL_0 (p = 1.00) |
| 8 | you do n't have to know about music to appreciate the film 's easygoing blend of comedy and romance . | LABEL_1 | LABEL_0 (p = 0.97) |
| 10 | the mesmerizing performances of the leads keep the film grounded and keep the audience riveted . | LABEL_1 | LABEL_0 (p = 0.99) |
Checkout out the Giskard Space and Giskard Documentation to learn more about how to test your model.
Disclaimer: it's important to note that automated scans may produce false positives or miss certain vulnerabilities. We encourage you to review the findings and assess the impact accordingly.