Report for Sydelabs/detectors_legit_user

#138
by giskard-bot - opened
Giskard org

Hi Team,

This is a report from Giskard Bot Scan 🐢.

We have identified 1 potential vulnerabilities in your model based on an automated scan.

This automated analysis evaluated the model on the dataset sst2 (subset default, split validation).

👉Performance issues (1)

For records in the dataset where text contains "film", the Accuracy is 18.16% lower than the global Accuracy.

Level Data slice Metric Deviation
major 🔴 text contains "film" Accuracy = 0.402 -18.16% than global

Taxonomy

avid-effect:performance:P0204
🔍✨Examples
text label Predicted label
5 although laced with humor and a few fanciful touches , the film is a refreshingly serious look at young women . LABEL_1 LABEL_0 (p = 1.00)
8 you do n't have to know about music to appreciate the film 's easygoing blend of comedy and romance . LABEL_1 LABEL_0 (p = 0.97)
10 the mesmerizing performances of the leads keep the film grounded and keep the audience riveted . LABEL_1 LABEL_0 (p = 0.99)

Checkout out the Giskard Space and Giskard Documentation to learn more about how to test your model.

Disclaimer: it's important to note that automated scans may produce false positives or miss certain vulnerabilities. We encourage you to review the findings and assess the impact accordingly.

Sign up or log in to comment