Microsoft Edge AI Evasion
Date: 2020-02-01
Affected: New Microsoft AI Product
Attack vector: adversarial-input
Category: research
Severity: High

The Azure Red Team performed a red team exercise on a new Microsoft product designed for running AI workloads at the edge. This exercise was meant to use an automated system to continuously manipulate a target image to cause the ML model to produce misclassifications.


Mitigations:

Architectural layers (MAESTRO):