Social work AI transcription tools wrongly indicate suicidal ideation
Date: 2025
Affected: Beam; Microsoft
Attack vector: unsafe-advice
Category: real-world
Severity: Medium

AIAAIC-tracked incident. System: Copilot; Magic Notes. Technology: Generative AI; Speech-to-text; Speech recognition. Sector: Govt - welfare. Jurisdiction: England; Scotland.


Mitigations:

Architectural layers (MAESTRO):