Data poisoning attacks occur when an attacker tampers with the data that an AI model is trained on to produce undesirable outcomes (both in terms of security and bias). As LLMs in particular are increasingly used to pass data to third-party applications and services, the risks from these attacks will grow, as described in the NCSC blog ‘Thinking about the security of AI systems’.
(Source: National Cyber Security Centre)