Kubernetes MLSec: Securing AI in Space - Francesco Beltramini & James Callaghan, ControlPlane
Channel: CNCF [Cloud Native Computing Foundation]
Date: 23/03/2024

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io

Kubernetes MLSec: Securing AI in Space - Francesco Beltramini & James Callaghan, ControlPlane

In the gold rush to unearth the next groundbreaking AI technology, operational and data security have become the first victims. We feed ever greater volumes of PII and proprietary secrets into models running on "other people's computers" and receive fewer guarantees than ever before about the safety and sanctity of our data. High-profile breaches with cross-customer data leaks and training on user inputs lead us to ask: do we trust that mode input data is unpolluted and verified? Are we sure inputs remain ours and aren't used to train other systems? Will your financial history be used to define insurance rates? Cloud native is here to help! In this talk we: - Threat model Kubernetes-powered MLOps - Break into and poison a Kubernetes model-training environment - Demonstrate the dangers inherent in feeding data into any LLM and train ML models - Suggest cloud native architectural and procedural remediation