Privacy Preserving AI

IS IT POSSIBLE TO:

answer questions using
data we cannot see?

What do tumors
look like in humans?

Source: Wikipedia Commons

What do tumors
look like in humans?

◆ Step 1: Download millions of tumor images.

Source: Wikipedia Commons

What do tumors
look like in humans?

◆ Step 0: Buy a dataset from a hospital.
◆ Step 1: Download millions of tumor images.

Source: Wikipedia Commons

What do tumors
look like in humans?

◆ Step -1: Persuade a VC.
◆ Step 0: Buy a dataset from a hospital.
◆ Step 1: Download millions of tumor images.

Source: Wikipedia Commons

What do tumors
look like in humans?

◆ Step -2: Create a business plan!
◆ Step -1: Persuade a VC.
◆ Step 0: Buy a dataset from a hospital.
◆ Step 1: Download millions of tumor images.

Source: Wikipedia Commons

What do tumors
look like in humans?

◆ Step -3: Find a business partner!
◆ Step -2: Create a business plan!
◆ Step -1: Persuade a VC.
◆ Step 0: Buy a dataset from a hospital.
◆ Step 1: Download millions of tumor images.

Source: Wikipedia Commons

What do tumors
look like in humans?

◆ Step -4: Spam all my classmates on LinkedIn!
◆ Step -3: Find a business partner!
◆ Step -2: Create a business plan!
◆ Step -1: Persuade a VC.
◆ Step 0: Buy a dataset from a hospital.
◆ Step 1: Download millions of tumor images.

Source: Wikipedia Commons

What do handwritten
digits look like?

What do handwritten
digits look like?

◆ Step 1: Download data
◆ Step 2: Download SOTA training script◆ Step 3: Run script.

Getting access to
private data is HARD!

We SOLVE tasks which
are accessible:✓ ImageNet✓ MNIST✓ CIFAR-10✓ Librispeech✓ WikiText-103✓ WMT

We SOLVE tasks which
are accessible:… but what about?

✓ ImageNet◆ Cancer✓ MNIST◆ Alzheimers✓ CIFAR-10◆ Dementia✓ Librispeech◆ Depression✓ WikiText-103◆ Anxiety✓ WMT◆ … the Common Cold?

IS IT POSSIBLE TO:

answer questions using
data we cannot see?

atrask:~ pip install the-worlds-dataOpenMind is a Community

Tool 1: Remote Execution

Tool 1: Remote Execution

Tool 1: Remote Execution

Tool 1: Remote Execution

Tool 1: Remote Execution

Tool 1: Remote Execution

Tool 1: Remote Execution

Tool 1: Remote Execution

Tool 1: Remote Execution

Tool 1: Remote Execution

Pros:◆ RPC: Data remains on remotemachineCons:◆ How can we do good data science
without seeing the data?

Top Contributors

Tool 2: Search and Example Data

Tool 2: Search and Example Data

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 2: Search and Example Data

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 2: Search and Example Data

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 2: Search and Example Data

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 2: Search and Example Data

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 2: Search and Example Data

Pros:

◆ RPC: Data remains on remote machine◆ Search/Sample: We feature engineerw/ sample dataCons:

◆ We can steal data using
PointerTensor.get()

Top Contributors

Tool 3: Differential Privacy

Tool 3: Differential Privacy

Canonical DB
Bob: 1
Bill: 0
Sue: 0
John: 1
Joe: 1
Pat: 0
Amy: 1
Alice: 0◆ Goal: ensure statistical analysis doesn’tcompromise privacy◆ Query: function(database)◆ Perfect Privacy: the output of our query is thesame between this database and any identical
database with one row removed or replacedTool 3: Differential Privacy

Tool 3: Differential Privacy

FEATURE IN
DEVELOPMENThttps://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 3: Differential Privacy

FEATURE IN
DEVELOPMENT

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 3: Differential Privacy

FEATURE IN
DEVELOPMENT

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 3: Differential Privacy◆ Pros:◆ Remote: Data remains on remote machine◆ Search/Sample: We can feature engineer
using toy data

◆ DP: formal, rigorous privacy budgeting◆ Cons:◆ The data is safe, but the model is put at risk!
◆ What if we need to do a join/computation
across multiple data owners?

Top Contributors

FEATURE IN
DEVELOPMENT

Tool 4: Secure Multi-Party Computation

Tool 4: Secure Multi-Party Computation◆ Deﬁnition: multiple people can combine theirprivate inputs to compute a function, without
revealing their inputs to each other.

◆ Implication: multiple people can:
SHARE OWNERSHIP OF A NUMBER

Tool 4: Secure Multi-Party Computation

253

Tool 4: Secure Multi-Party Computation523

Tool 4: Secure Multi-Party Computation523

Tool 4: Secure Multi-Party Computation

253

Tool 4: Secure Multi-Party Computation

25◆ Encryption: neither knows the hidden value◆ Shared Governance: the number can only be
used if everyone agrees

3

Tool 4: Secure Multi-Party Computation

253

Tool 4: Secure Multi-Party Computation

253X

X

2246

Tool 4: Secure Multi-Party Computation

253XX

224106

Models and datasets are justlarge collections of numbers
which we can encryptTool 4: Secure Multi-Party Computation

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 4: Secure Multi-Party Computation

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 4: Secure Multi-Party Computation

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 4: Secure Multi-Party Computation

https://github.com/OpenMined/design-assets/blob/master/logos/PyGrid/horizontal-primary-trans.png

Tool 4: Secure Multi-Party Computation◆ Pros:◆ Remote: Data remains on remotemachine◆ Search/Sample: We can featureengineer using toy data

◆ DP: formal, rigorous privacy budgeting◆ MPC: The model can be encrypted
during training!

◆ MPC: We can do joins / functions acrossdata owners!

Top Contributors

IS IT POSSIBLE TO:

answer questions using
data we cannot see?

IS IT POSSIBLE TO:

answer questions using
data we cannot see?
Tool 1Tool 2

Remote Execution

Example Data

Tool 3Tool 4

Differential Privacy

Secure Multi-party
Computation

atrask:~ pip install the-worlds-dataLets forget these• ImageNet• MNIST• CIFAR-10• Librispeech• WikiText-103• WMT

✓ Cancer✓ Alzheimers

Lets solve these!

✓ Dementia✓ Depression✓ Anxiety✓ … the Common Cold?

udacity.com/private-ai

Part 2: AI, Privacy & Society