An ugly fix to tox failures on policy.json

This allows tox tests to find policy.json, a problem introduced upstream.

ONLY MERGE IF A TEMPORARY FIX IS OK.

Upstream might fix this shortly? We can hope.