An ugly fix for tox failures on policy.json

This allows tox tests to find policy.json, a problem introduced upstream.

ONLY MERGE IF A TEMPORARY FIX IS OK.

Upstream might fix this shortly? Maybe?