Configure tempest more completely

Upstream defaults changed to be incompatible with the
setup that we deploy. Be more explicit in the setup so
that it works again.

(cherry picked from commit 75e327308cc3f79e9cd192cd6a040d4b82482472)