Revert "Live create tenants"

This reverts commit 2e419b20318e73422abfd72199d09db069d54040.