You're right, I was thinking of running tests against a locally running stack. But you're absolutely right, the main difficulty is to inject configuration into a remote running system.

Maybe for django apps we could build some pretenders middleware that you could use to pass magic values in proprietary HTTP headers or URL parameters... but that's another story