orchestrator: Actually give containers skeleton keys, and remember them