An engine for the creation, mangement, and scaling of software services across pools of hosts