Before revision:  We first show that empirically learning the service rates and then scheduling using these learned values results in a regret of holding-cost that does not depend on the time horizon .
After revision:  We first show that empirically learning the service rates and then scheduling using these learned values results in a constant holding-cost regret (the regret is independent of the time horizon .