Before revision:  Current solutions are mainly based on model compression -- deploying a smaller model to save the computational resources. Meanwhile , the peak workload of inference service could be 10x higher than the average cases, with even unpredictable extreme cases.
After revision:  In practice , the peak workload of inference service could be 10x higher than the average cases, with even unpredictable extreme cases.