/blog/high-performance-llama/)

  * [ Naver Case Study: Transition From High-Cost GPUs to Intel CPUs and oneAPI powered Software with performance ](https://pytorch.org/blog/ml-model-server-resource-saving/)

  * [ Run multiple generative AI models on GPU using Amazon SageMaker multi-model endpoints with TorchServe and save up to 75% in inference costs ](https://aws.amazon.com/blogs/machine-learning/run-multiple-generative-ai-models-on-gpu-using-amazon-sagemaker-multi-model-endpoints-with-torchserve-and-save-up-to-75-in-inference-costs/)

  * [ Deploying your Generative AI model in only four steps with Vertex AI and PyTorch ](https://cloud.google.com/blog/products/ai-machine-learning/get-your-genai-model-going-in-four-easy-steps)

  * [ PyTorch Model Serving on Google Cloud TPUv5 ](https://cloud.google.com/tpu/docs/v5e-inference#pytorch-model-inference-and-serving)

  * [ Monitoring using Datadog ](https://www.datadoghq.com/blog/ai-integrations/#model-serving-and-deployment-vertex-ai-amazon-sagemaker-torchserve)

  * [ Torchserve Performance Tuning, Animated Drawings Case-Study ](https://pytorch.org/blog/torchserve-performance-tuning/)

  * [ Walmart Search: Serving Models at a Scale on TorchServe ](https://medium.com/walmartglobaltech/search-model-serving-using-pytorch-and-torchserve-6caf9d1c5f4d)

  * [ Scaling inference on CPU with TorchServe ](https://www.youtube.com/watch?v=066_Jd6cwZg)

  * [ TorchServe C++ backend ](https://www.youtube.com/watch?v=OSmGGDpaesc)

  * [ Grokking Intel CPU PyTorch performance from first principles: a TorchServe case study ](https://pytorch.org/tutorials/intermediate/torchserve_with_ipex.html)

  * [ Grokking Intel CPU PyTorch performance from first principles( Part 2): a TorchServe case study ](https://pytorch.org/tutorials/intermediate/torchserve_with_ipex_2.html)

  * [ Case Study: Amazon Ads Uses PyTorch and AWS Inferentia to Scale Models for Ads Processing ](https://pytorch.org/blog/amazon-ads-case-study/)

  * [ Optimize your inference jobs using dynamic batch inference with TorchServe on Amazon SageMaker ](https://aws.amazon.com/blogs/machine-learning/optimize-your-inference-jobs-using-dynamic-batch-inference-with-torchserve-on-amazon-sagemaker/)

  * [ Using AI to bring children’s drawings to life ](https://ai.facebook.com/blog/using-ai-to-bring-childrens-drawings-to-life/)

  * [ Model Serving in PyTorch ](https://www.youtube.com/watch?v=2A17ZtycsPw)

  * [ Evolution of Cresta’s machine learning architecture: Migration to AWS and PyTorch ](https://aws.amazon.com/blogs/machine-learning/evolution-of-crestas-machine-learning-architecture-migration-to-aws-and-pytorch/)

  * [ Explain Like I’m 5: TorchServe ](https://www.youtube.com/watch?v=NEdZbkfHQCk)

  * [ How to Serve PyTorch Models with TorchServe ](https://www.youtube.com/watch?v=XlO7iQMV3Ik)

  * [ How to deploy PyTorch models on Vertex AI ](https://cloud.google.com/blog/topics/developers-practitioners/pytorch-google-cloud-how-deploy-pytorch-models-vertex-ai)

  * [ Quantitative Comparison of Serving Platforms ](https://biano-ai.github.io/research/2021/08/16/quantitative-comparison-of-serving-platforms-for-neural-networks.html)

All

* * *

#### [ TorchServe Quick Start  Topics:  Quick Start  Learn how to install
TorchServe and serve models.  ![](https://user-
images.githubusercontent.com/880376/83180095-c44cc600-a0d7-11ea-97c1-23abb4cdbe4d.jpg)
](getting_started.html)

#### [ Running TorchServe  Topics:  Running TorchServe  Indepth explanation of
how to run TorchServe
![](https://raw.githubusercontent.com/pytorch/serve/master/docs/images/dogs-
after.jpg) ](server.html)

#### [ Why TorchServe  Topics:  Examples  Various TorchServe use cases
![](https://download.pytorch.org/torchaudio/tutorial-
assets/thumbnails/streamreader_basic_tutorial.png) ](use_cases.html)

#### [ Performance  Topics:  Performance,Troubleshooting  Guides and best
practices on how to improve perfromance when working with TorchServe
![](https://raw.githubuserco