(intermediate/dist_pipeline_parallel_tutorial.html)
  * [ Implementing Batch RPC Processing Using Asynchronous Executions ](intermediate/rpc_async_execution.html)
  * [ Combining Distributed DataParallel with Distributed RPC Framework ](advanced/rpc_ddp_tutorial.html)
  * [ Training Transformer models using Distributed Data Parallel and Pipeline Parallelism ](advanced/ddp_pipeline.html)
  * [ Distributed Training with Uneven Inputs Using the Join Context Manager ](advanced/generic_join.html)

Edge with ExecuTorch

  * [ Exporting to ExecuTorch Tutorial ](https://pytorch.org/executorch/stable/tutorials/export-to-executorch-tutorial.html)
  * [ Running an ExecuTorch Model in C++ Tutorial ]( https://pytorch.org/executorch/stable/running-a-model-cpp-tutorial.html)
  * [ Using the ExecuTorch SDK to Profile a Model ](https://pytorch.org/executorch/stable/tutorials/sdk-integration-tutorial.html)
  * [ Building an ExecuTorch iOS Demo App ](https://pytorch.org/executorch/stable/demo-apps-ios.html)
  * [ Building an ExecuTorch Android Demo App ](https://pytorch.org/executorch/stable/demo-apps-android.html)
  * [ Lowering a Model as a Delegate ](https://pytorch.org/executorch/stable/examples-end-to-end-to-lower-model-to-delegate.html)

Recommendation Systems

  * [ Introduction to TorchRec ](intermediate/torchrec_tutorial.html)
  * [ Exploring TorchRec sharding ](advanced/sharding.html)

Multimodality

  * [ TorchMultimodal Tutorial: Finetuning FLAVA ](beginner/flava_finetuning_tutorial.html)

  * Tutorials  >
  * Welcome to PyTorch Tutorials 
  * [ ![](_static/images/view-page-source-icon.svg) ](_sources/index.rst.txt)

Shortcuts

index

![](_static/images/pytorch-colab.svg)

Run in Google Colab

Colab

![](_static/images/pytorch-download.svg)

Download Notebook

Notebook

![](_static/images/pytorch-github.svg)

View on GitHub

GitHub

#  Welcome to PyTorch Tutorials  ¶

**What’s new in PyTorch tutorials?**

  * [ Using User-Defined Triton Kernels with torch.compile ](https://pytorch.org/tutorials/recipes/torch_compile_user_defined_triton_kernel_tutorial.html)

  * [ Large Scale Transformer model training with Tensor Parallel (TP) ](https://pytorch.org/tutorials/intermediate/TP_tutorial.html)

  * [ Accelerating BERT with semi-structured (2:4) sparsity ](https://pytorch.org/tutorials/advanced/semi_structured_sparse.html)

  * [ torch.export Tutorial with torch.export.Dim ](https://pytorch.org/tutorials/intermediate/torch_export_tutorial.html)

  * [ Extension points in nn.Module for load_state_dict and tensor subclasses ](https://pytorch.org/tutorials/recipes/recipes/swap_tensors.html)

###  Learn the Basics

Familiarize yourself with PyTorch concepts and modules. Learn how to load
data, build deep neural networks, train and save your models in this
quickstart guide.

[ Get started with PyTorch ](beginner/basics/intro.html)

###  PyTorch Recipes

Bite-size, ready-to-deploy PyTorch code examples.

[ Explore Recipes ](recipes/recipes_index.html)

All

* * *

#### [ Learn the Basics  A step-by-step guide to building a complete ML
workflow with PyTorch.  Getting-Started
![](_static/img/thumbnails/cropped/60-min-blitz.png)
](beginner/basics/intro.html)

#### [ Introduction to PyTorch on YouTube  An introduction to building a
complete ML workflow with PyTorch. Follows the PyTorch Beginner Series on
YouTube.  Getting-Started  ![](_static/img/thumbnails/cropped/generic-pytorch-
logo.png) ](beginner/introyt.html)

#### [ Learning PyTorch with Examples  This tutorial introduces the
fundamental concepts of PyTorch through self-contained examples.  Getting-
Started  ![](_static/img/thumbnails/cropped/learning-pytorch-with-
examples.png) ](beginner/pytorch_with_examples.html)

#### [ What is torch.nn really?  Use torch.nn to create and train a neural
network.  Getting-Started  ![](_static/img/thumbnails/cropped/torch-nn.png)
](beginner/nn_tutorial.html)

#### [ Visualizing Models, Data, and Training with TensorBoard  Learn to use
TensorBoard to visu