Package: torchrec-nightly
TorchRec (Beta Release)DocsTorchRec is a PyTorch domain library built to provide common sparsity & parallelism primitives needed for large-scale recommender systems (RecSys). It allows authors to train models with large embedding tables sharded across many GPUs.TorchRec contains:Parallelism primitives that enable easy authoring of large, performant multi-device/multi-node models using hybrid data-parallelism/model-parallelism.The TorchRec sharder can shard embedding tables with different sharding strategies including data-parallel, table-wise, row-wise, table-wise-row-wise, and column-wise sharding.The TorchRec planner can automatically generate optimized sharding plans for models.Pipelined training overlaps dataloading device transfer (copy to GPU), inter-device communications (input_dist), and computation (forward, backward) for increased performance.Optimized kernels for RecSys powered by FBGEMM.Quantization support for reduced precision training and inference.Common modules for RecSys.Production-proven model architectures for RecSys.RecSys datasets (criteo click logs and movielens)Examples of end-to-end training such the dlrm event prediction model trained on criteo click logs dataset.InstallationTorchrec requires Python >= 3.7 and CUDA >= 11.0 (CUDA is highly recommended for performance but not required). The example below shows how to install with CUDA 11.8. This setup assumes you have conda installed.BinariesExperimental binary on Linux for Python 3.7, 3.8 and 3.9 can be installed via pip wheelsInstallationsTO use the library without cuda, use the *-cpu fbgemm installations. However, this will be much slower than the CUDA variant.

Nightly

conda install pytorch pytorch-cuda=11.8 -c pytorch-nightly -c nvidia
pip install torchrec_nightly

Stable

conda install pytorch pytorch-cuda=11.8 -c pytorch -c nvidia
pip install torchrec

If you have no CUDA device:

Nightly

pip uninstall fbgemm-gpu-nightly -y
pip install fbgemm-gpu-nightly-cpu

Stable

pip uninstall fbgemm-gpu -y
pip install fbgemm-gpu-cpuColab example: introduction + installSee our colab notebook for an introduction to torchrec which includes runnable installation.
-Tutorial Source- Open inGoogle ColabFrom SourceWe are currently iterating on the setup experience. For now, we provide manual instructions on how to build from source. The example below shows how to install with CUDA 11.3. This setup assumes you have conda installed.Install pytorch. Seepytorch documentationconda install pytorch pytorch-cuda=11.8 -c pytorch-nightly -c nvidiaInstall Requirementspip install -r requirements.txtDownload and install TorchRec.git clone --recursive https://github.com/pytorch/torchrec

cd torchrec
python setup.py install developTest the installation.GPU mode

torchx run -s local_cwd dist.ddp -j 1x2 --gpu 2 --script test_installation.py

CPU Mode

torchx run -s local_cwd dist.ddp -j 1x2 --script test_installation.py -- --cpu_onlySeeTorchXfor more information on launching distributed and remote jobs.If you want to run a more complex example, please take a look at the torchrecDLRM example.ContributingPyre and lintingBefore landing, please make sure that pyre and linting look okay. To run our linters, you will need topip install pre-commit, and run it.For Pyre, you will need tocat .pyre_configuration
pip install pyre-check-nightly==<VERSION FROM CONFIG>
pyre checkWe will also check for these issues in our GitHub actions.LicenseTorchRec is BSD licensed, as found in theLICENSEfile.