Pytorch support for sm120

Sean_V: <p>I apologize if this is the incorrect place to ask… I have an rtx5080 that I was lucky enough to grab… but I can not get it to work with pytorch… I keep getting an error because pytorch does not support cm120… I’ve tried everything to work around it but I am getting stuck… Could someone please help</p>

ptrblck: <p>Blackwell (<code>sm_100</code> and <code>sm_120</code>) is supported already if you are building PyTorch from source.<br>
We are also working on enabling nightly binaries and first builds are already successful. We are currently verifying these and you could grab the very early build from the build pipelines, e.g.: <a href="https://github.com/pytorch/pytorch/actions/runs/13074871296">from here</a> (select the desired Python version and use the CUDA 12.8 builds).<br>
Executed this wheel on a Blackwell GPU:</p>
<pre data-code-wrap="python"><code class="lang-python">python -c "import torch; print(torch.__version__); print(torch.cuda.get_arch_list()); print(torch.randn(1).cuda())"
2.7.0.dev20250131+cu128
['sm_50', 'sm_60', 'sm_70', 'sm_75', 'sm_80', 'sm_86', 'sm_90', 'sm_100', 'sm_120', 'compute_120']
tensor([-0.0819], device='cuda:0')
</code></pre>
<p>Tomorrow’s nightly binaries should also be ready and we will confirm it once the builds are ready (already triggered), so instead of downloading test wheels you can wait until tomorrow to check if the builds went through.</p>

ptrblck: <p><code>pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu128</code> works now.<br>
<code>torchvision</code> and <code>torchaudio</code> is still WIP.</p>

daleaktw: <p>Not able to download<br>
ERROR: Could not find a version that satisfies the requirement torch (from versions: none)<br>
ERROR: No matching distribution found for torch<br>
thanks.</p>

ptrblck: <p>I should have added that these binaries are currently built for Python 3.9-3.13 and Linux x86 only. I don’t know which Python version, OS, or architecture you are using.</p>

daleaktw: <p>Thank you for your reply.<br>
I think I have figured out the issue.<br>
I am using <strong>Python 3.10</strong> on <strong>AMD WIN64</strong></p>

jiken: <p>is the nightly binaries out for python 3.9.13 and win64?</p>

ptrblck: <p>No, not yet. The binaries are available for Linux on x86 and ARM, so you could use WSL2 in the meantime.</p>

Loham: <p>Also a user of Python 3.10, WIN64 and CUDA 12.8. I will be watching this thread for the good news of the nightly when it’s ready!</p>

Omegadarling: <p>Are there any other places we should be watching so that we’ll know the minute there’s a Pytorch that supports sm120? I keep checking this page and I don’t want to miss it!</p>

ptrblck: <p>PyTorch binaries using CUDA 12.8 are already available as nightly binaries for Linux (x86 and SBSA). If you don’t want to use WSL and are looking for native Windows support you could check when the binaries show up <a href="https://download.pytorch.org/whl/nightly/torch/">here</a> but I will also update this thread once they are available.</p>

Omegadarling: <p>Any updates? Is this something that might take another few months or weeks? I’m sure a million people are asking this, but I really have no idea how often to refresh this page, hah</p>

ptrblck: <p>The nightly wheels for Windows are available as of now, e.g. for Python==3.12 you can find the download <a href="https://download.pytorch.org/whl/nightly/cu128/torch-2.7.0.dev20250220%2Bcu128-cp312-cp312-win_amd64.whl#sha256=d91399263c6d59f0258ad586ad887adbd7e94ba2fe1c9e395dfda48249345ae1">here</a>.</p>

superbes: <p>I just checked, and I think it’s finally out!! <a href="https://download.pytorch.org/whl/nightly/torch/" rel="noopener nofollow ugc">https://download.pytorch.org/whl/nightly/torch/</a></p>

Godmax: <p>What about torchvision and torchaudio? When might that arrive?</p>

viyriy: <p>Will this only work for python 3.12+? Currently running an environment that only works with 3.10.13</p>

viyriy: <p>Yeah I am currently getting this error when trying to update:</p>
<p>ERROR: Cannot install torch==2.7.0.dev20250220+cu128 and torchvision==0.19.1+cu124 because these package versions have conflicting dependencies.</p>
<p>The conflict is caused by:<br>
The user requested torch==2.7.0.dev20250220+cu128<br>
torchvision 0.19.1+cu124 depends on torch==2.4.1+cu124</p>
<p>Need torchvision and torchaudio updates it seems.</p>

Dream_Sillkew: <p>Yes, I have also encountered the same issue. I have been keeping an eye on this post and waiting for PyTorch CUDA 12.8 to support Windows. However, the current version of Torchaudio is only 2.6.0, so it seems that I need to wait for a while longer <img src="https://discuss.pytorch.org/images/emoji/apple/pensive.png?v=12" title=":pensive:" class="emoji" alt=":pensive:" loading="lazy" width="20" height="20"></p>

fsalka: <p>Training with RTX 5090 + Windows 11 Pro + Pytorch latest nightly with cu128 is ~10% <em>slower</em> than when using the RTX 4090 on the same script / same model (resnet f32) / machine configuration / same envrionment. Anyone can confirm this issue? Is the 5090 only faster on Linux or is the 5090 throttled for AI workloads?</p>

Godmax: <p>So no torchvision and torchaudio yet, damn</p>