When will CUDA 12.4 be compatible with Pytorch 2.3?

username: plumberpt
cooked: <p>I am using CUDA 12.5 now (for another software). Plan to downgrade the CUDA to 12.4 (for that software and PyTorch). Like to know what is the approximate timeframe for CUDA 12.4 to be compatible with Pytorch 2.3? Weeks, months?</p>
<p>Thanks.</p>
<p>P/S I guess CUDA 12.5 will be much later, a year later?</p>

username: ptrblck
cooked: <p>Your locally installed CUDA toolkit won’t be used if you install the PyTorch binaries since they ship with their own CUDA runtime dependencies.<br>
If you want to use a specific CUDA version you can build PyTorch from source using it, as it’s compatible with the latest CUDA releases.</p>

username: plumberpt
cooked: <p>Thanks.</p>
<p>Honestly, I do not fully understand it due to my limited knowledge. Let me recap what I did.</p>
<p>Upgraded from Davinci Resolve Studio18 to  DRS 19 a few months ago. Updated the CUDA to the latest one 12.5 a few weeks ago.</p>
<p>Uninstalled and reinstalled Pycharm, Python and Pytorch a few weeks ago. Why? Got many errors (think due to my own making, not knowing what I was configuring). Before the reinstallation, I got Pytorch to access my GPU Cuda with the correct Pytorch and Cuda versions.</p>
<p>Now no access between Pytorch 2.3 and Cuda 12.5. I think Pytorch 2.3 currently does not support Cuda 12.5. Support for Cuda 12.4 in Pytorch 2.3 is coming.</p>
<p>Please help withe the following:</p>
<p>“Your locally installed CUDA toolkit won’t be used if you install the PyTorch binaries since they ship with their own CUDA runtime dependencies.”</p>
<p>*** Meaning Pytorch and DRS 19 will use their respective installed Cuda versions? Use PIP to install specific Cuda version for Pytorch?</p>
<p>“If you want to use a specific CUDA version you can build PyTorch from source using it, as it’s compatible with the latest CUDA releases.”</p>
<p>***  What is meant by “build Pytorch from source”? Saw that a few times on the web.<br>
***   “as it’s compatible with the latest CUDA releases.”  Possible to install any CUDA version for Pytorch 2.3?</p>
<p>Many thanks for your help.</p>

username: anantguptadbl
cooked: <p><a class="mention" href="/u/plumberpt">@plumberpt</a> what <a class="mention" href="/u/ptrblck">@ptrblck</a>  means is not installing but building from source code on your system</p><aside class="onebox allowlistedgeneric" data-onebox-src="https://github.com/pytorch/pytorch#from-source">
  <header class="source">
      <img src="https://github.githubassets.com/favicons/favicon.svg" class="site-icon" width="32" height="32">

      <a href="https://github.com/pytorch/pytorch#from-source" target="_blank" rel="noopener nofollow ugc">GitHub</a>
  </header>

  <article class="onebox-body">
    <div class="aspect-image" style="--aspect-ratio:690/344;"><img src="https://opengraph.githubassets.com/39ff1720996b25faf5a8d0848f9c4f463392ae43c4df22f48099910f824322ee/pytorch/pytorch" class="thumbnail" width="690" height="345"></div>

<h3><a href="https://github.com/pytorch/pytorch#from-source" target="_blank" rel="noopener nofollow ugc">GitHub - pytorch/pytorch: Tensors and Dynamic neural networks in Python with...</a></h3>

  <p>Tensors and Dynamic neural networks in Python with strong GPU acceleration - pytorch/pytorch</p>


  </article>

  <div class="onebox-metadata">
    
    
  </div>

  <div style="clear: both"></div>
</aside>


username: plumberpt
cooked: <p>Thanks.</p>
<p>Pardon me, what is meant by building from source code?<br>
P/S Got a brief from ChatGPT on this. I think I will give this a miss. Ha.</p>
<p>Fear this is a lot harder than I thought. Maybe just wait for cuda 12.4</p>
<p>P/S Useful infor in the attached link you provided. Will wait for Pytorch 2.4 full release at the end of Jul and then install with PIP3 … Bingo.</p>

username: ptrblck
cooked: <aside class="quote no-group" data-username="plumberpt" data-post="3" data-topic="205847">
<div class="title">
<div class="quote-controls"></div>
<img loading="lazy" alt="" width="24" height="24" src="https://discuss.pytorch.org/letter_avatar_proxy/v4/letter/p/e9a140/48.png" class="avatar"> plumberpt:</div>
<blockquote>
<p>Now no access between Pytorch 2.3 and Cuda 12.5. I think Pytorch 2.3 currently does not support Cuda 12.5. Support for Cuda 12.4 in Pytorch 2.3 is coming.</p>
</blockquote>
</aside>
<p>PyTorch 2.3 does support CUDA 12.5 if you build from source. The binaries (pip wheels and condo binaries) whip with CUDA 11.8 or 12.1.<br>
The current nightly binaries ship additionally with CUDA 12.4.<br>
However, as already mentioned your locally installed CUDA toolkit won’t be used and the shipped CUDA dependencies will be used.</p>
<aside class="quote no-group" data-username="plumberpt" data-post="3" data-topic="205847">
<div class="title">
<div class="quote-controls"></div>
<img loading="lazy" alt="" width="24" height="24" src="https://discuss.pytorch.org/letter_avatar_proxy/v4/letter/p/e9a140/48.png" class="avatar"> plumberpt:</div>
<blockquote>
<p>*** Meaning Pytorch and DRS 19 will use their respective installed Cuda versions? Use PIP to install specific Cuda version for Pytorch?</p>
</blockquote>
</aside>
<p>I don’t know what DRS does, but PyTorch binaries install all needed CUDA runtime dependencies during the install process and will use these.</p>
<aside class="quote no-group" data-username="plumberpt" data-post="5" data-topic="205847">
<div class="title">
<div class="quote-controls"></div>
<img loading="lazy" alt="" width="24" height="24" src="https://discuss.pytorch.org/letter_avatar_proxy/v4/letter/p/e9a140/48.png" class="avatar"> plumberpt:</div>
<blockquote>
<p>Will wait for Pytorch 2.4 full release at the end of Jul and then install with PIP3 … Bingo.</p>
</blockquote>
</aside>
<p>The nightly binaries already build with 12.4.</p>

username: plumberpt
cooked: <p>Noted and many thanks! <img src="https://discuss.pytorch.org/images/emoji/apple/grinning.png?v=12" title=":grinning:" class="emoji" alt=":grinning:" loading="lazy" width="20" height="20"> <img src="https://discuss.pytorch.org/images/emoji/apple/+1.png?v=12" title=":+1:" class="emoji" alt=":+1:" loading="lazy" width="20" height="20"></p>