RTX 3090 6 times slower than GTX 1080ti

Fra_Zuppi: <p>Hi Guys,</p>
<p>I hope you are doing great, I am well aware of all the github issues (<a href="https://github.com/pytorch/pytorch/issues/50328" class="inline-onebox" rel="noopener nofollow ugc">RTX3090 performs no better than 1080ti · Issue #50328 · pytorch/pytorch · GitHub</a>, <a href="https://github.com/traveller59/spconv/issues/276" class="inline-onebox" rel="noopener nofollow ugc">Anyone has use it in 3090? It seems been slow... · Issue #276 · traveller59/spconv · GitHub</a>, etc) about this topic.</p>
<p>I’ve tried a lot of different containers from nvidia and my RTX 3090 is just so much slower than my 1080ti when performing forward 3x3 convs. What is going one?</p>
<p>Does anyone know how to fix it? There is no solution in any issue.</p>
<p>Thanks</p>

ptrblck: <p>Could you post a minimal, executable code snippet reproducing this issue, please?</p>

Fra_Zuppi: <p>hi <a class="mention" href="/u/ptrblck">@ptrblck</a> ,</p>
<p>I was running a vgg like moodel, the 1080ti was really faster. Now if you think it’s better to run your benchmark (form here → <a href="https://github.com/pytorch/pytorch/issues/47039" class="inline-onebox" rel="noopener nofollow ugc">Convolution operations are extremely slow on RTX 30 series GPU · Issue #47039 · pytorch/pytorch · GitHub</a>) on both, I’ll do it. If we can avoid it it would be better so I don’t have to switch GPUs.</p>
<p>Do you know if there is a fix for this problem? In cudnn release notes, I’ve seen that is labeled as an known issue but no fix.</p>
<p>It’s cray that this problem exists in the first place, the 3090 is the flagship. Do you have additional information about what is causing it?</p>
<p>Thanks a lot</p>

ptrblck: <aside class="quote no-group" data-username="Fra_Zuppi" data-post="3" data-topic="157809">
<div class="title">
<div class="quote-controls"></div>
<img loading="lazy" alt="" width="24" height="24" src="https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/fra_zuppi/48/33454_2.png" class="avatar"> Fra_Zuppi:</div>
<blockquote>
<p>Do you know if there is a fix for this problem? In cudnn release notes, I’ve seen that is labeled as an known issue but no fix.</p>
</blockquote>
</aside>
<p>As you see in my comment from ~1.5 years ago, the 3090 performed already better.<br>
Unfortunately, users keep commenting with unverified claims, don’t share their model or how they profiled the code, and often don’t bother to follow up.</p>
<aside class="quote no-group" data-username="Fra_Zuppi" data-post="3" data-topic="157809">
<div class="title">
<div class="quote-controls"></div>
<img loading="lazy" alt="" width="24" height="24" src="https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/fra_zuppi/48/33454_2.png" class="avatar"> Fra_Zuppi:</div>
<blockquote>
<p>It’s cray that this problem exists in the first place, the 3090 is the flagship. Do you have additional information about what is causing it?</p>
</blockquote>
</aside>
<p>I still claim it’s fixed until I see a valid counter example, so feel free to share something here.</p>

Fra_Zuppi: <p>Hi <a class="mention" href="/u/ptrblck">@ptrblck</a> , I had time to benchmark both 1080ti and 3090 during the weekend. Yes, the 3090 is around ~2 times faster than the 1080ti.</p>
<p>Code and benchmarks here → <a href="https://github.com/FrancescoSaverioZuppichini/is-3090-good-for-computer-vision" class="inline-onebox" rel="noopener nofollow ugc">GitHub - FrancescoSaverioZuppichini/is-3090-good-for-computer-vision: A collection of benchmarks I've run</a></p>
<p><div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/0/f/0f7740e4f893e76293c0420bf50048e170c06e9f.png" data-download-href="https://discuss.pytorch.org/uploads/default/0f7740e4f893e76293c0420bf50048e170c06e9f" title="image"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/0/f/0f7740e4f893e76293c0420bf50048e170c06e9f_2_612x500.png" alt="image" data-base62-sha1="2cOF0LkaKpEtQsAsbcyoRRcstb1" width="612" height="500" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/0/f/0f7740e4f893e76293c0420bf50048e170c06e9f_2_612x500.png, https://discuss.pytorch.org/uploads/default/optimized/3X/0/f/0f7740e4f893e76293c0420bf50048e170c06e9f_2_918x750.png 1.5x, https://discuss.pytorch.org/uploads/default/optimized/3X/0/f/0f7740e4f893e76293c0420bf50048e170c06e9f_2_1224x1000.png 2x" data-dominant-color="E9F1F1"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">image</span><span class="informations">2616×2136 167 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>
<p>Thanks a lot and I don’t know why I thought it was slower in the first place</p>

ptrblck: <p>Thanks for sharing. You could also check the performance for mixed-precision training (in channels-last memory layout), which might also show more speedups.</p>