Pytorch is only using GPU for vram, not for actual compute

username: Stanley_C
cooked: <p>Note, when I’m running a test, I’m using this script: <a href="https://github.com/pytorch/examples/blob/master/mnist/main.py" class="inline-onebox" rel="noopener nofollow ugc">examples/mnist/main.py at main · pytorch/examples · GitHub</a><br>
with no arguments, only python main.py</p>
<p>I’m currently on windows, and I’m installing PyTorch in a sandboxed anaconda environment python 3.6 with this command: conda install pytorch torchvision cudatoolkit=10.0 -c pytorch<br>
Here is the screenshot showing that my gpu is detected: <div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/e/b/eb33349978d9d453b0af1948f0dc550364442180.png" data-download-href="https://discuss.pytorch.org/uploads/default/eb33349978d9d453b0af1948f0dc550364442180" title="Screenshot%20(4)"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/e/b/eb33349978d9d453b0af1948f0dc550364442180_2_690x388.png" alt="Screenshot%20(4)" data-base62-sha1="xyFUAEMD0K4o9vSm3Vf1Bv9MoxO" width="690" height="388" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/e/b/eb33349978d9d453b0af1948f0dc550364442180_2_690x388.png, https://discuss.pytorch.org/uploads/default/optimized/3X/e/b/eb33349978d9d453b0af1948f0dc550364442180_2_1035x582.png 1.5x, https://discuss.pytorch.org/uploads/default/optimized/3X/e/b/eb33349978d9d453b0af1948f0dc550364442180_2_1380x776.png 2x" data-dominant-color="B5B5B5"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">Screenshot%20(4)</span><span class="informations">1920×1080 239 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div><br>
And here is a screenshot showing that the cpu is being fully used and the gpu is only being used for Vram, not the actual compute:</p>
<p>How do I fix this issue? Am I installing with the wrong command?<br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/4/1/41e0189e653fd0f9ffc2742a704b0d1115076a80.png" data-download-href="https://discuss.pytorch.org/uploads/default/41e0189e653fd0f9ffc2742a704b0d1115076a80" title="Screenshot%20(5)"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/4/1/41e0189e653fd0f9ffc2742a704b0d1115076a80_2_690x388.png" alt="Screenshot%20(5)" data-base62-sha1="9oL9SK57r9tsGJf6qE1OIu7fgoU" width="690" height="388" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/4/1/41e0189e653fd0f9ffc2742a704b0d1115076a80_2_690x388.png, https://discuss.pytorch.org/uploads/default/optimized/3X/4/1/41e0189e653fd0f9ffc2742a704b0d1115076a80_2_1035x582.png 1.5x, https://discuss.pytorch.org/uploads/default/optimized/3X/4/1/41e0189e653fd0f9ffc2742a704b0d1115076a80_2_1380x776.png 2x" data-dominant-color="B5B5B6"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">Screenshot%20(5)</span><span class="informations">1920×1080 253 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>

username: albanD
cooked: <p>Hi,</p>
<p>I think the reporting of the task manager on windows does not report CUDA usage. And so you will never see high usage there by running compute intensive tasks.<br>
<a class="mention" href="/u/peterjc123">@peterjc123</a> might be able to give a more detailed explanation of this?</p>

username: peterjc123
cooked: <p><a href="https://devblogs.microsoft.com/directx/gpus-in-the-task-manager/" rel="nofollow noopener">https://devblogs.microsoft.com/directx/gpus-in-the-task-manager/ </a><br>
It is normal, see this post for more details.</p>

username: peterjc123
cooked: <p>If you really want to see that performance counter,then you should use nvidia-smi.</p>

username: Stanley_C
cooked: <p>Thank you for your help!</p>