Is a failed unit test normal (under DynamicShapesMiscTests)

bobbym: <p>I’m new, and got the build to succeed, but upon running all unit tests (latest main) I get this output :</p>
<p>===================================================================== short test summary info ======================================================================<br>
FAILED [1.7000s] dynamo/test_dynamic_shapes.py::DynamicShapesMiscTests::test_mandelbrot_numpy_dynamic_shapes - AssertionError: Scalars are not equal!<br>
!!! stopping after 1 failures !!!<br>
============================================= 1 failed, 347 passed, 11 skipped, 4 xfailed, 2 rerun in 86.12s (0:01:26) =============================================</p>
<p>Is this normal or do I have an environment issue?</p>

bobbym: <p>Ah, maybe it is expected:</p><aside class="onebox githubissue" data-onebox-src="https://github.com/pytorch/pytorch/issues/109995">
  <header class="source">

      <a href="https://github.com/pytorch/pytorch/issues/109995" target="_blank" rel="noopener nofollow ugc">github.com/pytorch/pytorch</a>
  </header>

  <article class="onebox-body">
    <div class="github-row">
  <div class="github-icon-container" title="Issue">
	  <svg width="60" height="60" class="github-icon" viewBox="0 0 14 16" aria-hidden="true"><path fill-rule="evenodd" d="M7 2.3c3.14 0 5.7 2.56 5.7 5.7s-2.56 5.7-5.7 5.7A5.71 5.71 0 0 1 1.3 8c0-3.14 2.56-5.7 5.7-5.7zM7 1C3.14 1 0 4.14 0 8s3.14 7 7 7 7-3.14 7-7-3.14-7-7-7zm1 3H6v5h2V4zm0 6H6v2h2v-2z"></path></svg>
  </div>

  <div class="github-info-container">
    <h4>
      <a href="https://github.com/pytorch/pytorch/issues/109995" target="_blank" rel="noopener nofollow ugc">DISABLED test_mandelbrot_numpy_dynamic_shapes (__main__.DynamicShapesMiscTests)</a>
    </h4>

    <div class="github-info">
      <div class="date">
        opened <span class="discourse-local-date" data-format="ll" data-date="2023-09-25" data-time="06:40:07" data-timezone="UTC">06:40AM - 25 Sep 23 UTC</span>
      </div>


      <div class="user">
        <a href="https://github.com/apps/pytorch-bot" target="_blank" rel="noopener nofollow ugc">
          <img alt="pytorch-bot[bot]" src="https://avatars.githubusercontent.com/in/40112?v=4" class="onebox-avatar-inline" width="20" height="20">
          pytorch-bot[bot]
        </a>
      </div>
    </div>

    <div class="labels">
        <span style="display:inline-block;margin-top:2px;background-color: #B8B8B8;padding: 2px;border-radius: 4px;color: #fff;margin-left: 3px;">
          triaged
        </span>
        <span style="display:inline-block;margin-top:2px;background-color: #B8B8B8;padding: 2px;border-radius: 4px;color: #fff;margin-left: 3px;">
          module: flaky-tests
        </span>
        <span style="display:inline-block;margin-top:2px;background-color: #B8B8B8;padding: 2px;border-radius: 4px;color: #fff;margin-left: 3px;">
          skipped
        </span>
        <span style="display:inline-block;margin-top:2px;background-color: #B8B8B8;padding: 2px;border-radius: 4px;color: #fff;margin-left: 3px;">
          module: dynamo
        </span>
    </div>
  </div>
</div>

  <div class="github-row">
    <p class="github-body-container">Platforms: asan, linux, mac, macos, rocm, slow

This test was disabled because i<span class="show-more-container"><a href="" rel="noopener" class="show-more">…</a></span><span class="excerpt hidden">t is failing in CI. See [recent examples](https://hud.pytorch.org/flakytest?name=test_mandelbrot_numpy_dynamic_shapes&amp;suite=DynamicShapesMiscTests) and the most recent trunk [workflow logs](https://github.com/pytorch/pytorch/runs/17085074563).

Over the past 3 hours, it has been determined flaky in 32 workflow(s) with 96 failures and 32 successes.

**Debugging instructions (after clicking on the recent samples link):**
DO NOT ASSUME THINGS ARE OKAY IF THE CI IS GREEN. We now shield flaky tests from developers so CI will thus be green but it will be harder to parse the logs.
To find relevant log snippets:
1. Click on the workflow logs linked above
2. Click on the Test step of the job so that it is expanded. Otherwise, the grepping will not work.
3. Grep for `test_mandelbrot_numpy_dynamic_shapes`
4. There should be several instances run (as flaky tests are rerun in CI) from which you can study the logs.


Test file path: `dynamo/test_dynamic_shapes.py`

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @Xia-Weiwen @wenzhe-nrv @jiayisunx @chenyang78 @aakhundov @kadeng</span></p>
  </div>

  </article>

  <div class="onebox-metadata">
    
    
  </div>

  <div style="clear: both"></div>
</aside>


bobbym: <p>Running all tests under test_dynamic_shapes causes the failure, but it passes when running just that test alone. Maybe some interdependency?<br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/4/1/415d078986997134b10aa5e02af3b7a7025e2f53.png" data-download-href="https://discuss.pytorch.org/uploads/default/415d078986997134b10aa5e02af3b7a7025e2f53" title="image"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/4/1/415d078986997134b10aa5e02af3b7a7025e2f53_2_690x174.png" alt="image" data-base62-sha1="9kelIjYT3gxHdoAnPp9rkoQvy8j" width="690" height="174" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/4/1/415d078986997134b10aa5e02af3b7a7025e2f53_2_690x174.png, https://discuss.pytorch.org/uploads/default/optimized/3X/4/1/415d078986997134b10aa5e02af3b7a7025e2f53_2_1035x261.png 1.5x, https://discuss.pytorch.org/uploads/default/optimized/3X/4/1/415d078986997134b10aa5e02af3b7a7025e2f53_2_1380x348.png 2x" data-dominant-color="441D38"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">image</span><span class="informations">1496×378 82.7 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>