Repository: pytorch
Issue: DISABLED test_simple (__main__.TestNumericDebugger)
Labels: oncall: quantization,triaged,module: flaky-tests,module: macos,skipped

Platforms: mac, macos

This test was disabled because it is failing in CI. See [recent examples](https://hud.pytorch.org/flakytest?name=test_simple&suite=TestNumericDebugger&limit=100) and the most recent trunk [workflow logs](https://github.com/pytorch/pytorch/runs/34162312572).

Over the past 3 hours, it has been determined flaky in 3 workflow(s) with 6 failures and 3 successes.

**Debugging instructions (after clicking on the recent samples link):**
DO NOT ASSUME THINGS ARE OKAY IF THE CI IS GREEN. We now shield flaky tests from developers so CI will thus be green but it will be harder to parse the logs.
To find relevant log snippets:
1. Click on the workflow logs linked above
2. Click on the Test step of the job so that it is expanded. Otherwise, the grepping will not work.
3. Grep for `test_simple`
4. There should be several instances run (as flaky tests are rerun in CI) from which you can study the logs.



<details><summary>Sample error message</summary>

```
Traceback (most recent call last):
  File "/Users/ec2-user/runner/_work/pytorch/pytorch/test/quantization/pt2e/test_numeric_debugger.py", line 47, in test_simple
    ep = torch.export.export(m, example_inputs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/__init__.py", line 368, in export
    return _export(
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/_trace.py", line 1035, in wrapper
    raise e
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/_trace.py", line 1008, in wrapper
    ep = fn(*args, **kwargs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/exported_program.py", line 128, in wrapper
    return fn(*args, **kwargs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/_trace.py", line 1970, in _export
    return _export_for_training(
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/_trace.py", line 1035, in wrapper
    raise e
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/_trace.py", line 1008, in wrapper
    ep = fn(*args, **kwargs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/exported_program.py", line 128, in wrapper
    return fn(*args, **kwargs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/_trace.py", line 1834, in _export_for_training
    export_artifact = export_func(  # type: ignore[operator]
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/_trace.py", line 1283, in _strict_export_lower_to_aten_ir
    gm_torch_level = _export_to_torch_ir(
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/export/_trace.py", line 662, in _export_to_torch_ir
    gm_torch_level, _ = torch._dynamo.export(
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/_dynamo/eval_frame.py", line 1564, in inner
    result_traced = opt_f(*args, **kwargs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl
    return forward_call(*args, **kwargs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/_dynamo/eval_frame.py", line 573, in _fn
    return fn(*args, **kwargs)
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/_dynamo/convert_frame.py", line 1380, in __call__
    return self._torchdynamo_orig_callable(
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/_dynamo/convert_frame.py", line 547, in __call__
    return _compile(
  File "/Users/ec2-user/runner/_work/_temp/conda_environment_12246164370/lib/python3.9/site-packages/torch/_dynamo/convert_frame.py", line 925, in _compile
    raise CacheLimitExceeded(f"{limit_type} reached")
torch._dynamo.exc.CacheLimitExceeded: cache_size_limit reached

To execute this test, run the following from the base repo dir:
    python test/quantization/pt2e/test_numeric_debugger.py TestNumericDebugger.test_simple

This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0
```

</details>


Test file path: `test_quantization.py`

cc @jerryzh168 @jianyuh @raghuramank100 @jamesr66a @vkuzo @jgong5 @Xia-Weiwen @leslie-fang-intel @msaroufim @clee2000 @wdvr @malfet @albanD