[inductor][cpu] perf regression
Labels: triaged, oncall: pt2, module: inductor, module: cpu inductor

<p>new_perf_regression compare with 2023-09-07 nightly release</p>
<table border="1" class="dataframe table">
  <thead>
    <tr style="text-align: right;">
      <th>name</th>
      <th>batch_size_new</th>
      <th>speed_up_new</th>
      <th>inductor_new</th>
      <th>eager_new</th>
      <th>compilation_latency_new</th>
      <th>batch_size_old</th>
      <th>speed_up_old</th>
      <th>inductor_old</th>
      <th>eager_old</th>
      <th>compilation_latency_old</th>
      <th>Ratio Speedup(New/old)</th>
      <th>Eager Ratio(old/new)</th>
      <th>Inductor Ratio(old/new)</th>
      <th>Compilation_latency_Ratio(old/new)</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>cait_m36_384</td>
      <td>1.0</td>
      <td>0.441975</td>
      <td>0.794344889</td>
      <td>0.351080582315775</td>
      <td>88.337227</td>
      <td>2.0</td>
      <td>0.895947</td>
      <td>0.695152833</td>
      <td>0.622820095267851</td>
      <td>94.38569</td>
      <td>0.49</td>
      <td>1.77</td>
      <td>0.88</td>
      <td>1.07</td>
    </tr>
    <tr>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
    </tr>
    <tr>
      <td>lennard_jones</td>
      <td>1.0</td>
      <td>1.024876</td>
      <td>7.2823e-05</td>
      <td>7.463454494799999e-05</td>
      <td>9.897081</td>
      <td>1.0</td>
      <td>1.166834</td>
      <td>6.1867e-05</td>
      <td>7.218851907799999e-05</td>
      <td>9.894189</td>
      <td>0.88</td>
      <td>0.97</td>
      <td>0.85</td>
      <td>1.0</td>
    </tr>
    <tr>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
      <td>*</td>
    </tr>
  </tbody>
</table>
<p>SW info</p>
<table border="1" class="dataframe table">
  <thead>
    <tr style="text-align: right;">
      <th>SW</th>
      <th>Nightly commit</th>
      <th>Main commit</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Pytorch</td>
      <td>11d2c76</td>
      <td></td>
    </tr>
    <tr>
      <td>Torchbench</td>
      <td>/</td>
      <td>ffbbebb9</td>
    </tr>
    <tr>
      <td>torchaudio</td>
      <td>475b6ae</td>
      <td></td>
    </tr>
    <tr>
      <td>torchtext</td>
      <td>142d029</td>
      <td></td>
    </tr>
    <tr>
      <td>torchvision</td>
      <td>8636bf3</td>
      <td></td>
    </tr>
    <tr>
      <td>torchdata</td>
      <td>eb9bf61</td>
      <td></td>
    </tr>
    <tr>
      <td>dynamo_benchmarks</td>
      <td>0200b11</td>
      <td>/</td>
    </tr>
  </tbody>
</table>

<html>
<body>
<!--StartFragment--><p style="color: rgb(0, 0, 0); font-family: &quot;Times New Roman&quot;; font-size: medium; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; white-space: normal; text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial;">SW info(2023-09-07 nightly release)</p>

SW | Nightly commit | Main commit
-- | -- | --
Pytorch | a618118 |  
Torchbench | / | 770d5cf7
torchaudio | dc83b38 |  
torchtext | c11d758 |  
torchvision | 58366ab |  
torchdata | 1d231d1 |  
dynamo_benchmarks | f228c8b | /

<br class="Apple-interchange-newline"><!--EndFragment-->
</body>
</html>




Repro:
bash [inductor_single_test.sh](https://github.com/chuanqi129/inductor-tools/blob/yudong/aws_auto/scripts/modelbench/inductor_single_run.sh) multiple inference performance **timm_models cait_m36_384** float32 first static default 0

bash
[inductor_single_test.sh](https://github.com/chuanqi129/inductor-tools/blob/yudong/aws_auto/scripts/modelbench/inductor_single_run.sh)
single inference performance **torchbench lennard_jones** float32 first static default 0

cc @ezyang @msaroufim @wconstab @bdhirsh @anijain2305 @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @Xia-Weiwen @wenzhe-nrv @jiayisunx @peterbell10 @ipiszy @ngimel @yf225 @chenyang78 @kadeng @muchulee8 @aakhundov