Repository: pytorch/benchmark
Issue: V2 Performance Signal Detected by TorchBench CI on 'ed0910596db6fe7e40eff2d6681535cfe68cad4e'
Root cause: Algorithmic Error


TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: f3e13d956729d4fa9ce35dca5beed588c914797d

Affected PyTorch commit: ed0910596db6fe7e40eff2d6681535cfe68cad4e

Affected Tests:
- detectron2_maskrcnn, Adamax, cuda, (pt2) default: -19.91439%
- detectron2_maskrcnn, Adamax, cuda, (pt2) maximize: -13.12249%
- detectron2_maskrcnn, Adamax, cuda, (pt2) foreach: -19.12845%
- detectron2_maskrcnn, ASGD, cuda, (pt2) default: -34.44846%
- detectron2_maskrcnn, ASGD, cuda, foreach: -27.87450%
- phlippe_resnet, Adagrad, cuda, (pt2) maximize: +10.42680%
- phlippe_resnet, Adagrad, cuda, foreach: +11.36247%
- phlippe_resnet, AdamW, cuda, default: +11.13243%
- phlippe_resnet, ASGD, cuda, (pt2) default: +16.77763%
- phlippe_resnet, ASGD, cuda, maximize: +11.58219%
- phlippe_resnet, RAdam, cuda, foreach: +18.63859%
- LearningToPaint, Adagrad, cuda, foreach: -25.23022%
- LearningToPaint, AdamW, cuda, foreach: +14.23910%
- LearningToPaint, ASGD, cuda, (pt2) foreach: +57.30821%
- LearningToPaint, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -10.41286%
- LearningToPaint, Rprop, cuda, (pt2) default: +48.79141%
- basic_gnn_edgecnn, Adadelta, cuda, (pt2) maximize: +12.73790%
- basic_gnn_edgecnn, Adadelta, cuda, (pt2) foreach: +10.55751%
- basic_gnn_edgecnn, Adagrad, cuda, maximize: +10.14854%
- basic_gnn_edgecnn, Adam, cuda, (pt2) foreach, maximize, capturable: +19.69705%
- basic_gnn_edgecnn, SGD, cuda, (pt2) foreach: +25.09012%
- basic_gnn_edgecnn, RAdam, cuda, (pt2) default: -14.70125%
- basic_gnn_edgecnn, Rprop, cuda, (pt2) maximize: +11.64648%
- hf_T5, Adagrad, cuda, foreach: +15.71029%
- hf_T5, ASGD, cuda, (pt2) default: +12.02539%
- hf_T5, ASGD, cuda, (pt2) maximize: +10.97286%
- hf_T5, ASGD, cuda, (pt2) foreach: +34.51926%
- hf_T5, Rprop, cuda, default: -25.23911%
- hf_Bert_large, ASGD, cuda, foreach: -29.63311%
- hf_Bert_large, Rprop, cuda, foreach: +27.12062%
- timm_vovnet, Adamax, cuda, maximize: -10.70898%
- resnet152, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +22.55056%
- detectron2_fasterrcnn_r_50_fpn, Adagrad, cuda, (pt2) maximize: -21.56008%
- detectron2_fasterrcnn_r_50_fpn, SGD, cuda, (pt2) foreach, momentum=0.9: +63.48025%
- detectron2_fasterrcnn_r_50_fpn, Rprop, cuda, foreach: -17.44701%
- lennard_jones, Adadelta, cuda, foreach: +13.08048%
- lennard_jones, Adagrad, cuda, (pt2) foreach: +12.45143%
- lennard_jones, Adam, cuda, (pt2) default: -13.64392%
- lennard_jones, AdamW, cuda, fused, capturable, amsgrad: -11.26110%
- lennard_jones, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +38.27080%
- Super_SloMo, Adamax, cuda, (pt2) default: -13.38689%
- Super_SloMo, Adamax, cuda, default: +27.84152%
- Super_SloMo, Adamax, cuda, maximize: +15.53603%
- Super_SloMo, Adamax, cuda, foreach: +11.04281%
- Super_SloMo, Rprop, cuda, default: -11.55867%
- Super_SloMo, Rprop, cuda, (pt2) maximize: -15.95111%
- mnasnet1_0, Adagrad, cuda, maximize: +26.76661%
- mnasnet1_0, Adagrad, cuda, (pt2) foreach: +17.49466%
- mnasnet1_0, Adam, cuda, foreach, maximize, capturable: +11.93668%
- mnasnet1_0, Adamax, cuda, (pt2) maximize: +33.84867%
- mnasnet1_0, Rprop, cuda, foreach: +39.17865%
- hf_GPT2_large, RAdam, cuda, no_foreach: +14.02062%
- hf_GPT2_large, NAdam, cuda, foreach: +11.48284%
- hf_BigBird, Adagrad, cuda, maximize: +12.48981%
- hf_BigBird, Adagrad, cuda, foreach: +13.74999%
- phlippe_densenet, Adagrad, cuda, (pt2) default: +35.28811%
- phlippe_densenet, Adagrad, cuda, maximize: +36.21369%
- phlippe_densenet, Adagrad, cuda, (pt2) foreach: +35.17471%
- phlippe_densenet, ASGD, cuda, (pt2) maximize: +17.09425%
- timm_vision_transformer, Adadelta, cuda, (pt2) default: -12.14200%
- timm_vision_transformer, Adagrad, cuda, (pt2) maximize: +15.11985%
- timm_vision_transformer, Adagrad, cuda, (pt2) differentiable: +14.10571%
- timm_vision_transformer, AdamW, cuda, (pt2) foreach, maximize, capturable: -10.63389%
- timm_vision_transformer, ASGD, cuda, default: +11.30641%
- timm_vision_transformer, ASGD, cuda, (pt2) no_foreach: +12.08883%
- timm_vision_transformer, NAdam, cuda, (pt2) no_foreach: +12.17165%
- timm_resnest, Adadelta, cuda, maximize: +11.14189%
- timm_resnest, Adadelta, cuda, foreach: -11.25202%
- timm_resnest, ASGD, cuda, maximize: +20.25423%
- timm_resnest, ASGD, cuda, (pt2) foreach: +10.40782%
- timm_resnest, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -12.39224%
- timm_resnest, SGD, cuda, (pt2) foreach, momentum=0.9: -51.44716%
- functorch_dp_cifar10, Adadelta, cuda, (pt2) maximize: +10.49919%
- functorch_dp_cifar10, Adagrad, cuda, maximize: +10.89256%
- functorch_dp_cifar10, Adamax, cuda, foreach: -15.63804%
- functorch_dp_cifar10, ASGD, cuda, maximize: +10.91344%
- functorch_dp_cifar10, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +18.33701%
- functorch_dp_cifar10, SGD, cuda, (pt2) foreach, momentum=0.9: -12.84222%
- detectron2_fasterrcnn_r_101_dc5, Adamax, cuda, (pt2) maximize: -15.70017%
- DALLE2_pytorch, Adam, cuda, fused, amsgrad, maximize: +42.15537%
- DALLE2_pytorch, AdamW, cuda, (pt2) foreach, maximize, capturable: -10.90805%
- DALLE2_pytorch, Adamax, cuda, (pt2) maximize: -13.97606%
- DALLE2_pytorch, ASGD, cuda, maximize: +34.60023%
- DALLE2_pytorch, RAdam, cuda, foreach: +13.47158%
- DALLE2_pytorch, Rprop, cuda, foreach: +35.69265%
- tacotron2, Adadelta, cuda, (pt2) default: +10.44241%
- tacotron2, Adadelta, cuda, (pt2) foreach: -11.37204%
- tacotron2, Adagrad, cuda, (pt2) foreach: +10.75143%
- tacotron2, Adam, cuda, (pt2) foreach: -16.82882%
- resnext50_32x4d, ASGD, cuda, default: -14.55556%
- timm_regnet, Adadelta, cuda, (pt2) default: +12.04450%
- timm_regnet, Adam, cuda, foreach, maximize, capturable, amsgrad: +12.98484%
- timm_regnet, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -10.30266%
- attention_is_all_you_need_pytorch, Adagrad, cuda, (pt2) maximize: +22.11420%
- attention_is_all_you_need_pytorch, Adagrad, cuda, (pt2) foreach: +21.25857%
- attention_is_all_you_need_pytorch, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: -14.87213%
- attention_is_all_you_need_pytorch, AdamW, cuda, (pt2) foreach, maximize, capturable: +19.59653%
- attention_is_all_you_need_pytorch, Adamax, cuda, (pt2) foreach: +10.33821%
- attention_is_all_you_need_pytorch, ASGD, cuda, maximize: -15.74719%
- attention_is_all_you_need_pytorch, Rprop, cuda, (pt2) maximize: -22.59559%
- hf_GPT2, Adadelta, cuda, (pt2) default: -10.59372%
- hf_GPT2, Adamax, cuda, (pt2) maximize: +17.39768%
- hf_GPT2, ASGD, cuda, (pt2) foreach: +21.01928%
- pytorch_unet, SGD, cuda, (pt2) foreach, momentum=0.9: -23.86406%
- soft_actor_critic, Adadelta, cuda, (pt2) foreach: +11.71542%
- soft_actor_critic, Adam, cuda, (pt2) fused, capturable: -10.86192%
- drq, Adadelta, cuda, default: +12.82022%
- drq, Adadelta, cuda, foreach: +10.68071%
- drq, Adagrad, cuda, (pt2) default: -12.21161%
- drq, Adagrad, cuda, (pt2) maximize: -11.03856%
- drq, Adagrad, cuda, (pt2) foreach: +19.17463%
- drq, Rprop, cuda, default: +44.86367%
- Background_Matting, Adadelta, cuda, foreach: -13.41574%
- Background_Matting, Adagrad, cuda, default: +18.91427%
- Background_Matting, Adagrad, cuda, foreach: +17.19655%
- Background_Matting, AdamW, cuda, (pt2) default: +15.15966%
- Background_Matting, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -17.83727%
- Background_Matting, AdamW, cuda, foreach, maximize, capturable, amsgrad: +14.54809%
- Background_Matting, Adamax, cuda, (pt2) foreach: +35.02988%
- Background_Matting, Rprop, cuda, default: +26.40956%
- Background_Matting, Rprop, cuda, (pt2) foreach: +36.26213%
- Background_Matting, NAdam, cuda, (pt2) default: +19.67167%
- Background_Matting, NAdam, cuda, (pt2) foreach: +20.16572%
- demucs, Adadelta, cuda, (pt2) default: -11.45240%
- demucs, SGD, cuda, (pt2) foreach, momentum=0.9: -20.98388%
- detectron2_maskrcnn_r_101_fpn, AdamW, cuda, foreach, maximize, capturable, amsgrad: -15.33772%
- detectron2_maskrcnn_r_101_fpn, Adamax, cuda, (pt2) foreach: -22.07053%
- detectron2_maskrcnn_r_101_fpn, ASGD, cuda, (pt2) foreach: +17.72884%
- detectron2_maskrcnn_r_101_fpn, Rprop, cuda, maximize: +22.18533%
- hf_T5_base, ASGD, cuda, (pt2) default: -16.85178%
- hf_T5_base, ASGD, cuda, default: +18.09290%
- hf_T5_base, ASGD, cuda, foreach: +12.17878%
- hf_T5_base, Rprop, cuda, maximize: -10.51747%
- detectron2_fasterrcnn_r_101_c4, Adagrad, cuda, (pt2) default: -11.71938%
- detectron2_fasterrcnn_r_101_c4, Adagrad, cuda, (pt2) foreach: -24.21626%
- detectron2_fasterrcnn_r_101_c4, Adam, cuda, (pt2) foreach, maximize, capturable: -15.34815%
- detectron2_fasterrcnn_r_101_c4, Adam, cuda, foreach, maximize, capturable: +13.28859%
- detectron2_fasterrcnn_r_101_c4, AdamW, cuda, (pt2) foreach, maximize, capturable: +10.20318%
- detectron2_fasterrcnn_r_101_c4, Rprop, cuda, (pt2) default: +18.04077%
- resnet50, Adagrad, cuda, (pt2) foreach: +10.88984%
- resnet50, Adam, cuda, (pt2) differentiable: -14.34316%
- resnet50, Adam, cuda, (pt2) foreach: +11.69492%
- resnet50, Adam, cuda, (pt2) foreach, maximize, capturable: -10.24726%
- resnet50, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +20.33037%
- resnet50, NAdam, cuda, (pt2) differentiable: +17.86833%
- doctr_reco_predictor, Adadelta, cuda, (pt2) foreach: +13.41811%
- doctr_reco_predictor, Adagrad, cuda, default: +13.06080%
- doctr_reco_predictor, Adagrad, cuda, (pt2) foreach: +21.41028%
- doctr_reco_predictor, AdamW, cuda, amsgrad, maximize: +17.09957%
- doctr_reco_predictor, Adamax, cuda, maximize: +19.98322%
- doctr_reco_predictor, ASGD, cuda, foreach: +14.47972%
- doctr_reco_predictor, Rprop, cuda, (pt2) foreach: +28.84524%
- hf_DistilBert, Adagrad, cuda, foreach: +22.47037%
- hf_DistilBert, ASGD, cuda, (pt2) foreach: +40.41317%
- hf_Albert, Adadelta, cuda, (pt2) maximize: +10.09545%
- hf_Albert, Adadelta, cuda, (pt2) foreach: +10.62538%
- hf_Albert, AdamW, cuda, foreach, maximize, capturable: -10.74150%
- hf_Albert, ASGD, cuda, default: +12.58756%
- hf_Albert, Rprop, cuda, maximize: +19.49571%
- nanogpt_generate, ASGD, cuda, (pt2) default: +19.70077%
- nanogpt_generate, ASGD, cuda, default: +25.77799%
- detectron2_fasterrcnn_r_101_fpn, Rprop, cuda, (pt2) default: -10.15715%
- detectron2_fasterrcnn_r_101_fpn, Rprop, cuda, (pt2) maximize: -16.22152%
- detectron2_fasterrcnn_r_101_fpn, Rprop, cuda, foreach: -32.27404%
- detectron2_maskrcnn_r_101_c4, Adadelta, cuda, (pt2) maximize: -10.34669%
- detectron2_maskrcnn_r_101_c4, Adamax, cuda, maximize: -12.96856%
- detectron2_maskrcnn_r_101_c4, Adamax, cuda, foreach: -25.69457%
- detectron2_maskrcnn_r_101_c4, Rprop, cuda, (pt2) foreach: -18.01260%
- doctr_det_predictor, Adadelta, cuda, (pt2) maximize: -10.90668%
- doctr_det_predictor, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +14.85398%
- doctr_det_predictor, ASGD, cuda, maximize: +12.23065%
- doctr_det_predictor, RAdam, cuda, (pt2) foreach: +16.07554%
- doctr_det_predictor, Rprop, cuda, (pt2) foreach: -21.45562%
- yolov3, Adagrad, cuda, (pt2) maximize: -13.56923%
- yolov3, Adagrad, cuda, (pt2) no_foreach: +11.52963%
- yolov3, AdamW, cuda, (pt2) foreach: -10.38845%
- yolov3, Adamax, cuda, no_foreach: -10.48951%
- dcgan, Adagrad, cuda, default: -16.28515%
- dcgan, ASGD, cuda, (pt2) foreach: -13.27241%
- dcgan, Rprop, cuda, maximize: -17.95887%
- detectron2_fasterrcnn_r_50_c4, Adadelta, cuda, (pt2) default: -10.87722%
- detectron2_fasterrcnn_r_50_c4, Adagrad, cuda, foreach: -25.56575%
- detectron2_fasterrcnn_r_50_c4, Adam, cuda, foreach, maximize, capturable: +10.39541%
- detectron2_fasterrcnn_r_50_c4, Adamax, cuda, (pt2) maximize: -10.11444%
- detectron2_fasterrcnn_r_50_c4, ASGD, cuda, maximize: -16.60155%
- detectron2_fasterrcnn_r_50_c4, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +10.85929%
- detectron2_fasterrcnn_r_50_c4, SGD, cuda, (pt2) foreach, momentum=0.9: +14.17777%
- detectron2_fasterrcnn_r_50_c4, Rprop, cuda, (pt2) maximize: +10.59910%
- pytorch_struct, Adadelta, cuda, (pt2) foreach: +12.89473%
- pytorch_struct, Adagrad, cuda, default: +10.67507%
- pytorch_struct, Adagrad, cuda, (pt2) maximize: -10.69208%
- pytorch_struct, Adam, cuda, (pt2) default: -11.77156%
- hf_Reformer, AdamW, cuda, (pt2) foreach, maximize, capturable: -12.58296%
- hf_Reformer, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: +10.40632%
- hf_Reformer, Adamax, cuda, maximize: +23.16435%
- timm_efficientdet, Adam, cuda, (pt2) default: +10.11356%
- timm_efficientdet, AdamW, cuda, foreach, maximize, capturable, amsgrad: -12.23934%
- mobilenet_v2, AdamW, cuda, (pt2) foreach, maximize, capturable: +22.41405%
- mobilenet_v2, Rprop, cuda, (pt2) foreach: +10.83874%
- detectron2_maskrcnn_r_50_fpn, Adadelta, cuda, (pt2) foreach: +11.14311%
- detectron2_maskrcnn_r_50_fpn, Adagrad, cuda, (pt2) default: +24.91278%
- detectron2_maskrcnn_r_50_fpn, Adagrad, cuda, (pt2) foreach: +10.81507%
- detectron2_maskrcnn_r_50_fpn, Adamax, cuda, (pt2) default: +10.17051%
- detectron2_maskrcnn_r_50_fpn, ASGD, cuda, foreach: +10.58337%
- detectron2_maskrcnn_r_50_fpn, SGD, cuda, (pt2) foreach, momentum=0.9: -50.44477%
- BERT_pytorch, Adagrad, cuda, default: +37.15494%
- BERT_pytorch, Adagrad, cuda, no_foreach: +30.71572%
- BERT_pytorch, Adam, cuda, no_foreach: +18.55358%
- BERT_pytorch, AdamW, cuda, no_foreach: +19.04301%
- BERT_pytorch, Adamax, cuda, (pt2) differentiable: -14.06075%
- BERT_pytorch, Adamax, cuda, (pt2) foreach: +15.88497%
- BERT_pytorch, ASGD, cuda, default: +35.80297%
- BERT_pytorch, ASGD, cuda, (pt2) maximize: +18.41042%
- BERT_pytorch, ASGD, cuda, differentiable: +10.67304%
- BERT_pytorch, ASGD, cuda, foreach: +15.49398%
- BERT_pytorch, Rprop, cuda, default: -29.09629%
- BERT_pytorch, RMSprop, cuda, (pt2) no_foreach: +11.97477%
- BERT_pytorch, RMSprop, cuda, no_foreach: +32.45654%
- BERT_pytorch, NAdam, cuda, (pt2) no_foreach: -22.89217%
- BERT_pytorch, NAdam, cuda, (pt2) differentiable: -10.59984%
- BERT_pytorch, NAdam, cuda, differentiable: +21.76792%
- vision_maskrcnn, Adam, cuda, (pt2) fused: +10.22668%
- vision_maskrcnn, SGD, cuda, (pt2) foreach, momentum=0.9: -66.94339%
- vision_maskrcnn, Rprop, cuda, (pt2) foreach: -10.75198%
- detectron2_fasterrcnn_r_50_dc5, Adagrad, cuda, (pt2) maximize: -11.34467%
- detectron2_fasterrcnn_r_50_dc5, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +10.82579%
- mobilenet_v3_large, Adadelta, cuda, (pt2) foreach: +14.01822%
- mobilenet_v3_large, Adagrad, cuda, (pt2) foreach: +10.13037%
- mobilenet_v3_large, Adam, cuda, (pt2) foreach, maximize, capturable: -16.54559%
- mobilenet_v3_large, Adamax, cuda, (pt2) maximize: +25.24815%
- shufflenet_v2_x1_0, Adagrad, cuda, maximize: +18.01128%
- shufflenet_v2_x1_0, AdamW, cuda, amsgrad, maximize: -10.67135%
- tts_angular, Adagrad, cuda, (pt2) default: +10.42442%
- densenet121, Adagrad, cuda, (pt2) maximize: +38.17399%
- densenet121, Adamax, cuda, maximize: -10.31477%
- densenet121, ASGD, cuda, (pt2) maximize: +11.09135%
- densenet121, ASGD, cuda, maximize: +11.14851%
- densenet121, ASGD, cuda, (pt2) foreach: +19.45049%
- densenet121, RAdam, cuda, foreach: +11.05995%
- densenet121, Rprop, cuda, (pt2) default: +10.14220%
- densenet121, Rprop, cuda, default: -39.98182%
- densenet121, Rprop, cuda, foreach: -12.64309%
- basic_gnn_sage, Adadelta, cuda, (pt2) foreach: -22.73137%
- basic_gnn_sage, Adagrad, cuda, (pt2) maximize: +16.40742%
- basic_gnn_sage, Adagrad, cuda, (pt2) foreach: -17.45942%
- basic_gnn_sage, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -19.07331%
- basic_gnn_sage, AdamW, cuda, fused, amsgrad, maximize: +11.26481%
- basic_gnn_sage, ASGD, cuda, foreach: +23.38791%
- basic_gnn_sage, RMSprop, cuda, maximize: +16.28634%
- basic_gnn_sage, RMSprop, cuda, foreach: -17.47501%
- llama, Adamax, cuda, foreach: -12.51740%
- resnet18, Adagrad, cuda, (pt2) foreach: +12.55089%
- resnet18, Adam, cuda, default: +12.05201%
- resnet18, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -11.86711%
- opacus_cifar10, Adagrad, cuda, default: +19.29671%
- opacus_cifar10, Adagrad, cuda, (pt2) maximize: +16.07632%
- opacus_cifar10, Adagrad, cuda, maximize: +18.00978%
- opacus_cifar10, Adagrad, cuda, foreach: +13.48573%
- opacus_cifar10, Adam, cuda, (pt2) amsgrad, maximize: -13.99371%
- opacus_cifar10, Adam, cuda, (pt2) fused, amsgrad, maximize: -12.33381%
- detectron2_maskrcnn_r_50_c4, Adagrad, cuda, default: +10.73939%
- detectron2_maskrcnn_r_50_c4, Adamax, cuda, default: +14.54782%
- detectron2_maskrcnn_r_50_c4, ASGD, cuda, foreach: +10.97065%
- detectron2_maskrcnn_r_50_c4, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -17.15368%
- detectron2_maskrcnn_r_50_c4, SGD, cuda, (pt2) foreach, momentum=0.9: -13.18500%
- detectron2_maskrcnn_r_50_c4, Rprop, cuda, foreach: +13.39249%
- mobilenet_v2_quantized_qat, Adamax, cuda, default: +17.02101%
- basic_gnn_gin, Adadelta, cuda, (pt2) default: -14.72463%
- basic_gnn_gin, Adadelta, cuda, default: +14.96690%
- basic_gnn_gin, Adadelta, cuda, (pt2) maximize: -10.78421%
- basic_gnn_gin, Adagrad, cuda, (pt2) maximize: -10.31754%
- basic_gnn_gin, Adam, cuda, (pt2) amsgrad, maximize: -14.16083%
- basic_gnn_gin, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +18.23224%
- basic_gnn_gin, AdamW, cuda, (pt2) amsgrad, maximize: +11.02967%
- basic_gnn_gin, Rprop, cuda, default: -34.78597%
- functorch_maml_omniglot, Adagrad, cuda, foreach: +11.12108%
- speech_transformer, Adagrad, cuda, maximize: +16.49917%
- speech_transformer, ASGD, cuda, (pt2) maximize: +14.22791%
- basic_gnn_gcn, Adadelta, cuda, (pt2) default: -10.01115%
- basic_gnn_gcn, Adagrad, cuda, (pt2) maximize: +12.25135%
- basic_gnn_gcn, Adam, cuda, default: -10.67896%
- basic_gnn_gcn, Adam, cuda, (pt2) fused, capturable, amsgrad: -10.09188%
- basic_gnn_gcn, AdamW, cuda, (pt2) amsgrad, maximize: -13.30018%
- basic_gnn_gcn, SGD, cuda, (pt2) default: -21.50831%
- basic_gnn_gcn, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -13.26904%
- basic_gnn_gcn, Rprop, cuda, default: -14.88732%
- maml_omniglot, AdamW, cuda, amsgrad, maximize: +12.99761%
- cm3leon_generate, Adagrad, cuda, (pt2) maximize: +16.59038%
- timm_efficientnet, AdamW, cuda, (pt2) default: +11.76824%
- timm_efficientnet, Adamax, cuda, default: +13.42221%
- hf_Bert, Rprop, cuda, (pt2) default: -11.00264%
- squeezenet1_1, Adagrad, cuda, default: +16.16388%
- squeezenet1_1, Adagrad, cuda, (pt2) foreach: +21.95199%
- squeezenet1_1, AdamW, cuda, (pt2) fused, capturable, amsgrad: -10.20801%
- squeezenet1_1, NAdam, cuda, (pt2) foreach: -10.69909%


Tests that were no longer run on affected commit:


Tests that were newly added on affected commit:


Runtime regressions found?
No runtime errors were found in the new benchmarks run--you are all good there!

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/4999189008

cc @janeyx99


This time we have:
Total: 295
Speedups: 115 | Slowdowns: 180
pt2: 181
Things within 20%:  225

Hmmmm should I change the threshold to 20%? Stay tuned tomorrow