Repository: pytorch/benchmark
Issue: V2 Performance Signal Detected by TorchBench CI on '61239df555df02e8c60a2ad63363878a2a57c161'
Root cause: Algorithmic Error


TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: 61239df555df02e8c60a2ad63363878a2a57c161

Affected PyTorch commit: 61239df555df02e8c60a2ad63363878a2a57c161

Affected Tests:
- resnet152, ASGD, cuda, (pt2) maximize: -26.70721%
- resnet152, Rprop, cuda, (pt2) maximize: -11.36957%
- maml, Adam, cuda, (pt2) default: -11.80658%
- maml, AdamW, cuda, foreach, maximize, capturable, amsgrad: +15.35835%
- maml, Adamax, cuda, (pt2) foreach: -23.64292%
- maml, ASGD, cuda, (pt2) foreach: -29.00865%
- maml, RAdam, cuda, (pt2) default: -11.43351%
- maml, Rprop, cuda, (pt2) maximize: -29.59821%
- maml, Rprop, cuda, maximize: +12.65809%
- basic_gnn_edgecnn, Adam, cuda, (pt2) foreach, maximize, capturable: +10.07433%
- basic_gnn_edgecnn, Adamax, cuda, (pt2) default: +19.35783%
- basic_gnn_edgecnn, ASGD, cuda, maximize: +18.47360%
- basic_gnn_edgecnn, ASGD, cuda, foreach: +14.58017%
- basic_gnn_edgecnn, RAdam, cuda, (pt2) default: +11.76654%
- basic_gnn_edgecnn, Rprop, cuda, default: +28.16688%
- basic_gnn_edgecnn, Rprop, cuda, maximize: +11.48363%
- basic_gnn_edgecnn, RMSprop, cuda, foreach: +16.29502%
- timm_vovnet, Adagrad, cuda, default: -11.09558%
- timm_vovnet, Adamax, cuda, default: -24.79264%
- timm_vovnet, Adamax, cuda, maximize: -24.68796%
- timm_vovnet, ASGD, cuda, (pt2) maximize: -10.50366%
- timm_vovnet, RAdam, cuda, default: -19.23441%
- timm_vovnet, Rprop, cuda, (pt2) default: -20.11134%
- timm_vovnet, Rprop, cuda, (pt2) foreach: -32.12505%
- timm_vovnet, Rprop, cuda, foreach: -18.88337%
- Background_Matting, Adagrad, cuda, (pt2) maximize: -11.59322%
- Background_Matting, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +15.36486%
- Background_Matting, AdamW, cuda, (pt2) default: -12.53126%
- Background_Matting, Adamax, cuda, foreach: +14.81062%
- Background_Matting, ASGD, cuda, foreach: +17.87331%
- Background_Matting, NAdam, cuda, foreach: +10.49253%
- opacus_cifar10, Adagrad, cuda, (pt2) maximize: +21.82247%
- opacus_cifar10, AdamW, cuda, foreach, maximize, capturable: +21.64264%
- opacus_cifar10, Adamax, cuda, default: -15.63931%
- opacus_cifar10, Adamax, cuda, (pt2) maximize: -21.75036%
- opacus_cifar10, Adamax, cuda, foreach: -22.23867%
- opacus_cifar10, ASGD, cuda, maximize: +15.53468%
- phlippe_resnet, Adam, cuda, (pt2) default: -12.49478%
- phlippe_resnet, Adamax, cuda, (pt2) maximize: -22.46512%
- phlippe_resnet, Rprop, cuda, foreach: +11.74996%
- moco, ASGD, cuda, (pt2) foreach: -22.53215%
- doctr_det_predictor, Adagrad, cuda, default: +40.99683%
- doctr_det_predictor, AdamW, cuda, (pt2) foreach, maximize, capturable: -10.55323%
- doctr_det_predictor, AdamW, cuda, foreach, maximize, capturable: -18.14086%
- doctr_det_predictor, ASGD, cuda, (pt2) default: -12.00957%
- doctr_det_predictor, ASGD, cuda, maximize: +13.89837%
- timm_efficientdet, Adadelta, cuda, (pt2) foreach: +14.50723%
- timm_efficientdet, Adam, cuda, foreach: +10.14883%
- timm_efficientdet, Adam, cuda, foreach, maximize, capturable: +12.75264%
- timm_efficientdet, Adamax, cuda, maximize: -14.15656%
- timm_efficientdet, ASGD, cuda, (pt2) default: -23.33315%
- timm_efficientdet, ASGD, cuda, (pt2) foreach: +13.59839%
- timm_efficientdet, NAdam, cuda, default: -12.56657%
- hf_T5_large, AdamW, cuda, no_foreach: -18.74204%
- hf_T5_large, RAdam, cuda, (pt2) foreach: +12.19073%
- hf_T5_large, RMSprop, cuda, no_foreach: -27.98567%
- hf_T5_large, RMSprop, cuda, (pt2) differentiable: +10.41560%
- pytorch_unet, ASGD, cuda, foreach: -20.36344%
- pytorch_unet, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +50.54502%
- pytorch_unet, SGD, cuda, (pt2) foreach, momentum=0.9: +99.31296%
- pytorch_unet, Rprop, cuda, (pt2) default: -30.74260%
- detectron2_maskrcnn_r_50_fpn, AdamW, cuda, foreach, maximize, capturable: -12.81829%
- detectron2_maskrcnn_r_50_fpn, RAdam, cuda, (pt2) foreach: +15.91883%
- detectron2_maskrcnn_r_50_fpn, Rprop, cuda, (pt2) foreach: +12.28071%
- detectron2_maskrcnn, Adagrad, cuda, (pt2) default: -10.30156%
- detectron2_maskrcnn, Adam, cuda, (pt2) foreach, maximize, capturable: +16.55898%
- detectron2_maskrcnn, ASGD, cuda, (pt2) default: +42.85036%
- detectron2_maskrcnn, ASGD, cuda, maximize: -21.42523%
- detectron2_maskrcnn, Rprop, cuda, maximize: -21.50942%
- detectron2_maskrcnn, Rprop, cuda, (pt2) foreach: +13.49724%
- squeezenet1_1, Adadelta, cuda, (pt2) foreach: -10.55450%
- squeezenet1_1, Adagrad, cuda, default: -12.53007%
- squeezenet1_1, Adam, cuda, (pt2) foreach, maximize, capturable: -13.37511%
- squeezenet1_1, Adamax, cuda, foreach: -17.69727%
- squeezenet1_1, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +10.75022%
- squeezenet1_1, SGD, cuda, (pt2) foreach, momentum=0.9: +21.65740%
- squeezenet1_1, Rprop, cuda, (pt2) maximize: -26.04235%
- mobilenet_v3_large, Adam, cuda, (pt2) foreach: +15.30968%
- mobilenet_v3_large, Adam, cuda, (pt2) foreach, maximize, capturable: +15.31024%
- mobilenet_v3_large, AdamW, cuda, (pt2) amsgrad, maximize: +35.20007%
- mobilenet_v3_large, Adamax, cuda, maximize: +27.89959%
- mobilenet_v3_large, Adamax, cuda, (pt2) foreach: -19.91697%
- mobilenet_v3_large, ASGD, cuda, maximize: +12.91231%
- mobilenet_v3_large, Rprop, cuda, default: +12.25413%
- mobilenet_v3_large, Rprop, cuda, maximize: +13.29801%
- soft_actor_critic, AdamW, cuda, (pt2) foreach, maximize, capturable: -11.10432%
- soft_actor_critic, Adamax, cuda, (pt2) default: -18.45100%
- soft_actor_critic, Adamax, cuda, default: -16.16745%
- soft_actor_critic, NAdam, cuda, (pt2) default: -11.14417%
- fambench_xlmr, ASGD, cuda, (pt2) maximize: +14.34782%
- pytorch_struct, AdamW, cuda, (pt2) amsgrad, maximize: -13.44242%
- pytorch_struct, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -20.74441%
- pytorch_struct, AdamW, cuda, foreach, maximize, capturable, amsgrad: -15.16853%
- pytorch_struct, RMSprop, cuda, (pt2) default: -10.00815%
- timm_nfnet, AdamW, cuda, (pt2) foreach, maximize, capturable: -12.60597%
- timm_nfnet, ASGD, cuda, (pt2) default: -16.08915%
- doctr_reco_predictor, Adagrad, cuda, (pt2) maximize: +21.90477%
- doctr_reco_predictor, AdamW, cuda, (pt2) foreach, maximize, capturable: +21.93337%
- doctr_reco_predictor, ASGD, cuda, (pt2) default: -10.77631%
- doctr_reco_predictor, ASGD, cuda, default: +41.91755%
- doctr_reco_predictor, ASGD, cuda, maximize: -11.10400%
- doctr_reco_predictor, ASGD, cuda, (pt2) foreach: +18.98600%
- doctr_reco_predictor, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -10.88884%
- doctr_reco_predictor, Rprop, cuda, (pt2) default: -26.76900%
- doctr_reco_predictor, NAdam, cuda, (pt2) foreach: +10.49594%
- mnasnet1_0, Adam, cuda, default: -11.00885%
- mnasnet1_0, Adamax, cuda, foreach: +16.62146%
- mnasnet1_0, ASGD, cuda, (pt2) maximize: -13.95311%
- hf_Longformer, Adamax, cuda, default: -12.04231%
- hf_Longformer, Rprop, cuda, (pt2) default: -31.82841%
- detectron2_maskrcnn_r_50_c4, Adagrad, cuda, default: +23.18592%
- detectron2_maskrcnn_r_50_c4, Adamax, cuda, maximize: +15.89505%
- detectron2_maskrcnn_r_50_c4, ASGD, cuda, (pt2) default: +11.21990%
- detectron2_maskrcnn_r_50_c4, ASGD, cuda, default: +48.54926%
- detectron2_maskrcnn_r_50_c4, Rprop, cuda, maximize: +17.24874%
- basic_gnn_gin, Adadelta, cuda, maximize: +16.94640%
- basic_gnn_gin, Adadelta, cuda, foreach: +18.94039%
- basic_gnn_gin, Adagrad, cuda, default: +40.10875%
- basic_gnn_gin, Adagrad, cuda, maximize: -10.69715%
- basic_gnn_gin, Adamax, cuda, (pt2) default: +30.19628%
- basic_gnn_gin, Adamax, cuda, (pt2) foreach: +27.54305%
- basic_gnn_gin, RMSprop, cuda, maximize: +11.06649%
- basic_gnn_gin, NAdam, cuda, default: +20.71175%
- dcgan, Adagrad, cuda, (pt2) foreach: +13.84371%
- dcgan, Adam, cuda, (pt2) amsgrad, maximize: +10.35106%
- dcgan, AdamW, cuda, foreach, maximize, capturable, amsgrad: +25.84892%
- dcgan, Adamax, cuda, (pt2) maximize: +15.60140%
- dcgan, ASGD, cuda, (pt2) default: -22.23382%
- dcgan, Rprop, cuda, maximize: +40.94713%
- dcgan, Rprop, cuda, foreach: +29.49148%
- dcgan, RMSprop, cuda, default: +14.68525%
- dcgan, RMSprop, cuda, maximize: +15.94863%
- densenet121, Adagrad, cuda, maximize: +20.40317%
- densenet121, Adagrad, cuda, foreach: -19.49794%
- densenet121, Adam, cuda, (pt2) foreach: +10.18014%
- densenet121, Rprop, cuda, (pt2) default: +11.54315%
- densenet121, Rprop, cuda, maximize: -14.08797%
- detectron2_maskrcnn_r_101_fpn, Adamax, cuda, maximize: -26.36738%
- detectron2_maskrcnn_r_101_fpn, Adamax, cuda, foreach: -25.99243%
- detectron2_maskrcnn_r_101_fpn, ASGD, cuda, (pt2) maximize: +43.29782%
- detectron2_maskrcnn_r_101_fpn, ASGD, cuda, maximize: +34.65497%
- detectron2_maskrcnn_r_101_fpn, ASGD, cuda, foreach: -13.47205%
- LearningToPaint, Adagrad, cuda, (pt2) default: +11.69446%
- LearningToPaint, Adagrad, cuda, maximize: -12.21500%
- LearningToPaint, AdamW, cuda, foreach: -12.14906%
- LearningToPaint, RAdam, cuda, default: +25.32940%
- detectron2_fasterrcnn_r_101_dc5, Adamax, cuda, (pt2) maximize: +18.04972%
- hf_GPT2, Rprop, cuda, (pt2) default: -30.08374%
- hf_GPT2, Rprop, cuda, foreach: +15.58955%
- mobilenet_v2, Adagrad, cuda, foreach: -12.11016%
- mobilenet_v2, ASGD, cuda, (pt2) foreach: -34.43214%
- mobilenet_v2, ASGD, cuda, foreach: -11.22729%
- mobilenet_v2, Rprop, cuda, (pt2) maximize: -10.52955%
- timm_vision_transformer, Adadelta, cuda, (pt2) no_foreach: -10.58562%
- timm_vision_transformer, AdamW, cuda, foreach: +12.23901%
- timm_vision_transformer, AdamW, cuda, (pt2) foreach, maximize, capturable: -12.99451%
- timm_vision_transformer, Adamax, cuda, (pt2) no_foreach: -11.81785%
- timm_vision_transformer, SGD, cuda, no_foreach: -30.30547%
- timm_vision_transformer, RAdam, cuda, no_foreach: -15.78638%
- timm_vision_transformer, RAdam, cuda, foreach: -11.23664%
- timm_vision_transformer, Rprop, cuda, (pt2) foreach: -27.89307%
- tacotron2, SGD, cuda, (pt2) foreach, momentum=0.9: +11.93211%
- tacotron2, Rprop, cuda, maximize: +10.26656%
- hf_T5_base, Adagrad, cuda, default: +16.50121%
- hf_T5_base, Adamax, cuda, (pt2) default: -19.54848%
- hf_Reformer, Adam, cuda, (pt2) foreach: +14.35604%
- hf_Reformer, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +21.37489%
- hf_Reformer, AdamW, cuda, foreach, maximize, capturable, amsgrad: +10.47098%
- hf_Reformer, Adamax, cuda, (pt2) default: +24.83579%
- hf_Reformer, SGD, cuda, (pt2) foreach, momentum=0.9: +298.77511%
- hf_Reformer, RAdam, cuda, (pt2) default: +17.35493%
- pytorch_stargan, AdamW, cuda, default: +13.39849%
- pytorch_stargan, AdamW, cuda, foreach: -11.01690%
- pytorch_stargan, AdamW, cuda, foreach, maximize, capturable, amsgrad: +12.17688%
- pytorch_stargan, Rprop, cuda, default: -14.71337%
- timm_efficientnet, Adagrad, cuda, (pt2) maximize: -14.30759%
- vision_maskrcnn, Adamax, cuda, foreach: -11.92459%
- vision_maskrcnn, ASGD, cuda, foreach: -20.37496%
- vision_maskrcnn, Rprop, cuda, maximize: -30.64211%
- vision_maskrcnn, Rprop, cuda, foreach: -31.77217%
- hf_T5, Adagrad, cuda, (pt2) maximize: -12.58571%
- hf_T5, Adam, cuda, foreach, maximize, capturable: -14.59181%
- hf_T5, Adamax, cuda, (pt2) default: -21.33609%
- hf_T5, Adamax, cuda, default: +15.97983%
- hf_T5, ASGD, cuda, default: +13.12001%
- phlippe_densenet, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: -11.41410%
- phlippe_densenet, Rprop, cuda, maximize: -11.81223%
- llama, Adamax, cuda, default: -15.94793%
- llama, Rprop, cuda, maximize: -27.78953%
- llama, NAdam, cuda, (pt2) default: -10.60715%
- timm_regnet, AdamW, cuda, (pt2) foreach, maximize, capturable: -12.56214%
- timm_regnet, ASGD, cuda, maximize: -10.32653%
- functorch_dp_cifar10, Adam, cuda, foreach: +11.46752%
- functorch_dp_cifar10, ASGD, cuda, (pt2) default: +40.69299%
- functorch_dp_cifar10, RAdam, cuda, default: +16.03111%
- BERT_pytorch, Adadelta, cuda, differentiable: +22.24455%
- BERT_pytorch, Adamax, cuda, maximize: +12.80378%
- BERT_pytorch, Adamax, cuda, no_foreach: +11.43728%
- BERT_pytorch, Adamax, cuda, differentiable: -16.82775%
- BERT_pytorch, Rprop, cuda, (pt2) default: -21.75557%
- BERT_pytorch, Rprop, cuda, maximize: +30.64101%
- BERT_pytorch, RMSprop, cuda, no_foreach: -33.38305%
- BERT_pytorch, RMSprop, cuda, differentiable: +16.04301%
- BERT_pytorch, NAdam, cuda, differentiable: +11.51106%
- resnet50, Adagrad, cuda, differentiable: -31.09572%
- resnet50, Adagrad, cuda, (pt2) foreach: -27.83224%
- resnet50, Adam, cuda, (pt2) differentiable: -10.53943%
- resnet50, ASGD, cuda, (pt2) default: +32.64926%
- resnet50, ASGD, cuda, (pt2) maximize: -15.55929%
- resnet50, Rprop, cuda, foreach: -20.81917%
- resnet50, RMSprop, cuda, no_foreach: -10.60675%
- speech_transformer, AdamW, cuda, foreach, maximize, capturable: -17.63376%
- speech_transformer, ASGD, cuda, (pt2) default: -20.06106%
- speech_transformer, Rprop, cuda, (pt2) foreach: -24.79732%
- timm_resnest, Rprop, cuda, maximize: -15.49178%
- resnet50_quantized_qat, ASGD, cuda, default: -14.91513%
- resnet50_quantized_qat, ASGD, cuda, maximize: -20.35597%
- resnet50_quantized_qat, Rprop, cuda, (pt2) foreach: +15.78313%
- detectron2_fasterrcnn_r_50_c4, Adamax, cuda, maximize: +10.03374%
- detectron2_fasterrcnn_r_50_c4, SGD, cuda, (pt2) foreach, momentum=0.9: -10.38512%
- detectron2_fasterrcnn_r_50_c4, Rprop, cuda, (pt2) default: +38.31636%
- detectron2_fasterrcnn_r_50_c4, Rprop, cuda, default: +35.19523%
- detectron2_fasterrcnn_r_50_c4, Rprop, cuda, maximize: +44.55766%
- detectron2_fasterrcnn_r_50_c4, Rprop, cuda, (pt2) foreach: -26.15523%
- functorch_maml_omniglot, Adadelta, cuda, default: +19.37228%
- functorch_maml_omniglot, Adagrad, cuda, foreach: +29.63994%
- functorch_maml_omniglot, ASGD, cuda, maximize: +12.19074%
- functorch_maml_omniglot, ASGD, cuda, (pt2) foreach: +37.41773%
- functorch_maml_omniglot, Rprop, cuda, (pt2) maximize: +10.77623%
- functorch_maml_omniglot, NAdam, cuda, default: +13.84042%
- nanogpt_generate, Rprop, cuda, (pt2) default: -28.71561%
- nanogpt_generate, Rprop, cuda, (pt2) maximize: -28.88319%
- demucs, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +29.10218%
- hf_Bert, Adagrad, cuda, (pt2) foreach: -16.43509%
- hf_Bert, Adamax, cuda, default: -17.54326%
- hf_Bert, ASGD, cuda, (pt2) foreach: +26.92188%
- detectron2_maskrcnn_r_101_c4, Adamax, cuda, maximize: +24.38839%
- detectron2_maskrcnn_r_101_c4, Adamax, cuda, foreach: +13.55522%
- detectron2_maskrcnn_r_101_c4, ASGD, cuda, (pt2) maximize: +43.39737%
- detectron2_maskrcnn_r_101_c4, Rprop, cuda, (pt2) maximize: +27.64297%
- hf_GPT2_large, AdamW, cuda, foreach, maximize, capturable: +12.33132%
- hf_GPT2_large, Adamax, cuda, (pt2) no_foreach: +12.27124%
- hf_GPT2_large, Rprop, cuda, (pt2) foreach: -12.35636%
- hf_GPT2_large, NAdam, cuda, default: +14.12990%
- fastNLP_Bert, Adagrad, cuda, (pt2) foreach: +11.88850%
- fastNLP_Bert, ASGD, cuda, (pt2) default: +27.40013%
- fastNLP_Bert, ASGD, cuda, default: +22.41599%
- fastNLP_Bert, Rprop, cuda, (pt2) foreach: -10.17502%
- detectron2_fasterrcnn_r_101_c4, Adagrad, cuda, (pt2) default: -25.17649%
- detectron2_fasterrcnn_r_101_c4, Adam, cuda, foreach, maximize, capturable: -12.77798%
- detectron2_fasterrcnn_r_101_c4, Adamax, cuda, (pt2) maximize: -19.09883%
- detectron2_fasterrcnn_r_101_c4, ASGD, cuda, foreach: +20.01436%
- basic_gnn_sage, Adagrad, cuda, (pt2) default: -23.72640%
- basic_gnn_sage, AdamW, cuda, (pt2) foreach: +13.75404%
- basic_gnn_sage, AdamW, cuda, fused: +12.41260%
- basic_gnn_sage, SGD, cuda, (pt2) foreach: -23.45331%
- basic_gnn_sage, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -34.44052%
- basic_gnn_sage, SGD, cuda, foreach, momentum=0.9: -11.86863%
- basic_gnn_sage, RAdam, cuda, foreach: +27.88997%
- basic_gnn_sage, Rprop, cuda, (pt2) default: -18.60691%
- basic_gnn_sage, RMSprop, cuda, default: +13.03006%
- basic_gnn_sage, RMSprop, cuda, maximize: +20.06418%
- basic_gnn_sage, RMSprop, cuda, foreach: +19.36378%
- drq, Adagrad, cuda, maximize: +13.95813%
- drq, ASGD, cuda, maximize: +24.54594%
- drq, ASGD, cuda, (pt2) foreach: +35.95023%
- drq, ASGD, cuda, foreach: +10.47170%
- drq, RAdam, cuda, default: +17.87223%
- drq, Rprop, cuda, default: +21.60647%
- DALLE2_pytorch, Adagrad, cuda, foreach: +17.71746%
- DALLE2_pytorch, Adamax, cuda, foreach: +17.24302%
- DALLE2_pytorch, RAdam, cuda, foreach: +21.50840%
- DALLE2_pytorch, Rprop, cuda, default: -13.31408%
- basic_gnn_gcn, Adam, cuda, (pt2) foreach: +10.77218%
- basic_gnn_gcn, Adam, cuda, foreach: -11.44005%
- basic_gnn_gcn, AdamW, cuda, foreach, maximize, capturable, amsgrad: +10.54626%
- basic_gnn_gcn, RMSprop, cuda, default: +13.48956%
- basic_gnn_gcn, NAdam, cuda, (pt2) default: +16.48359%
- hf_BigBird, ASGD, cuda, maximize: -15.55178%
- hf_BigBird, Rprop, cuda, (pt2) default: -24.92132%
- resnext50_32x4d, RAdam, cuda, foreach: -11.13449%
- hf_Albert, AdamW, cuda, foreach, maximize, capturable: +11.43218%
- hf_Albert, Adamax, cuda, maximize: +11.27102%
- hf_Albert, ASGD, cuda, default: +30.08483%
- hf_Albert, ASGD, cuda, (pt2) maximize: +38.45062%
- hf_Albert, ASGD, cuda, maximize: +38.32180%
- hf_Albert, Rprop, cuda, default: +23.53694%
- hf_Albert, NAdam, cuda, foreach: +12.61388%
- detectron2_fasterrcnn_r_101_fpn, Adagrad, cuda, maximize: +37.58974%
- detectron2_fasterrcnn_r_101_fpn, Adam, cuda, foreach, maximize, capturable, amsgrad: +11.72084%
- detectron2_fasterrcnn_r_101_fpn, Adamax, cuda, foreach: +14.65182%
- detectron2_fasterrcnn_r_101_fpn, RAdam, cuda, (pt2) default: +18.61861%
- detectron2_fasterrcnn_r_101_fpn, Rprop, cuda, (pt2) maximize: +10.22397%
- detectron2_fasterrcnn_r_50_fpn, Adamax, cuda, foreach: +17.02507%
- detectron2_fasterrcnn_r_50_fpn, Rprop, cuda, (pt2) default: +44.85441%
- detectron2_fasterrcnn_r_50_fpn, Rprop, cuda, maximize: -12.54462%
- tts_angular, Rprop, cuda, default: -14.66004%
- tts_angular, Rprop, cuda, foreach: -28.71247%
- hf_DistilBert, Adamax, cuda, default: +16.47624%
- detectron2_fasterrcnn_r_50_dc5, SGD, cuda, (pt2) foreach, momentum=0.9: -17.02137%
- hf_Bart, Adagrad, cuda, default: +20.43146%
- hf_Bart, Rprop, cuda, (pt2) maximize: -11.66945%
- yolov3, Adagrad, cuda, (pt2) default: +12.84407%
- yolov3, Adagrad, cuda, maximize: +15.38334%
- yolov3, Adagrad, cuda, (pt2) no_foreach: -18.89740%
- yolov3, AdamW, cuda, differentiable: -22.60359%
- yolov3, AdamW, cuda, foreach, maximize, capturable: +12.79810%
- yolov3, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: +14.63659%
- yolov3, Adamax, cuda, (pt2) differentiable: +13.12427%
- yolov3, ASGD, cuda, (pt2) foreach: -29.28654%
- yolov3, ASGD, cuda, foreach: -24.92798%
- yolov3, RAdam, cuda, default: +13.18466%
- yolov3, RAdam, cuda, foreach: -13.66986%
- shufflenet_v2_x1_0, AdamW, cuda, (pt2) foreach, maximize, capturable: +13.20980%
- shufflenet_v2_x1_0, RAdam, cuda, (pt2) default: +10.21003%
- shufflenet_v2_x1_0, Rprop, cuda, (pt2) default: +10.79949%
- shufflenet_v2_x1_0, Rprop, cuda, (pt2) foreach: -11.19333%
- hf_Bert_large, Adamax, cuda, (pt2) default: +13.22288%
- hf_Bert_large, ASGD, cuda, default: -22.13152%
- hf_Bert_large, Rprop, cuda, (pt2) default: +10.65958%
- attention_is_all_you_need_pytorch, Adam, cuda, (pt2) foreach, maximize, capturable: +15.76218%
- attention_is_all_you_need_pytorch, ASGD, cuda, (pt2) maximize: +29.89549%
- attention_is_all_you_need_pytorch, ASGD, cuda, (pt2) foreach: +23.76496%
- attention_is_all_you_need_pytorch, ASGD, cuda, foreach: -11.11704%
- attention_is_all_you_need_pytorch, RAdam, cuda, (pt2) default: +14.06877%
- attention_is_all_you_need_pytorch, RAdam, cuda, (pt2) foreach: +20.14739%
- hf_T5_generate, Adagrad, cuda, maximize: +16.22029%
- hf_T5_generate, AdamW, cuda, foreach, maximize, capturable: +14.24164%
- hf_T5_generate, Adamax, cuda, default: -11.75204%
- hf_T5_generate, ASGD, cuda, foreach: +13.73504%
- lennard_jones, Adam, cuda, foreach, maximize, capturable, amsgrad: -14.93068%
- lennard_jones, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -10.61540%
- lennard_jones, ASGD, cuda, (pt2) default: -24.77542%
- lennard_jones, ASGD, cuda, maximize: -15.34266%
- lennard_jones, SGD, cuda, foreach, momentum=0.9: -15.94286%
- lennard_jones, Rprop, cuda, (pt2) maximize: -10.24342%
- lennard_jones, NAdam, cuda, foreach: -10.45695%
- Super_SloMo, AdamW, cuda, (pt2) foreach, maximize, capturable: +14.53525%
- Super_SloMo, AdamW, cuda, foreach, maximize, capturable: +13.00840%
- Super_SloMo, Adamax, cuda, (pt2) foreach: -13.88161%
- Super_SloMo, ASGD, cuda, default: -13.25938%
- Super_SloMo, Rprop, cuda, maximize: +13.07365%
- maml_omniglot, Adadelta, cuda, maximize: -15.88731%
- pytorch_CycleGAN_and_pix2pix, Adagrad, cuda, default: -10.79603%
- pytorch_CycleGAN_and_pix2pix, Adagrad, cuda, maximize: -10.24472%
- pytorch_CycleGAN_and_pix2pix, Adagrad, cuda, foreach: -10.34238%
- pytorch_CycleGAN_and_pix2pix, ASGD, cuda, default: -14.24663%
- pytorch_CycleGAN_and_pix2pix, RAdam, cuda, foreach: -20.69316%
- pytorch_CycleGAN_and_pix2pix, Rprop, cuda, (pt2) maximize: -21.78718%
- mobilenet_v2_quantized_qat, Adagrad, cuda, (pt2) foreach: -11.21110%
- mobilenet_v2_quantized_qat, Adagrad, cuda, foreach: +11.93324%
- mobilenet_v2_quantized_qat, Rprop, cuda, default: +13.99761%
- resnet18, Adam, cuda, (pt2) foreach: -10.31932%
- resnet18, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -17.47634%
- resnet18, RAdam, cuda, (pt2) foreach: -16.67772%


Tests that were no longer run on affected commit:


Tests that were newly added on affected commit:


Runtime regressions found?
No runtime errors were found in the new benchmarks run--you are all good there!

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/5041660526

cc @janeyx99


This was NOT part of the rerun whose stats are taken account of here https://docs.google.com/spreadsheets/d/1r3a7UczDofej8p6KhAcbTf8moxnlbyQ1AWZKOo0kbh8/edit#gid=418753160

however, this tests the same commit