Repository: pytorch/benchmark
Issue: V2 Performance Signal Detected by TorchBench CI on '61239df555df02e8c60a2ad63363878a2a57c161'
Root cause: Algorithmic Error


TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: 329bb2a33e40f4bc76b2e061b180d3234984c91b

Affected PyTorch commit: 61239df555df02e8c60a2ad63363878a2a57c161

Affected Tests:
- timm_vision_transformer, Adadelta, cuda, no_foreach: +53.53932%
- timm_vision_transformer, Adagrad, cuda, maximize: +32.12325%
- timm_vision_transformer, Adagrad, cuda, (pt2) foreach: -11.34721%
- timm_vision_transformer, Adam, cuda, differentiable: +23.48854%
- timm_vision_transformer, AdamW, cuda, (pt2) no_foreach: -10.08515%
- timm_vision_transformer, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -11.53268%
- timm_vision_transformer, Adamax, cuda, no_foreach: +25.74496%
- timm_vision_transformer, ASGD, cuda, (pt2) no_foreach: -12.67811%
- timm_vision_transformer, ASGD, cuda, no_foreach: -10.13679%
- timm_vision_transformer, ASGD, cuda, (pt2) differentiable: +25.57148%
- timm_vision_transformer, ASGD, cuda, differentiable: +47.56361%
- timm_vision_transformer, SGD, cuda, no_foreach: +42.94818%
- timm_vision_transformer, Rprop, cuda, maximize: +25.40260%
- timm_vision_transformer, Rprop, cuda, no_foreach: -11.04615%
- timm_vision_transformer, RMSprop, cuda, maximize: -12.93588%
- timm_vision_transformer, NAdam, cuda, no_foreach: +16.33970%
- timm_vision_transformer, NAdam, cuda, foreach: -10.89150%
- detectron2_maskrcnn_r_101_fpn, Adamax, cuda, (pt2) maximize: +23.75005%
- detectron2_maskrcnn_r_101_fpn, Adamax, cuda, foreach: +24.93651%
- detectron2_maskrcnn_r_101_fpn, Rprop, cuda, (pt2) default: +10.17308%
- detectron2_maskrcnn_r_101_fpn, Rprop, cuda, maximize: +27.86769%
- tts_angular, Adagrad, cuda, (pt2) foreach: +13.94466%
- tts_angular, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: -11.30084%
- tts_angular, AdamW, cuda, (pt2) foreach, maximize, capturable: +11.15804%
- tts_angular, AdamW, cuda, foreach, maximize, capturable: +15.67291%
- tts_angular, Adamax, cuda, default: +15.32201%
- tts_angular, ASGD, cuda, default: +15.30780%
- tts_angular, ASGD, cuda, (pt2) foreach: +24.59256%
- tts_angular, Rprop, cuda, (pt2) default: +39.67880%
- maml_omniglot, Adagrad, cuda, (pt2) foreach: -11.86156%
- maml_omniglot, Adam, cuda, (pt2) foreach, maximize, capturable: -11.94778%
- maml_omniglot, Adam, cuda, (pt2) fused, capturable, amsgrad: -13.54720%
- maml_omniglot, Adamax, cuda, default: +33.81851%
- maml_omniglot, Rprop, cuda, (pt2) maximize: +35.59728%
- basic_gnn_sage, Adagrad, cuda, (pt2) maximize: -13.97681%
- basic_gnn_sage, Adam, cuda, (pt2) foreach, maximize, capturable: -14.83897%
- basic_gnn_sage, AdamW, cuda, (pt2) foreach, maximize, capturable: -14.18740%
- dcgan, Adam, cuda, (pt2) default: -12.09172%
- dcgan, Adam, cuda, (pt2) foreach, maximize, capturable: -12.48419%
- dcgan, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: -16.68432%
- dcgan, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -14.14385%
- dcgan, Adamax, cuda, (pt2) foreach: -21.30176%
- hf_BigBird, Adadelta, cuda, (pt2) maximize: -12.41861%
- hf_BigBird, ASGD, cuda, foreach: +10.04720%
- hf_BigBird, Rprop, cuda, default: +12.84580%
- hf_BigBird, Rprop, cuda, (pt2) foreach: +24.83287%
- mnasnet1_0, Adagrad, cuda, (pt2) default: +28.08648%
- mnasnet1_0, Adagrad, cuda, (pt2) maximize: +43.16076%
- mnasnet1_0, Adamax, cuda, default: +14.37103%
- mnasnet1_0, Adamax, cuda, (pt2) maximize: +19.36344%
- mnasnet1_0, Adamax, cuda, foreach: +19.64449%
- mnasnet1_0, ASGD, cuda, (pt2) maximize: +41.23010%
- mnasnet1_0, ASGD, cuda, (pt2) foreach: -12.40706%
- mnasnet1_0, RAdam, cuda, (pt2) default: +10.68261%
- timm_resnest, Adadelta, cuda, (pt2) maximize: -14.86659%
- timm_resnest, Adagrad, cuda, (pt2) maximize: +12.01904%
- timm_resnest, AdamW, cuda, foreach, maximize, capturable, amsgrad: +11.32568%
- timm_resnest, Rprop, cuda, foreach: +14.06376%
- phlippe_densenet, Adadelta, cuda, maximize: -11.21732%
- phlippe_densenet, Adagrad, cuda, (pt2) default: +32.87688%
- phlippe_densenet, Adam, cuda, default: +10.92161%
- phlippe_densenet, Adam, cuda, (pt2) amsgrad, maximize: +14.70362%
- phlippe_densenet, ASGD, cuda, default: +15.45044%
- phlippe_densenet, ASGD, cuda, (pt2) foreach: -10.57968%
- detectron2_maskrcnn_r_50_fpn, Adagrad, cuda, maximize: +14.46379%
- detectron2_maskrcnn_r_50_fpn, Adamax, cuda, (pt2) maximize: +25.90348%
- detectron2_maskrcnn_r_50_fpn, ASGD, cuda, default: +12.26084%
- detectron2_maskrcnn_r_50_fpn, Rprop, cuda, default: -13.68096%
- detectron2_maskrcnn_r_50_fpn, Rprop, cuda, (pt2) maximize: -20.42775%
- hf_T5_generate, Adagrad, cuda, maximize: +10.34790%
- hf_T5_generate, AdamW, cuda, foreach, maximize, capturable: +16.41024%
- hf_T5_generate, ASGD, cuda, foreach: +13.03577%
- hf_T5_generate, Rprop, cuda, default: +24.59337%
- hf_T5_generate, Rprop, cuda, maximize: -16.11325%
- resnet18, Adagrad, cuda, (pt2) foreach: +23.05988%
- resnet18, Adagrad, cuda, foreach: -11.35727%
- resnet18, AdamW, cuda, (pt2) foreach, maximize, capturable: +21.75968%
- resnet18, AdamW, cuda, foreach, maximize, capturable: +10.27159%
- resnet18, AdamW, cuda, foreach, maximize, capturable, amsgrad: +20.66255%
- resnet18, ASGD, cuda, default: +10.97326%
- resnet18, ASGD, cuda, maximize: +43.78124%
- resnet18, ASGD, cuda, foreach: +19.42219%
- resnet18, NAdam, cuda, (pt2) default: +12.44900%
- Super_SloMo, Adamax, cuda, (pt2) default: -21.81058%
- Super_SloMo, Rprop, cuda, (pt2) foreach: +10.28410%
- basic_gnn_edgecnn, Adagrad, cuda, (pt2) default: +11.78981%
- basic_gnn_edgecnn, Adagrad, cuda, (pt2) maximize: -12.76638%
- basic_gnn_edgecnn, AdamW, cuda, (pt2) foreach: +11.01927%
- basic_gnn_edgecnn, ASGD, cuda, default: +24.18684%
- basic_gnn_edgecnn, RAdam, cuda, (pt2) foreach: +17.48828%
- basic_gnn_edgecnn, Rprop, cuda, maximize: -15.51448%
- basic_gnn_edgecnn, Rprop, cuda, foreach: +46.11808%
- basic_gnn_edgecnn, RMSprop, cuda, foreach: +11.79813%
- basic_gnn_edgecnn, NAdam, cuda, (pt2) default: +12.99027%
- mobilenet_v2, Adagrad, cuda, (pt2) foreach: +14.14087%
- mobilenet_v2, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +16.89216%
- mobilenet_v2, Adamax, cuda, (pt2) default: +20.63447%
- mobilenet_v2, Adamax, cuda, (pt2) foreach: +35.72640%
- mobilenet_v2, ASGD, cuda, (pt2) default: +11.47192%
- mobilenet_v2, ASGD, cuda, (pt2) foreach: +27.41558%
- mobilenet_v2, ASGD, cuda, foreach: +18.83247%
- detectron2_fasterrcnn_r_50_c4, Adagrad, cuda, foreach: +12.62408%
- resnet152, Adagrad, cuda, (pt2) foreach: +26.49898%
- resnet152, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +12.01771%
- resnet152, Adamax, cuda, (pt2) default: +10.44291%
- resnet152, Adamax, cuda, default: +12.11363%
- resnet152, ASGD, cuda, (pt2) default: +14.24557%
- resnet152, Rprop, cuda, default: +22.25323%
- resnet152, Rprop, cuda, foreach: +43.87260%
- resnet152, NAdam, cuda, (pt2) foreach: +11.65626%
- soft_actor_critic, Adadelta, cuda, default: -12.98720%
- soft_actor_critic, Adagrad, cuda, default: +28.13906%
- soft_actor_critic, Adagrad, cuda, foreach: +10.77106%
- soft_actor_critic, AdamW, cuda, amsgrad, maximize: +16.14627%
- soft_actor_critic, AdamW, cuda, foreach, maximize, capturable, amsgrad: +22.55479%
- soft_actor_critic, Adamax, cuda, (pt2) default: +22.81436%
- soft_actor_critic, ASGD, cuda, default: +26.16693%
- soft_actor_critic, ASGD, cuda, foreach: +29.02643%
- soft_actor_critic, Rprop, cuda, (pt2) foreach: +10.88153%
- soft_actor_critic, RMSprop, cuda, foreach: +18.24083%
- soft_actor_critic, NAdam, cuda, foreach: -12.61864%
- timm_nfnet, Adamax, cuda, maximize: +26.15058%
- timm_nfnet, Adamax, cuda, (pt2) foreach: +31.06256%
- timm_nfnet, ASGD, cuda, (pt2) default: +49.97807%
- timm_nfnet, ASGD, cuda, maximize: +45.51897%
- timm_nfnet, ASGD, cuda, foreach: +50.64707%
- densenet121, Adadelta, cuda, (pt2) default: -17.78453%
- llama, Adagrad, cuda, (pt2) maximize: +25.78154%
- mobilenet_v2_quantized_qat, Rprop, cuda, (pt2) maximize: +44.81184%
- timm_efficientdet, Adadelta, cuda, (pt2) default: -12.31799%
- timm_efficientdet, Adagrad, cuda, (pt2) foreach: -12.31809%
- timm_efficientdet, Adam, cuda, (pt2) foreach: +11.00571%
- timm_efficientdet, AdamW, cuda, (pt2) foreach, maximize, capturable: +18.48375%
- timm_efficientdet, ASGD, cuda, (pt2) default: +51.22359%
- timm_efficientdet, ASGD, cuda, (pt2) maximize: +35.63497%
- timm_efficientdet, RAdam, cuda, default: +10.83626%
- timm_efficientdet, Rprop, cuda, (pt2) default: -24.63856%
- moco, Adagrad, cuda, (pt2) foreach: +43.59471%
- moco, Adam, cuda, (pt2) foreach, maximize, capturable: +20.47589%
- moco, AdamW, cuda, (pt2) foreach, maximize, capturable: -10.16293%
- moco, Adamax, cuda, default: +13.09399%
- moco, Adamax, cuda, maximize: +29.74743%
- moco, Adamax, cuda, (pt2) foreach: +34.12087%
- moco, ASGD, cuda, maximize: +40.78157%
- moco, ASGD, cuda, (pt2) foreach: +10.78200%
- resnext50_32x4d, Adagrad, cuda, (pt2) default: +17.38871%
- resnext50_32x4d, Adagrad, cuda, (pt2) maximize: +30.73958%
- resnext50_32x4d, Adagrad, cuda, maximize: +44.64375%
- resnext50_32x4d, Adam, cuda, (pt2) foreach: -11.30384%
- resnext50_32x4d, Adam, cuda, (pt2) foreach, maximize, capturable: +10.71585%
- resnext50_32x4d, Adamax, cuda, (pt2) foreach: +33.95664%
- resnext50_32x4d, ASGD, cuda, (pt2) default: +39.33579%
- resnext50_32x4d, NAdam, cuda, default: +16.61369%
- fastNLP_Bert, Adamax, cuda, default: +26.86901%
- fastNLP_Bert, ASGD, cuda, (pt2) default: -14.37143%
- fastNLP_Bert, ASGD, cuda, foreach: +20.58792%
- fastNLP_Bert, Rprop, cuda, (pt2) maximize: +39.79138%
- fastNLP_Bert, Rprop, cuda, maximize: +13.04736%
- LearningToPaint, Adam, cuda, (pt2) foreach: -15.58777%
- LearningToPaint, Adamax, cuda, (pt2) maximize: -14.33456%
- LearningToPaint, Adamax, cuda, (pt2) foreach: -17.56434%
- LearningToPaint, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -10.57907%
- LearningToPaint, SGD, cuda, (pt2) foreach, momentum=0.9: -14.44627%
- hf_Bart, Adagrad, cuda, (pt2) maximize: +29.04751%
- nanogpt_generate, Adagrad, cuda, default: +39.70478%
- nanogpt_generate, Adagrad, cuda, maximize: +26.68630%
- nanogpt_generate, Adagrad, cuda, foreach: +13.06538%
- nanogpt_generate, Adamax, cuda, (pt2) foreach: +20.26810%
- tacotron2, Adadelta, cuda, (pt2) foreach: -10.00134%
- tacotron2, Adagrad, cuda, (pt2) maximize: +12.81657%
- tacotron2, Adagrad, cuda, foreach: +13.23898%
- tacotron2, Adamax, cuda, (pt2) foreach: +14.42187%
- tacotron2, ASGD, cuda, (pt2) default: +20.88874%
- tacotron2, ASGD, cuda, (pt2) foreach: +37.40156%
- tacotron2, SGD, cuda, (pt2) foreach, momentum=0.9: -18.19618%
- tacotron2, Rprop, cuda, (pt2) maximize: +20.58128%
- functorch_dp_cifar10, Adadelta, cuda, (pt2) maximize: -11.01234%
- functorch_dp_cifar10, Adagrad, cuda, (pt2) default: +41.82458%
- functorch_dp_cifar10, Adagrad, cuda, (pt2) maximize: +15.88305%
- functorch_dp_cifar10, Adagrad, cuda, maximize: +11.50211%
- functorch_dp_cifar10, Adam, cuda, (pt2) foreach: +10.93463%
- functorch_dp_cifar10, Rprop, cuda, default: +46.34256%
- squeezenet1_1, Adagrad, cuda, default: +33.56457%
- squeezenet1_1, Adagrad, cuda, (pt2) maximize: +14.47605%
- squeezenet1_1, Adam, cuda, amsgrad, maximize: +15.00691%
- squeezenet1_1, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -19.01921%
- squeezenet1_1, Adamax, cuda, (pt2) default: +31.88895%
- squeezenet1_1, Adamax, cuda, default: +30.71952%
- squeezenet1_1, Adamax, cuda, foreach: +16.80746%
- squeezenet1_1, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +14.82450%
- squeezenet1_1, Rprop, cuda, (pt2) maximize: +47.44198%
- squeezenet1_1, Rprop, cuda, foreach: +46.78456%
- hf_Reformer, Adam, cuda, (pt2) amsgrad, maximize: -12.22546%
- hf_Reformer, Adam, cuda, foreach, maximize, capturable: +10.92930%
- hf_Reformer, AdamW, cuda, (pt2) default: +12.35131%
- hf_Reformer, ASGD, cuda, (pt2) maximize: +24.80107%
- hf_Reformer, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: +66.88488%
- hf_Reformer, SGD, cuda, (pt2) foreach, momentum=0.9: -23.79921%
- hf_Reformer, RAdam, cuda, default: +16.89273%
- hf_Reformer, RAdam, cuda, (pt2) foreach: +11.44384%
- hf_Reformer, Rprop, cuda, default: +16.08058%
- hf_Reformer, NAdam, cuda, (pt2) foreach: +11.64259%
- phlippe_resnet, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: -16.46725%
- phlippe_resnet, Adam, cuda, foreach, maximize, capturable, amsgrad: +15.08302%
- phlippe_resnet, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: +10.11215%
- phlippe_resnet, AdamW, cuda, foreach, maximize, capturable, amsgrad: +19.11019%
- phlippe_resnet, Adamax, cuda, default: +15.83229%
- phlippe_resnet, ASGD, cuda, (pt2) default: +18.84364%
- phlippe_resnet, ASGD, cuda, (pt2) maximize: -23.69301%
- phlippe_resnet, ASGD, cuda, maximize: +19.52733%
- phlippe_resnet, Rprop, cuda, (pt2) maximize: +30.70779%
- phlippe_resnet, Rprop, cuda, (pt2) foreach: +16.49776%
- functorch_maml_omniglot, Adagrad, cuda, (pt2) maximize: -10.82571%
- functorch_maml_omniglot, Adam, cuda, (pt2) amsgrad, maximize: -11.14763%
- functorch_maml_omniglot, Adam, cuda, foreach, maximize, capturable, amsgrad: -14.77194%
- functorch_maml_omniglot, Adamax, cuda, (pt2) default: -12.94616%
- pytorch_unet, Adagrad, cuda, maximize: +22.91706%
- pytorch_unet, Adagrad, cuda, (pt2) foreach: +14.21526%
- pytorch_unet, Adam, cuda, foreach: +14.16563%
- pytorch_unet, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +22.74337%
- pytorch_unet, Adam, cuda, foreach, maximize, capturable, amsgrad: +21.73436%
- pytorch_unet, AdamW, cuda, foreach, maximize, capturable, amsgrad: +14.84954%
- pytorch_unet, Adamax, cuda, default: +16.36858%
- pytorch_unet, Adamax, cuda, foreach: +30.65457%
- pytorch_unet, ASGD, cuda, default: +12.35226%
- pytorch_unet, ASGD, cuda, foreach: +59.06675%
- pytorch_unet, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -66.52877%
- pytorch_unet, Rprop, cuda, (pt2) foreach: +16.18996%
- timm_efficientnet, Adam, cuda, (pt2) foreach, maximize, capturable: +12.27125%
- timm_efficientnet, Adamax, cuda, (pt2) foreach: +13.75609%
- timm_efficientnet, ASGD, cuda, foreach: +11.63609%
- timm_efficientnet, RAdam, cuda, (pt2) foreach: +20.89516%
- timm_efficientnet, Rprop, cuda, (pt2) maximize: +21.24637%
- detectron2_fasterrcnn_r_50_fpn, ASGD, cuda, (pt2) default: -11.19415%
- pytorch_struct, Adadelta, cuda, foreach: +10.17846%
- pytorch_struct, AdamW, cuda, amsgrad, maximize: +10.64638%
- pytorch_struct, AdamW, cuda, foreach: +10.66171%
- pytorch_struct, AdamW, cuda, (pt2) foreach, maximize, capturable: +18.79748%
- pytorch_struct, Adamax, cuda, default: +17.66084%
- pytorch_struct, Adamax, cuda, maximize: +17.37646%
- pytorch_struct, Adamax, cuda, (pt2) foreach: +13.86795%
- pytorch_struct, Adamax, cuda, foreach: +16.12887%
- pytorch_struct, ASGD, cuda, foreach: +26.32377%
- pytorch_struct, RAdam, cuda, default: +10.71221%
- pytorch_struct, RAdam, cuda, (pt2) foreach: +14.22502%
- pytorch_struct, RAdam, cuda, foreach: +16.91849%
- pytorch_struct, RMSprop, cuda, maximize: +10.49384%
- pytorch_struct, NAdam, cuda, (pt2) default: +15.83444%
- pytorch_struct, NAdam, cuda, default: +12.83181%
- hf_Bert, Adagrad, cuda, (pt2) foreach: -12.68128%
- hf_GPT2, Adagrad, cuda, default: +30.01897%
- hf_GPT2, Adagrad, cuda, foreach: +17.30949%
- hf_GPT2, Adamax, cuda, foreach: +16.98042%
- hf_GPT2, ASGD, cuda, (pt2) default: -12.06336%
- hf_T5_base, Adagrad, cuda, foreach: +37.29105%
- hf_T5_base, Adamax, cuda, (pt2) foreach: +10.33902%
- hf_T5_base, ASGD, cuda, (pt2) default: +50.63112%
- hf_T5_base, Rprop, cuda, default: +16.26460%
- hf_T5_base, Rprop, cuda, maximize: +13.46117%
- basic_gnn_gin, Adam, cuda, (pt2) amsgrad, maximize: -15.02829%
- shufflenet_v2_x1_0, Adadelta, cuda, foreach: -16.11919%
- shufflenet_v2_x1_0, Adagrad, cuda, (pt2) maximize: +15.53463%
- shufflenet_v2_x1_0, AdamW, cuda, amsgrad, maximize: +10.73330%
- shufflenet_v2_x1_0, Adamax, cuda, (pt2) maximize: +32.61347%
- shufflenet_v2_x1_0, ASGD, cuda, default: +20.15469%
- shufflenet_v2_x1_0, ASGD, cuda, (pt2) maximize: +39.52969%
- shufflenet_v2_x1_0, ASGD, cuda, (pt2) foreach: +50.82083%
- shufflenet_v2_x1_0, Rprop, cuda, (pt2) default: +39.81086%
- shufflenet_v2_x1_0, Rprop, cuda, default: +20.70433%
- shufflenet_v2_x1_0, NAdam, cuda, (pt2) foreach: +13.70874%
- hf_Bert_large, Adagrad, cuda, default: +15.72591%
- hf_Bert_large, Adagrad, cuda, (pt2) maximize: +23.73850%
- hf_Bert_large, ASGD, cuda, (pt2) foreach: +21.55953%
- hf_Bert_large, Rprop, cuda, (pt2) foreach: +38.04007%
- resnet50_quantized_qat, Adadelta, cuda, (pt2) foreach: -11.50697%
- resnet50_quantized_qat, Adam, cuda, foreach, maximize, capturable, amsgrad: +17.43166%
- resnet50_quantized_qat, Adamax, cuda, (pt2) foreach: +31.41307%
- resnet50_quantized_qat, Adamax, cuda, foreach: +26.60388%
- resnet50_quantized_qat, ASGD, cuda, (pt2) maximize: +45.02209%
- resnet50_quantized_qat, ASGD, cuda, foreach: +26.85274%
- resnet50_quantized_qat, Rprop, cuda, (pt2) foreach: -16.45343%
- resnet50_quantized_qat, NAdam, cuda, default: +12.36711%
- detectron2_maskrcnn_r_50_c4, Adadelta, cuda, (pt2) maximize: -10.01037%
- alexnet, Adadelta, cuda, (pt2) default: -11.30606%
- alexnet, Adagrad, cuda, (pt2) maximize: -10.67301%
- doctr_det_predictor, Adagrad, cuda, (pt2) foreach: +41.61053%
- doctr_det_predictor, ASGD, cuda, (pt2) foreach: +42.01389%
- doctr_det_predictor, ASGD, cuda, foreach: -13.75209%
- doctr_det_predictor, Rprop, cuda, default: +19.78069%
- pytorch_CycleGAN_and_pix2pix, Adadelta, cuda, (pt2) default: -10.41887%
- pytorch_CycleGAN_and_pix2pix, Adam, cuda, foreach, maximize, capturable: +15.47810%
- pytorch_CycleGAN_and_pix2pix, Adamax, cuda, foreach: +25.88248%
- pytorch_CycleGAN_and_pix2pix, ASGD, cuda, (pt2) foreach: +46.19043%
- pytorch_CycleGAN_and_pix2pix, ASGD, cuda, foreach: +48.80056%
- pytorch_CycleGAN_and_pix2pix, Rprop, cuda, default: +21.08384%
- pytorch_CycleGAN_and_pix2pix, Rprop, cuda, (pt2) foreach: +11.39415%
- pytorch_CycleGAN_and_pix2pix, Rprop, cuda, foreach: +21.40591%
- pytorch_CycleGAN_and_pix2pix, NAdam, cuda, (pt2) default: +11.52439%
- pytorch_CycleGAN_and_pix2pix, NAdam, cuda, default: +10.52793%
- hf_Albert, AdamW, cuda, (pt2) foreach, maximize, capturable: +20.06235%
- hf_Albert, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: +19.25422%
- detectron2_maskrcnn, Adagrad, cuda, (pt2) maximize: -11.51617%
- detectron2_maskrcnn, Adamax, cuda, foreach: +24.89287%
- detectron2_maskrcnn, Rprop, cuda, (pt2) foreach: +14.04253%
- resnet50, Adadelta, cuda, (pt2) default: -11.97150%
- resnet50, Adadelta, cuda, (pt2) no_foreach: -11.14937%
- resnet50, Adagrad, cuda, (pt2) maximize: +43.10973%
- resnet50, Adam, cuda, foreach, maximize, capturable: +14.64142%
- resnet50, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: -21.22536%
- resnet50, Adamax, cuda, (pt2) default: +35.69547%
- resnet50, Adamax, cuda, (pt2) maximize: +20.64135%
- resnet50, ASGD, cuda, (pt2) differentiable: +20.79161%
- resnet50, Rprop, cuda, default: +26.26379%
- resnet50, RMSprop, cuda, differentiable: +23.06516%
- resnet50, NAdam, cuda, differentiable: -10.16837%
- resnet50, NAdam, cuda, (pt2) foreach: -13.42861%
- resnet50, NAdam, cuda, foreach: +13.55246%
- basic_gnn_gcn, Adadelta, cuda, (pt2) default: -14.61952%
- basic_gnn_gcn, Adadelta, cuda, (pt2) maximize: -13.21655%
- basic_gnn_gcn, Adagrad, cuda, (pt2) default: -13.47372%
- basic_gnn_gcn, Adagrad, cuda, default: +10.87914%
- basic_gnn_gcn, Adam, cuda, foreach: -11.13949%
- basic_gnn_gcn, AdamW, cuda, (pt2) foreach, maximize, capturable: +10.36554%
- basic_gnn_gcn, AdamW, cuda, fused: +11.61111%
- basic_gnn_gcn, Adamax, cuda, foreach: +18.79071%
- basic_gnn_gcn, ASGD, cuda, (pt2) maximize: +16.32988%
- basic_gnn_gcn, ASGD, cuda, (pt2) foreach: +20.34906%
- basic_gnn_gcn, Rprop, cuda, default: -10.32569%
- basic_gnn_gcn, Rprop, cuda, foreach: +24.77408%
- basic_gnn_gcn, NAdam, cuda, default: +10.29641%
- basic_gnn_gcn, NAdam, cuda, (pt2) foreach: +12.34205%
- doctr_reco_predictor, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: -12.90297%
- doctr_reco_predictor, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -11.87772%
- doctr_reco_predictor, SGD, cuda, (pt2) foreach, momentum=0.9: -29.86858%
- timm_vision_transformer_large, ASGD, cuda, foreach: +10.34484%
- attention_is_all_you_need_pytorch, Adadelta, cuda, (pt2) default: -11.63472%
- attention_is_all_you_need_pytorch, Adagrad, cuda, (pt2) default: +18.27097%
- attention_is_all_you_need_pytorch, Adagrad, cuda, foreach: +28.71644%
- attention_is_all_you_need_pytorch, Adam, cuda, (pt2) foreach, maximize, capturable: +15.49935%
- attention_is_all_you_need_pytorch, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: +16.12533%
- attention_is_all_you_need_pytorch, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: +18.31905%
- attention_is_all_you_need_pytorch, Adamax, cuda, (pt2) default: +24.98292%
- attention_is_all_you_need_pytorch, ASGD, cuda, (pt2) default: +25.22647%
- attention_is_all_you_need_pytorch, ASGD, cuda, default: +13.56163%
- attention_is_all_you_need_pytorch, Rprop, cuda, foreach: +47.73935%
- drq, Adam, cuda, (pt2) foreach: -11.06075%
- drq, Adam, cuda, foreach, maximize, capturable: -10.20773%
- drq, ASGD, cuda, (pt2) maximize: +17.76439%
- drq, RMSprop, cuda, foreach: +10.59307%
- drq, NAdam, cuda, (pt2) default: +14.08851%
- yolov3, Adagrad, cuda, default: +37.81054%
- yolov3, Adagrad, cuda, (pt2) maximize: +25.72013%
- yolov3, Adagrad, cuda, maximize: +15.87964%
- yolov3, Adagrad, cuda, (pt2) foreach: +21.59556%
- yolov3, Adam, cuda, (pt2) no_foreach: -13.05618%
- yolov3, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: -15.88449%
- yolov3, AdamW, cuda, amsgrad, maximize: -10.58397%
- yolov3, AdamW, cuda, (pt2) no_foreach: -14.20916%
- yolov3, AdamW, cuda, differentiable: +20.74245%
- yolov3, AdamW, cuda, (pt2) foreach, maximize, capturable: -13.27028%
- yolov3, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: -22.25451%
- yolov3, AdamW, cuda, foreach, maximize, capturable, amsgrad: -13.33610%
- yolov3, AdamW, cuda, (pt2) fused, capturable, amsgrad: -12.62571%
- yolov3, Adamax, cuda, (pt2) foreach: -10.00051%
- yolov3, ASGD, cuda, (pt2) no_foreach: -18.97114%
- yolov3, SGD, cuda, maximize: -13.39993%
- yolov3, RAdam, cuda, (pt2) differentiable: +20.31636%
- detectron2_fasterrcnn_r_101_dc5, Adadelta, cuda, (pt2) maximize: -13.21910%
- lennard_jones, Adadelta, cuda, (pt2) foreach: -11.34993%
- lennard_jones, Adagrad, cuda, (pt2) default: -11.20481%
- lennard_jones, Adam, cuda, foreach, maximize, capturable, amsgrad: +16.60296%
- lennard_jones, AdamW, cuda, (pt2) amsgrad, maximize: +11.57623%
- lennard_jones, AdamW, cuda, foreach: +15.38840%
- lennard_jones, Adamax, cuda, default: +25.87130%
- lennard_jones, Adamax, cuda, (pt2) maximize: +12.60129%
- lennard_jones, Adamax, cuda, (pt2) foreach: +12.63637%
- lennard_jones, Rprop, cuda, default: +12.30840%
- mobilenet_v3_large, AdamW, cuda, (pt2) foreach, maximize, capturable: +16.70492%
- mobilenet_v3_large, ASGD, cuda, foreach: +35.87154%
- mobilenet_v3_large, Rprop, cuda, maximize: +21.45189%
- mobilenet_v3_large, NAdam, cuda, default: +10.03833%
- DALLE2_pytorch, AdamW, cuda, foreach: -12.14137%
- maml, Adadelta, cuda, (pt2) maximize: -11.04239%
- maml, Adagrad, cuda, foreach: +44.22603%
- maml, AdamW, cuda, foreach: +11.70918%
- maml, AdamW, cuda, (pt2) foreach, maximize, capturable: +21.91837%
- maml, ASGD, cuda, (pt2) maximize: +11.18921%
- maml, Rprop, cuda, default: +23.45075%
- maml, Rprop, cuda, (pt2) maximize: +26.14803%
- maml, Rprop, cuda, (pt2) foreach: +16.95691%
- maml, Rprop, cuda, foreach: +24.09426%
- maml, NAdam, cuda, (pt2) default: +19.40306%
- hf_Longformer, Adagrad, cuda, maximize: +15.86609%
- hf_Longformer, Adagrad, cuda, (pt2) foreach: +29.68495%
- hf_Longformer, Adamax, cuda, default: +16.32502%
- hf_Longformer, Adamax, cuda, (pt2) maximize: +21.27035%
- hf_Longformer, ASGD, cuda, (pt2) maximize: -32.72517%
- hf_Longformer, ASGD, cuda, maximize: +39.90014%
- hf_Longformer, ASGD, cuda, foreach: +34.59881%
- hf_Longformer, Rprop, cuda, default: -10.75764%
- hf_Longformer, Rprop, cuda, (pt2) foreach: +37.45420%
- Background_Matting, Adadelta, cuda, (pt2) maximize: -11.78448%
- Background_Matting, ASGD, cuda, foreach: -11.21731%
- hf_T5_large, Adagrad, cuda, no_foreach: +10.18882%
- hf_T5_large, Adam, cuda, no_foreach: +37.88428%
- hf_T5_large, Adam, cuda, differentiable: +28.68369%
- hf_T5_large, Adamax, cuda, (pt2) differentiable: +15.88996%
- hf_T5_large, Rprop, cuda, no_foreach: -12.14552%
- hf_T5_large, Rprop, cuda, (pt2) foreach: +10.12537%
- hf_T5_large, NAdam, cuda, foreach: +12.53438%
- hf_GPT2_large, Adamax, cuda, no_foreach: +13.74532%
- hf_GPT2_large, Adamax, cuda, (pt2) differentiable: -13.44074%
- hf_GPT2_large, Adamax, cuda, differentiable: +18.80788%
- hf_GPT2_large, NAdam, cuda, foreach: -11.38444%
- pytorch_stargan, Adadelta, cuda, (pt2) maximize: -11.91762%
- pytorch_stargan, Adagrad, cuda, (pt2) maximize: -11.47700%
- pytorch_stargan, Adagrad, cuda, maximize: +24.39584%
- pytorch_stargan, Adam, cuda, foreach, maximize, capturable: +13.21093%
- pytorch_stargan, Adam, cuda, foreach, maximize, capturable, amsgrad: -10.07555%
- pytorch_stargan, AdamW, cuda, foreach, maximize, capturable: +12.66824%
- pytorch_stargan, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: +13.42244%
- pytorch_stargan, Adamax, cuda, (pt2) default: +21.31559%
- pytorch_stargan, Adamax, cuda, (pt2) maximize: +10.14231%
- pytorch_stargan, Rprop, cuda, (pt2) maximize: +13.90658%
- opacus_cifar10, Adadelta, cuda, (pt2) default: -10.57211%
- opacus_cifar10, Adagrad, cuda, (pt2) maximize: -15.83863%
- opacus_cifar10, Adam, cuda, foreach, maximize, capturable, amsgrad: -12.56540%
- opacus_cifar10, RAdam, cuda, (pt2) default: +23.48221%
- opacus_cifar10, Rprop, cuda, (pt2) foreach: +29.34579%
- hf_T5, Adadelta, cuda, (pt2) maximize: -11.15229%
- hf_T5, Adamax, cuda, (pt2) maximize: +11.25254%
- hf_T5, RAdam, cuda, (pt2) default: +10.45158%
- hf_T5, Rprop, cuda, (pt2) default: +46.68346%
- hf_T5, Rprop, cuda, maximize: +11.70150%
- hf_T5, Rprop, cuda, (pt2) foreach: -16.47400%
- detectron2_fasterrcnn_r_50_dc5, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: -19.98280%
- detectron2_fasterrcnn_r_50_dc5, SGD, cuda, (pt2) foreach, momentum=0.9: -12.24226%
- timm_vovnet, Adadelta, cuda, (pt2) maximize: -11.30460%
- timm_vovnet, Adadelta, cuda, (pt2) foreach: -10.77068%
- timm_vovnet, Adagrad, cuda, maximize: +33.07197%
- timm_vovnet, ASGD, cuda, maximize: +35.99291%
- timm_vovnet, Rprop, cuda, (pt2) foreach: +41.39599%
- vision_maskrcnn, Adagrad, cuda, (pt2) default: +30.52953%
- vision_maskrcnn, Adagrad, cuda, (pt2) maximize: -23.68292%
- vision_maskrcnn, Adagrad, cuda, maximize: +31.09049%
- vision_maskrcnn, Adamax, cuda, (pt2) default: +22.31489%
- vision_maskrcnn, Adamax, cuda, default: +17.62025%
- vision_maskrcnn, ASGD, cuda, (pt2) maximize: +15.23655%
- vision_maskrcnn, ASGD, cuda, (pt2) foreach: +10.99842%
- vision_maskrcnn, RAdam, cuda, (pt2) foreach: +10.30898%
- vision_maskrcnn, Rprop, cuda, maximize: +28.32178%
- BERT_pytorch, AdamW, cuda, (pt2) differentiable: -11.10756%
- BERT_pytorch, Adamax, cuda, default: +20.74795%
- BERT_pytorch, ASGD, cuda, (pt2) maximize: -19.65716%
- BERT_pytorch, SGD, cuda, (pt2) maximize: -10.04372%
- BERT_pytorch, Rprop, cuda, (pt2) default: -12.42679%
- BERT_pytorch, Rprop, cuda, differentiable: -10.49081%
- timm_regnet, Adadelta, cuda, (pt2) default: -12.87274%
- timm_regnet, Adadelta, cuda, (pt2) maximize: -16.19089%
- timm_regnet, Adadelta, cuda, (pt2) foreach: -14.63395%
- timm_regnet, Adagrad, cuda, foreach: +27.92476%
- timm_regnet, AdamW, cuda, foreach, maximize, capturable, amsgrad: +13.85734%
- timm_regnet, Adamax, cuda, (pt2) maximize: +28.47153%
- timm_regnet, ASGD, cuda, maximize: +40.13817%
- timm_regnet, ASGD, cuda, (pt2) foreach: -10.32464%
- timm_regnet, ASGD, cuda, foreach: +43.91515%
- timm_regnet, RAdam, cuda, (pt2) default: -10.31926%
- timm_regnet, RAdam, cuda, (pt2) foreach: -11.98864%
- timm_regnet, Rprop, cuda, default: +39.05314%
- timm_regnet, Rprop, cuda, (pt2) maximize: +16.12252%
- timm_regnet, Rprop, cuda, (pt2) foreach: +44.50690%
- speech_transformer, Adagrad, cuda, foreach: +25.39725%
- speech_transformer, Adamax, cuda, (pt2) maximize: +12.13855%
- speech_transformer, Rprop, cuda, (pt2) default: +45.45284%
- speech_transformer, Rprop, cuda, default: +13.48409%
- speech_transformer, Rprop, cuda, (pt2) maximize: +20.37160%


Tests that were no longer run on affected commit:


Tests that were newly added on affected commit:


Runtime regressions found?
No runtime errors were found in the new benchmarks run--you are all good there!

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/5026870366

cc @janeyx99


This was part of a rerun, stats are taken account of here https://docs.google.com/spreadsheets/d/1r3a7UczDofej8p6KhAcbTf8moxnlbyQ1AWZKOo0kbh8/edit#gid=418753160