Repository: pytorch/benchmark
Issue: V2 Performance Signal Detected by TorchBench CI on 'a86aae1504e8051898ebf3cc7ec5284ffa531d11'
Root cause: Others


TorchBench CI has detected a performance signal.

Base PyTorch commit: f08dd7d0f7a9b922b23fb2b45d7a6dd4606a1491

Affected PyTorch commit: a86aae1504e8051898ebf3cc7ec5284ffa531d11

Affected Tests:


Tests that were no longer run on affected commit:
- doctr_reco_predictor, Adadelta, cpu, (pt2) default: 0.021797475800849498
- doctr_reco_predictor, Adadelta, cpu, default: 0.09254190535284579
- doctr_reco_predictor, Adadelta, cpu, (pt2) maximize: 0.022078143036924302
- doctr_reco_predictor, Adadelta, cpu, maximize: 0.10137384703072409
- doctr_reco_predictor, Adadelta, cpu, (pt2) no_foreach: 0.021984409214928745
- doctr_reco_predictor, Adadelta, cpu, no_foreach: 0.08762423538913329
- doctr_reco_predictor, Adadelta, cpu, (pt2) differentiable: 0.022421276196837425
- doctr_reco_predictor, Adadelta, cpu, differentiable: 0.10105541453231126
- doctr_reco_predictor, Adadelta, cpu, (pt2) foreach: 0.10494748502969742
- doctr_reco_predictor, Adadelta, cpu, foreach: 0.10369737108703703
- doctr_reco_predictor, Adagrad, cpu, (pt2) default: 0.029195422007303153
- doctr_reco_predictor, Adagrad, cpu, default: 0.04165063921827823
- doctr_reco_predictor, Adagrad, cpu, (pt2) maximize: 0.031027188591126884
- doctr_reco_predictor, Adagrad, cpu, maximize: 0.049348283605650065
- doctr_reco_predictor, Adagrad, cpu, (pt2) no_foreach: 0.029020124697126448
- doctr_reco_predictor, Adagrad, cpu, no_foreach: 0.04151854559313506
- doctr_reco_predictor, Adagrad, cpu, (pt2) differentiable: 0.028297113574808463
- doctr_reco_predictor, Adagrad, cpu, differentiable: 0.047826505894772706
- doctr_reco_predictor, Adagrad, cpu, (pt2) foreach: 0.08149029601675768
- doctr_reco_predictor, Adagrad, cpu, foreach: 0.07649300701450557
- doctr_reco_predictor, Adam, cpu, (pt2) default: 0.17954662651754916
- doctr_reco_predictor, Adam, cpu, default: 0.07913910038769245
- doctr_reco_predictor, Adam, cpu, (pt2) amsgrad, maximize: 0.18821474956348538
- doctr_reco_predictor, Adam, cpu, amsgrad, maximize: 0.10103559342678636
- doctr_reco_predictor, Adam, cpu, (pt2) no_foreach: 0.17879701452329755
- doctr_reco_predictor, Adam, cpu, no_foreach: 0.0757274186083426
- doctr_reco_predictor, Adam, cpu, (pt2) differentiable: 0.2015968265477568
- doctr_reco_predictor, Adam, cpu, differentiable: 0.07992957369424403
- doctr_reco_predictor, Adam, cpu, (pt2) foreach: 0.08190942369401455
- doctr_reco_predictor, Adam, cpu, foreach: 0.0815084360850354
- doctr_reco_predictor, AdamW, cpu, (pt2) default: 0.1834101404529065
- doctr_reco_predictor, AdamW, cpu, default: 0.08204092597588897
- doctr_reco_predictor, AdamW, cpu, (pt2) amsgrad, maximize: 0.20600279700011015
- doctr_reco_predictor, AdamW, cpu, amsgrad, maximize: 0.10241804656106979
- doctr_reco_predictor, AdamW, cpu, (pt2) no_foreach: 0.17753814195748419
- doctr_reco_predictor, AdamW, cpu, no_foreach: 0.0824099494299541
- doctr_reco_predictor, AdamW, cpu, (pt2) differentiable: 0.1823838755954057
- doctr_reco_predictor, AdamW, cpu, differentiable: 0.085556283670788
- doctr_reco_predictor, AdamW, cpu, (pt2) foreach: 0.08744644303806126
- doctr_reco_predictor, AdamW, cpu, foreach: 0.0899044347461313
- doctr_reco_predictor, Adamax, cpu, (pt2) default: 0.11932507855817676
- doctr_reco_predictor, Adamax, cpu, default: 0.09946554410271347
- doctr_reco_predictor, Adamax, cpu, (pt2) maximize: 0.12792313646059483
- doctr_reco_predictor, Adamax, cpu, maximize: 0.11156280292198062
- doctr_reco_predictor, Adamax, cpu, (pt2) no_foreach: 0.12753567704930902
- doctr_reco_predictor, Adamax, cpu, no_foreach: 0.1015305801993236
- doctr_reco_predictor, Adamax, cpu, (pt2) differentiable: 0.12248303706292063
- doctr_reco_predictor, Adamax, cpu, differentiable: 0.10303055960685015
- doctr_reco_predictor, Adamax, cpu, (pt2) foreach: 0.1581480730092153
- doctr_reco_predictor, Adamax, cpu, foreach: 0.15758768550585955
- doctr_reco_predictor, ASGD, cpu, (pt2) default: 0.0443779899738729
- doctr_reco_predictor, ASGD, cpu, default: 0.029476505517959595
- doctr_reco_predictor, ASGD, cpu, (pt2) maximize: 0.03905802553830048
- doctr_reco_predictor, ASGD, cpu, maximize: 0.040331687894649804
- doctr_reco_predictor, ASGD, cpu, (pt2) no_foreach: 0.05739010570105165
- doctr_reco_predictor, ASGD, cpu, no_foreach: 0.02998247651848942
- doctr_reco_predictor, ASGD, cpu, (pt2) differentiable: 0.03984374550636858
- doctr_reco_predictor, ASGD, cpu, differentiable: 0.02972246699500829
- doctr_reco_predictor, ASGD, cpu, (pt2) foreach: 0.029544921009801328
- doctr_reco_predictor, ASGD, cpu, foreach: 0.02858631880953908
- doctr_reco_predictor, SGD, cpu, (pt2) default: 0.010581923464901354
- doctr_reco_predictor, SGD, cpu, default: 0.01078258320922032
- doctr_reco_predictor, SGD, cpu, (pt2) maximize: 0.010553976704709624
- doctr_reco_predictor, SGD, cpu, maximize: 0.019014171103481203
- doctr_reco_predictor, SGD, cpu, (pt2) no_foreach: 0.01026029085041955
- doctr_reco_predictor, SGD, cpu, no_foreach: 0.010720130545087157
- doctr_reco_predictor, SGD, cpu, (pt2) differentiable: 0.010104238835629076
- doctr_reco_predictor, SGD, cpu, differentiable: 0.010570327006280422
- doctr_reco_predictor, SGD, cpu, (pt2) foreach: 0.01087769764708355
- doctr_reco_predictor, SGD, cpu, foreach: 0.010635529446881264
- doctr_reco_predictor, SGD, cpu, (pt2) foreach, momentum=0.9, nesterov: 0.037035988201387225
- doctr_reco_predictor, SGD, cpu, foreach, momentum=0.9, nesterov: 0.037431776290759444
- doctr_reco_predictor, SGD, cpu, (pt2) foreach, momentum=0.9: 0.027981129405088723
- doctr_reco_predictor, SGD, cpu, foreach, momentum=0.9: 0.02793122180737555
- doctr_reco_predictor, RAdam, cpu, (pt2) default: 0.06909260161531468
- doctr_reco_predictor, RAdam, cpu, default: 0.06802660940835874
- doctr_reco_predictor, RAdam, cpu, (pt2) no_foreach: 0.06636522297048941
- doctr_reco_predictor, RAdam, cpu, no_foreach: 0.06639462447492406
- doctr_reco_predictor, RAdam, cpu, (pt2) differentiable: 0.0672804806381464
- doctr_reco_predictor, RAdam, cpu, differentiable: 0.06762796562785904
- doctr_reco_predictor, RAdam, cpu, (pt2) foreach: 0.10587313759606332
- doctr_reco_predictor, RAdam, cpu, foreach: 0.10989347088616341
- doctr_reco_predictor, Rprop, cpu, (pt2) default: 0.024145091030125816
- doctr_reco_predictor, Rprop, cpu, default: 0.19744285696651787
- doctr_reco_predictor, Rprop, cpu, (pt2) maximize: 0.02421035622763965
- doctr_reco_predictor, Rprop, cpu, maximize: 0.20777733298018575
- doctr_reco_predictor, Rprop, cpu, (pt2) no_foreach: 0.023825026606209575
- doctr_reco_predictor, Rprop, cpu, no_foreach: 0.19788997212890536
- doctr_reco_predictor, Rprop, cpu, (pt2) differentiable: 0.023695887842526037
- doctr_reco_predictor, Rprop, cpu, differentiable: 0.20634465292096138
- doctr_reco_predictor, Rprop, cpu, (pt2) foreach: 0.20789880817756057
- doctr_reco_predictor, Rprop, cpu, foreach: 0.20806307601742446
- doctr_reco_predictor, RMSprop, cpu, (pt2) default: 0.01669481643087541
- doctr_reco_predictor, RMSprop, cpu, default: 0.04464893699623644
- doctr_reco_predictor, RMSprop, cpu, (pt2) maximize: 0.016089259163261607
- doctr_reco_predictor, RMSprop, cpu, maximize: 0.05508223799988628
- doctr_reco_predictor, RMSprop, cpu, (pt2) no_foreach: 0.015852507692761718
- doctr_reco_predictor, RMSprop, cpu, no_foreach: 0.046928896196186544
- doctr_reco_predictor, RMSprop, cpu, (pt2) differentiable: 0.01631145666425045
- doctr_reco_predictor, RMSprop, cpu, differentiable: 0.051925949705764654
- doctr_reco_predictor, RMSprop, cpu, (pt2) foreach: 0.05120660975808278
- doctr_reco_predictor, RMSprop, cpu, foreach: 0.05001612349878996
- doctr_reco_predictor, NAdam, cpu, (pt2) default: 0.28031228110194206
- doctr_reco_predictor, NAdam, cpu, default: 0.08847108933453758
- doctr_reco_predictor, NAdam, cpu, (pt2) no_foreach: 0.25494951312430203
- doctr_reco_predictor, NAdam, cpu, no_foreach: 0.08649989737508197
- doctr_reco_predictor, NAdam, cpu, differentiable: 0.11917417799122632
- doctr_reco_predictor, NAdam, cpu, (pt2) foreach: 0.09777737509769698
- doctr_reco_predictor, NAdam, cpu, foreach: 0.1010738699696958


Tests that were newly added on affected commit:
- torchrec_dlrm, Adadelta, cuda, (pt2) default: 0.014994187849879381
- torchrec_dlrm, Adadelta, cuda, default: 0.014978928349955824
- torchrec_dlrm, Adadelta, cuda, (pt2) maximize: 0.016102630499881344
- torchrec_dlrm, Adadelta, cuda, maximize: 0.0160583785000199
- torchrec_dlrm, Adadelta, cuda, (pt2) no_foreach: 0.014320898349978961
- torchrec_dlrm, Adadelta, cuda, no_foreach: 0.014308968299883418
- torchrec_dlrm, Adadelta, cuda, (pt2) differentiable: 0.015530964099889388
- torchrec_dlrm, Adadelta, cuda, differentiable: 0.015512127650072215
- torchrec_dlrm, Adadelta, cuda, (pt2) foreach: 0.014948033149994443
- torchrec_dlrm, Adadelta, cuda, foreach: 0.014939841800151043
- torchrec_dlrm, Adagrad, cuda, (pt2) default: 0.008311724980012513
- torchrec_dlrm, Adagrad, cuda, default: 0.00831963762997475
- torchrec_dlrm, Adagrad, cuda, (pt2) maximize: 0.00973093340022994
- torchrec_dlrm, Adagrad, cuda, maximize: 0.009727973766712238
- torchrec_dlrm, Adagrad, cuda, (pt2) no_foreach: 0.00576301886998408
- torchrec_dlrm, Adagrad, cuda, no_foreach: 0.005785037430032389
- torchrec_dlrm, Adagrad, cuda, (pt2) differentiable: 0.006050088810006855
- torchrec_dlrm, Adagrad, cuda, differentiable: 0.006051258799998322
- torchrec_dlrm, Adagrad, cuda, (pt2) foreach: 0.008316462430011598
- torchrec_dlrm, Adagrad, cuda, foreach: 0.008318917229989892
- torchrec_dlrm, Adam, cuda, (pt2) default: 0.01116623480047565
- torchrec_dlrm, Adam, cuda, default: 0.011155925400089473
- torchrec_dlrm, Adam, cuda, (pt2) amsgrad, maximize: 0.013855420350228086
- torchrec_dlrm, Adam, cuda, amsgrad, maximize: 0.013811392450224957
- torchrec_dlrm, Adam, cuda, (pt2) no_foreach: 0.010646292149976942
- torchrec_dlrm, Adam, cuda, no_foreach: 0.010626728249553706
- torchrec_dlrm, Adam, cuda, (pt2) differentiable: 0.016721957150002707
- torchrec_dlrm, Adam, cuda, differentiable: 0.016245382399938536
- torchrec_dlrm, Adam, cuda, (pt2) foreach: 0.011161777850065845
- torchrec_dlrm, Adam, cuda, foreach: 0.01114639139996143
- torchrec_dlrm, Adam, cuda, (pt2) foreach, maximize, capturable: 0.012455937350023306
- torchrec_dlrm, Adam, cuda, foreach, maximize, capturable: 0.012454287799846496
- torchrec_dlrm, Adam, cuda, (pt2) foreach, maximize, capturable, amsgrad: 0.014062719000139622
- torchrec_dlrm, Adam, cuda, foreach, maximize, capturable, amsgrad: 0.014077646899750107
- torchrec_dlrm, Adam, cuda, (pt2) fused: 0.004503214829965145
- torchrec_dlrm, Adam, cuda, fused: 0.004495388380018994
- torchrec_dlrm, Adam, cuda, (pt2) fused, amsgrad, maximize: 0.005105473910007276
- torchrec_dlrm, Adam, cuda, fused, amsgrad, maximize: 0.005101645870017819
- torchrec_dlrm, Adam, cuda, (pt2) fused, capturable: 0.004499055139967822
- torchrec_dlrm, Adam, cuda, fused, capturable: 0.0044984517699776915
- torchrec_dlrm, Adam, cuda, (pt2) fused, capturable, amsgrad: 0.005126409989970853
- torchrec_dlrm, Adam, cuda, fused, capturable, amsgrad: 0.005111473930010106
- torchrec_dlrm, AdamW, cuda, (pt2) default: 0.012280127849953713
- torchrec_dlrm, AdamW, cuda, default: 0.012287732250115369
- torchrec_dlrm, AdamW, cuda, (pt2) amsgrad, maximize: 0.01494011614995543
- torchrec_dlrm, AdamW, cuda, amsgrad, maximize: 0.014911669550201623
- torchrec_dlrm, AdamW, cuda, (pt2) no_foreach: 0.0117759742999624
- torchrec_dlrm, AdamW, cuda, no_foreach: 0.011755353949774873
- torchrec_dlrm, AdamW, cuda, (pt2) differentiable: 0.017700863199934247
- torchrec_dlrm, AdamW, cuda, differentiable: 0.016349512599481385
- torchrec_dlrm, AdamW, cuda, (pt2) foreach: 0.01229102130018873
- torchrec_dlrm, AdamW, cuda, foreach: 0.012265963150275637
- torchrec_dlrm, AdamW, cuda, (pt2) foreach, maximize, capturable: 0.013580483400437516
- torchrec_dlrm, AdamW, cuda, foreach, maximize, capturable: 0.0135746484498668
- torchrec_dlrm, AdamW, cuda, (pt2) foreach, maximize, capturable, amsgrad: 0.015207642899986239
- torchrec_dlrm, AdamW, cuda, foreach, maximize, capturable, amsgrad: 0.015184550899721216
- torchrec_dlrm, AdamW, cuda, (pt2) fused: 0.004611058709997451
- torchrec_dlrm, AdamW, cuda, fused: 0.004607440109975869
- torchrec_dlrm, AdamW, cuda, (pt2) fused, amsgrad, maximize: 0.005155633870017482
- torchrec_dlrm, AdamW, cuda, fused, amsgrad, maximize: 0.005157881069972063
- torchrec_dlrm, AdamW, cuda, (pt2) fused, capturable: 0.004616355960024521
- torchrec_dlrm, AdamW, cuda, fused, capturable: 0.004613317619950976
- torchrec_dlrm, AdamW, cuda, (pt2) fused, capturable, amsgrad: 0.005161790470010601
- torchrec_dlrm, AdamW, cuda, fused, capturable, amsgrad: 0.005154907420001109
- torchrec_dlrm, Adamax, cuda, (pt2) default: 0.014144966450112406
- torchrec_dlrm, Adamax, cuda, default: 0.014130552600181544
- torchrec_dlrm, Adamax, cuda, (pt2) maximize: 0.015248048199646291
- torchrec_dlrm, Adamax, cuda, maximize: 0.015234188400427229
- torchrec_dlrm, Adamax, cuda, (pt2) no_foreach: 0.012280240749896622
- torchrec_dlrm, Adamax, cuda, no_foreach: 0.012262124650078476
- torchrec_dlrm, Adamax, cuda, (pt2) differentiable: 0.013510260700059007
- torchrec_dlrm, Adamax, cuda, differentiable: 0.013488948099620757
- torchrec_dlrm, Adamax, cuda, (pt2) foreach: 0.014145280400043703
- torchrec_dlrm, Adamax, cuda, foreach: 0.014130645149634802
- torchrec_dlrm, ASGD, cuda, (pt2) default: 0.0041666746799455725
- torchrec_dlrm, ASGD, cuda, default: 0.0039753446600661844
- torchrec_dlrm, ASGD, cuda, (pt2) maximize: 0.005082664009969449
- torchrec_dlrm, ASGD, cuda, maximize: 0.005077201019958011
- torchrec_dlrm, ASGD, cuda, (pt2) no_foreach: 0.0056183074200089325
- torchrec_dlrm, ASGD, cuda, no_foreach: 0.005387105799964047
- torchrec_dlrm, ASGD, cuda, (pt2) differentiable: 0.005643817449963535
- torchrec_dlrm, ASGD, cuda, differentiable: 0.0053692822399898435
- torchrec_dlrm, ASGD, cuda, (pt2) foreach: 0.003976288530029706
- torchrec_dlrm, ASGD, cuda, foreach: 0.003975332569971215
- torchrec_dlrm, SGD, cuda, (pt2) default: 0.0016339576349855634
- torchrec_dlrm, SGD, cuda, default: 0.0016359809750065325
- torchrec_dlrm, SGD, cuda, (pt2) maximize: 0.002738066509991768
- torchrec_dlrm, SGD, cuda, maximize: 0.0027340393200574907
- torchrec_dlrm, SGD, cuda, (pt2) no_foreach: 0.0017181653149964406
- torchrec_dlrm, SGD, cuda, no_foreach: 0.0017168525449960726
- torchrec_dlrm, SGD, cuda, (pt2) differentiable: 0.0016335926250030752
- torchrec_dlrm, SGD, cuda, differentiable: 0.001639158199977828
- torchrec_dlrm, SGD, cuda, (pt2) foreach: 0.001634560140009853
- torchrec_dlrm, SGD, cuda, foreach: 0.0016381478499897639
- torchrec_dlrm, SGD, cuda, (pt2) foreach, momentum=0.9, nesterov: 0.0059933281599660404
- torchrec_dlrm, SGD, cuda, foreach, momentum=0.9, nesterov: 0.0059861389900470385
- torchrec_dlrm, SGD, cuda, (pt2) foreach, momentum=0.9: 0.004361763880006038
- torchrec_dlrm, SGD, cuda, foreach, momentum=0.9: 0.004355863579985453
- torchrec_dlrm, RAdam, cuda, (pt2) default: 0.013868410299983225
- torchrec_dlrm, RAdam, cuda, default: 0.013871476450003684
- torchrec_dlrm, RAdam, cuda, (pt2) no_foreach: 0.01616872005033656
- torchrec_dlrm, RAdam, cuda, no_foreach: 0.01616131549999409
- torchrec_dlrm, RAdam, cuda, (pt2) differentiable: 0.016551309200076504
- torchrec_dlrm, RAdam, cuda, differentiable: 0.016540228300073068
- torchrec_dlrm, RAdam, cuda, (pt2) foreach: 0.013858280800195643
- torchrec_dlrm, RAdam, cuda, foreach: 0.013859514249998029
- torchrec_dlrm, Rprop, cuda, (pt2) default: 0.018204541049999537
- torchrec_dlrm, Rprop, cuda, default: 0.018194236850104063
- torchrec_dlrm, Rprop, cuda, (pt2) maximize: 0.019311834149993955
- torchrec_dlrm, Rprop, cuda, maximize: 0.019287687199903304
- torchrec_dlrm, Rprop, cuda, (pt2) no_foreach: 0.017351396400044905
- torchrec_dlrm, Rprop, cuda, no_foreach: 0.017337715149915313
- torchrec_dlrm, Rprop, cuda, (pt2) differentiable: 0.0185166658997332
- torchrec_dlrm, Rprop, cuda, differentiable: 0.018489751699962653
- torchrec_dlrm, Rprop, cuda, (pt2) foreach: 0.018190411999603383
- torchrec_dlrm, Rprop, cuda, foreach: 0.018181593199915372
- torchrec_dlrm, RMSprop, cuda, (pt2) default: 0.007114589140037424
- torchrec_dlrm, RMSprop, cuda, default: 0.007112144910061033
- torchrec_dlrm, RMSprop, cuda, (pt2) maximize: 0.008219930440027383
- torchrec_dlrm, RMSprop, cuda, maximize: 0.008217817309996463
- torchrec_dlrm, RMSprop, cuda, (pt2) no_foreach: 0.0067894925500149835
- torchrec_dlrm, RMSprop, cuda, no_foreach: 0.006787514219977311
- torchrec_dlrm, RMSprop, cuda, (pt2) differentiable: 0.007068442800009507
- torchrec_dlrm, RMSprop, cuda, differentiable: 0.007066543440014356
- torchrec_dlrm, RMSprop, cuda, (pt2) foreach: 0.007115337709983578
- torchrec_dlrm, RMSprop, cuda, foreach: 0.007115016859970637
- torchrec_dlrm, NAdam, cuda, (pt2) default: 0.013327312400360825
- torchrec_dlrm, NAdam, cuda, default: 0.013317409100272926
- torchrec_dlrm, NAdam, cuda, (pt2) no_foreach: 0.012764665950089692
- torchrec_dlrm, NAdam, cuda, no_foreach: 0.012751986500006751
- torchrec_dlrm, NAdam, cuda, (pt2) differentiable: 0.01620922315014468
- torchrec_dlrm, NAdam, cuda, differentiable: 0.015768974949605764
- torchrec_dlrm, NAdam, cuda, (pt2) foreach: 0.013334473500071909
- torchrec_dlrm, NAdam, cuda, foreach: 0.013284243499583681
- torchrec_dlrm, Adadelta, cpu, (pt2) default: 1.0522491250012536
- torchrec_dlrm, Adadelta, cpu, default: 1.0577198210012284
- torchrec_dlrm, Adadelta, cpu, (pt2) maximize: 1.152546215998882
- torchrec_dlrm, Adadelta, cpu, maximize: 1.162692853002227
- torchrec_dlrm, Adadelta, cpu, (pt2) no_foreach: 1.05086874999688
- torchrec_dlrm, Adadelta, cpu, no_foreach: 1.04581060000055
- torchrec_dlrm, Adadelta, cpu, (pt2) differentiable: 1.1806860869983211
- torchrec_dlrm, Adadelta, cpu, differentiable: 1.174428345002525
- torchrec_dlrm, Adadelta, cpu, (pt2) foreach: 1.087780716996349
- torchrec_dlrm, Adadelta, cpu, foreach: 1.0782673279973096
- torchrec_dlrm, Adagrad, cpu, (pt2) default: 0.4746596520053572
- torchrec_dlrm, Adagrad, cpu, default: 0.4700703420021455
- torchrec_dlrm, Adagrad, cpu, (pt2) maximize: 0.5872452580006211
- torchrec_dlrm, Adagrad, cpu, maximize: 0.5877260880006361
- torchrec_dlrm, Adagrad, cpu, (pt2) no_foreach: 0.4725311209986103
- torchrec_dlrm, Adagrad, cpu, no_foreach: 0.47249152299627895
- torchrec_dlrm, Adagrad, cpu, (pt2) differentiable: 0.5320310509996489
- torchrec_dlrm, Adagrad, cpu, differentiable: 0.5428422539989697
- torchrec_dlrm, Adagrad, cpu, (pt2) foreach: 0.7743217319948599
- torchrec_dlrm, Adagrad, cpu, foreach: 0.7693192110018572
- torchrec_dlrm, Adam, cpu, (pt2) default: 0.8399928709986852
- torchrec_dlrm, Adam, cpu, default: 0.821647901997494
- torchrec_dlrm, Adam, cpu, (pt2) amsgrad, maximize: 1.0724075350008206
- torchrec_dlrm, Adam, cpu, amsgrad, maximize: 1.0596949419996236
- torchrec_dlrm, Adam, cpu, (pt2) no_foreach: 0.8309434359980514
- torchrec_dlrm, Adam, cpu, no_foreach: 0.8244987720026984
- torchrec_dlrm, Adam, cpu, (pt2) differentiable: 0.8530185780036845
- torchrec_dlrm, Adam, cpu, differentiable: 0.8465415300015593
- torchrec_dlrm, Adam, cpu, (pt2) foreach: 0.8398836729975301
- torchrec_dlrm, Adam, cpu, foreach: 0.8442341870031669
- torchrec_dlrm, AdamW, cpu, (pt2) default: 0.9036862040011329
- torchrec_dlrm, AdamW, cpu, default: 0.9095629419971374
- torchrec_dlrm, AdamW, cpu, (pt2) amsgrad, maximize: 1.1405078980023973
- torchrec_dlrm, AdamW, cpu, amsgrad, maximize: 1.13410231799935
- torchrec_dlrm, AdamW, cpu, (pt2) no_foreach: 0.9002658360041096
- torchrec_dlrm, AdamW, cpu, no_foreach: 0.900421282996831
- torchrec_dlrm, AdamW, cpu, (pt2) differentiable: 0.9077674680011114
- torchrec_dlrm, AdamW, cpu, differentiable: 0.9116469180007698
- torchrec_dlrm, AdamW, cpu, (pt2) foreach: 0.9064643520032405
- torchrec_dlrm, AdamW, cpu, foreach: 0.8987202749995049
- torchrec_dlrm, Adamax, cpu, (pt2) default: 1.623005851994094
- torchrec_dlrm, Adamax, cpu, default: 1.6325353650026955
- torchrec_dlrm, Adamax, cpu, (pt2) maximize: 1.7526298930024495
- torchrec_dlrm, Adamax, cpu, maximize: 1.7494260579987895
- torchrec_dlrm, Adamax, cpu, (pt2) no_foreach: 1.6453377959987847
- torchrec_dlrm, Adamax, cpu, no_foreach: 1.6434599529966363
- torchrec_dlrm, Adamax, cpu, (pt2) differentiable: 1.7638701119940379
- torchrec_dlrm, Adamax, cpu, differentiable: 1.7594381680028164
- torchrec_dlrm, Adamax, cpu, (pt2) foreach: 2.89732675000414
- torchrec_dlrm, Adamax, cpu, foreach: 2.9212058279954363
- torchrec_dlrm, ASGD, cpu, (pt2) default: 0.29890075299772434
- torchrec_dlrm, ASGD, cpu, default: 0.29834091100201476
- torchrec_dlrm, ASGD, cpu, (pt2) maximize: 0.406343400994956
- torchrec_dlrm, ASGD, cpu, maximize: 0.41316420800285414
- torchrec_dlrm, ASGD, cpu, (pt2) no_foreach: 0.2891827350031235
- torchrec_dlrm, ASGD, cpu, no_foreach: 0.2932236950000515
- torchrec_dlrm, ASGD, cpu, (pt2) differentiable: 0.2956554080010392
- torchrec_dlrm, ASGD, cpu, differentiable: 0.30001513499883004
- torchrec_dlrm, ASGD, cpu, (pt2) foreach: 0.2949178000053507
- torchrec_dlrm, ASGD, cpu, foreach: 0.2965021909985808
- torchrec_dlrm, SGD, cpu, (pt2) default: 0.11824025599707966
- torchrec_dlrm, SGD, cpu, default: 0.11592887949882424
- torchrec_dlrm, SGD, cpu, (pt2) maximize: 0.2334871769999154
- torchrec_dlrm, SGD, cpu, maximize: 0.2292955580051057
- torchrec_dlrm, SGD, cpu, (pt2) no_foreach: 0.11901301200123271
- torchrec_dlrm, SGD, cpu, no_foreach: 0.11798218249896308
- torchrec_dlrm, SGD, cpu, (pt2) differentiable: 0.11863674699998228
- torchrec_dlrm, SGD, cpu, differentiable: 0.11638249799943878
- torchrec_dlrm, SGD, cpu, (pt2) foreach: 0.11564946350335958
- torchrec_dlrm, SGD, cpu, foreach: 0.11788387300111935
- torchrec_dlrm, SGD, cpu, (pt2) foreach, momentum=0.9, nesterov: 0.41042811200168217
- torchrec_dlrm, SGD, cpu, foreach, momentum=0.9, nesterov: 0.40865292899979977
- torchrec_dlrm, SGD, cpu, (pt2) foreach, momentum=0.9: 0.2939816529978998
- torchrec_dlrm, SGD, cpu, foreach, momentum=0.9: 0.2940257600057521
- torchrec_dlrm, RAdam, cpu, (pt2) default: 0.7179324469980202
- torchrec_dlrm, RAdam, cpu, default: 0.7146010369979194
- torchrec_dlrm, RAdam, cpu, (pt2) no_foreach: 0.7135495979964617
- torchrec_dlrm, RAdam, cpu, no_foreach: 0.7198061079980107
- torchrec_dlrm, RAdam, cpu, (pt2) differentiable: 0.7194761790015036
- torchrec_dlrm, RAdam, cpu, differentiable: 0.7170677279937081
- torchrec_dlrm, RAdam, cpu, (pt2) foreach: 1.0850332100017113
- torchrec_dlrm, RAdam, cpu, foreach: 1.0963466410030378
- torchrec_dlrm, Rprop, cpu, (pt2) default: 2.1646629460010445
- torchrec_dlrm, Rprop, cpu, default: 2.1682336810044944
- torchrec_dlrm, Rprop, cpu, (pt2) maximize: 2.275904147005349
- torchrec_dlrm, Rprop, cpu, maximize: 2.281279180999263
- torchrec_dlrm, Rprop, cpu, (pt2) no_foreach: 2.156185658997856
- torchrec_dlrm, Rprop, cpu, no_foreach: 2.170500093998271
- torchrec_dlrm, Rprop, cpu, (pt2) differentiable: 2.2850701269999263
- torchrec_dlrm, Rprop, cpu, differentiable: 2.2871251290052896
- torchrec_dlrm, Rprop, cpu, (pt2) foreach: 2.1704447060037637
- torchrec_dlrm, Rprop, cpu, foreach: 2.166318734001834
- torchrec_dlrm, RMSprop, cpu, (pt2) default: 0.5187132559949532
- torchrec_dlrm, RMSprop, cpu, default: 0.5264216299983673
- torchrec_dlrm, RMSprop, cpu, (pt2) maximize: 0.6430773469983251
- torchrec_dlrm, RMSprop, cpu, maximize: 0.6410972750018118
- torchrec_dlrm, RMSprop, cpu, (pt2) no_foreach: 0.5198663800038048
- torchrec_dlrm, RMSprop, cpu, no_foreach: 0.5250054799980717
- torchrec_dlrm, RMSprop, cpu, (pt2) differentiable: 0.5863325370009989
- torchrec_dlrm, RMSprop, cpu, differentiable: 0.5854320949947578
- torchrec_dlrm, RMSprop, cpu, (pt2) foreach: 0.5397144259986817
- torchrec_dlrm, RMSprop, cpu, foreach: 0.5399923299992224
- torchrec_dlrm, NAdam, cpu, (pt2) default: 0.9885553040003288
- torchrec_dlrm, NAdam, cpu, default: 0.9975512489982066
- torchrec_dlrm, NAdam, cpu, (pt2) no_foreach: 1.003872984998452
- torchrec_dlrm, NAdam, cpu, no_foreach: 0.9931020709991571
- torchrec_dlrm, NAdam, cpu, (pt2) differentiable: 1.3090364020026755
- torchrec_dlrm, NAdam, cpu, differentiable: 1.2807065840024734
- torchrec_dlrm, NAdam, cpu, (pt2) foreach: 1.004755688001751
- torchrec_dlrm, NAdam, cpu, foreach: 1.0028511870041257


cc @janeyx99


This is to be expected. Closing.