Bug: 4.84 - 2.02% google-mail ContentfulSpeedIndex / google-mail loadtime + 18 more (Windows) regression on Fri October 4 2024
Status: RESOLVED
Priority: P1
Resolution: FIXED
Created: 2024-10-11 12:56:27+00:00
Resolved: 2024-10-23 16:18:41+00:00

Perfherder has detected a browsertime performance regression from push [0ce46cb64bf09bfa7f0edd1340f7d7166fbbf8ec](https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=0ce46cb64bf09bfa7f0edd1340f7d7166fbbf8ec). As author of one of the patches included in that push, we need your help to address this regression.

### Regressions:

| **Ratio** | **Test** | **Platform** | **Options** | **Absolute values (old vs new)** |  **Performance Profiles** | 
|--|--|--|--|--|--| 
| [5%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85111,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) ContentfulSpeedIndex | windows11-64-shippable-qr | fission warm webrender | 548.01 -> 574.54 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |
| [5%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85112,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) FirstVisualChange | windows11-64-shippable-qr | fission warm webrender | 546.81 -> 573.23 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |
| [5%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85115,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) SpeedIndex | windows11-64-shippable-qr | fission warm webrender | 549.16 -> 574.94 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |
| [5%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85114,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) PerceptualSpeedIndex | windows11-64-shippable-qr | fission warm webrender | 553.91 -> 579.28 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |
| [4%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,86158,1,13)  | [yahoo-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#yahoo-mail-d) loadtime | windows11-64-shippable-qr | bytecode-cached fission warm webrender | 171.89 -> 177.92 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FTN0yxgb5QPm-IViuUOa_Zw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_yahoo-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FGO4Mm07WQAidQZ8H0lnc_w%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_yahoo-mail.zip) |
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85102,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) FirstVisualChange | windows11-64-shippable-qr | cold fission webrender | [668.29](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bkG-HjvIQw2nLUV75pS3LA/runs/0/artifacts/public/test_info/browsertime-results.tgz) -> [691.40](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZLetqboAREuG1A-hU77eVw/runs/0/artifacts/public/test_info/browsertime-results.tgz) | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85104,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) PerceptualSpeedIndex | windows11-64-shippable-qr | cold fission webrender | [725.22](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bkG-HjvIQw2nLUV75pS3LA/runs/0/artifacts/public/test_info/browsertime-results.tgz) -> [750.07](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZLetqboAREuG1A-hU77eVw/runs/0/artifacts/public/test_info/browsertime-results.tgz) | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85565,1,13)  | [office](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#office-d) fcp | windows11-64-shippable-qr | fission warm webrender | 205.01 -> 212.03 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2Ff425LcqTSh6fwHFDe7bNnQ%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_office.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FV_iExTf0QDaVWibWZREcYw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_office.zip) |
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,86157,1,13)  | [yahoo-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#yahoo-mail-d) largestContentfulPaint | windows11-64-shippable-qr | bytecode-cached fission warm webrender | 294.88 -> 304.61 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FTN0yxgb5QPm-IViuUOa_Zw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_yahoo-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FGO4Mm07WQAidQZ8H0lnc_w%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_yahoo-mail.zip) |
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85105,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) SpeedIndex | windows11-64-shippable-qr | cold fission webrender | [751.73](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bkG-HjvIQw2nLUV75pS3LA/runs/0/artifacts/public/test_info/browsertime-results.tgz) -> [775.71](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZLetqboAREuG1A-hU77eVw/runs/0/artifacts/public/test_info/browsertime-results.tgz) | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |
|...|...|...|...|...|...|
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85568,1,13)  | [office](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#office-d) loadtime | windows11-64-shippable-qr | fission warm webrender | 221.44 -> 227.58 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2Ff425LcqTSh6fwHFDe7bNnQ%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_office.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FV_iExTf0QDaVWibWZREcYw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_office.zip) |
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85113,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) LastVisualChange | windows11-64-shippable-qr | fission warm webrender | [623.68](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bkG-HjvIQw2nLUV75pS3LA/runs/0/artifacts/public/test_info/browsertime-results.tgz) -> [639.81](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZLetqboAREuG1A-hU77eVw/runs/0/artifacts/public/test_info/browsertime-results.tgz) | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |
| [2%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85608,1,13)  | [nytimes](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#nytimes-d) loadtime | windows11-64-shippable-qr | fission warm webrender | 549.19 -> 562.40 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FQeDJ9YG5S3ChjGlOObCgQg%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_nytimes.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FDdxQYLT0SlyZo2l7c--I0w%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_nytimes.zip) |
| [2%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85601,1,13)  | [nytimes](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#nytimes-d) LastVisualChange | windows11-64-shippable-qr | fission warm webrender | 785.88 -> 803.10 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FQeDJ9YG5S3ChjGlOObCgQg%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_nytimes.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FDdxQYLT0SlyZo2l7c--I0w%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_nytimes.zip) |
| [2%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,85110,1,13)  | [google-mail](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#google-mail-d) loadtime | windows11-64-shippable-qr | cold fission webrender | [276.04](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/bkG-HjvIQw2nLUV75pS3LA/runs/0/artifacts/public/test_info/browsertime-results.tgz) -> [281.61](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ZLetqboAREuG1A-hU77eVw/runs/0/artifacts/public/test_info/browsertime-results.tgz) | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FbkG-HjvIQw2nLUV75pS3LA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FZLetqboAREuG1A-hU77eVw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_google-mail.zip) |


Details of the alert can be found in the [alert summary](https://treeherder.mozilla.org/perfherder/alerts?id=2401), including links to graphs and comparisons for each of the affected tests. Please follow our [guide to handling regression bugs](https://wiki.mozilla.org/TestEngineering/Performance/Handling_regression_bugs) and **let us know your plans within 3 business days, or the patch(es) may be backed out** in accordance with our [regression policy](https://www.mozilla.org/en-US/about/governance/policies/regressions/).

If you need the profiling jobs you can trigger them yourself from treeherder job view or ask a sheriff to do that for you.

You can run all of these tests on try with `./mach try perf --alert 2401`

The following [documentation link](https://firefox-source-docs.mozilla.org/testing/perfdocs/mach-try-perf.html#running-alert-tests) provides more information about this command.

For more information on performance sheriffing please see our [FAQ](https://wiki.mozilla.org/TestEngineering/Performance/FAQ).

If you have any questions, please do not hesitate to reach out to aesanu@mozilla.com.