Bug: 5.78 - 2.23% outlook ContentfulSpeedIndex / outlook SpeedIndex + 2 more (Linux, Windows) regression on Tue May 7 2024
Status: NEW
Priority: --
Created: 2024-05-16 07:30:13+00:00
Resolved: 2024-06-04 15:41:53+00:00

Perfherder has detected a browsertime performance regression from push [2fd6571608c562d4703ad38ef440cb9c437d0046](https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=2fd6571608c562d4703ad38ef440cb9c437d0046). As author of one of the patches included in that push, we need your help to address this regression.

### Regressions:

| **Ratio** | **Test** | **Platform** | **Options** | **Absolute values (old vs new)** |  **Performance Profiles** | 
|--|--|--|--|--|--| 
| [6%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,3777101,1,13)  | [outlook](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#outlook-d) ContentfulSpeedIndex | linux1804-64-shippable-qr | fission warm webrender | 701.54 -> 742.12 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FezemCsntRp6Z0T1ggWbveA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_outlook.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FQnWXAJNWSGygftZ8CA4-NA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_outlook.zip) |
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,3777835,1,13)  | [outlook](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#outlook-d) loadtime | windows10-64-shippable-qr | fission warm webrender | 340.16 -> 351.62 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FULiVnJJWQzqY7owlbW_8Xw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_outlook.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FCyu3yPKHTgqVmw1_k57wyA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_outlook.zip) |
| [3%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,4967360,1,13)  | [outlook](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#outlook-d) largestContentfulPaint | windows10-64-shippable-qr | fission warm webrender | 605.16 -> 623.08 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FULiVnJJWQzqY7owlbW_8Xw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_outlook.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FCyu3yPKHTgqVmw1_k57wyA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_outlook.zip) |
| [2%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,3778006,1,13)  | [outlook](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#outlook-d) SpeedIndex | windows10-64-shippable-qr | fission warm webrender | [804.78](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ULiVnJJWQzqY7owlbW_8Xw/runs/0/artifacts/public/test_info/browsertime-results.tgz) -> [822.72](https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Cyu3yPKHTgqVmw1_k57wyA/runs/0/artifacts/public/test_info/browsertime-results.tgz) | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FULiVnJJWQzqY7owlbW_8Xw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_outlook.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FCyu3yPKHTgqVmw1_k57wyA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_outlook.zip) |
### Improvements:

| **Ratio** | **Test** | **Platform** | **Options** | **Absolute values (old vs new)** |  **Performance Profiles** | 
|--|--|--|--|--|--| 
| [18%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,3780097,1,13)  | [imgur](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#imgur-d) FirstVisualChange | macosx1015-64-shippable-qr | cold fission webrender | 418.78 -> 341.82 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FHpl0GQDBQJy06LIs3TTxKw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_imgur.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FB8Orr7TjTPu3OH-4303aPw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_imgur.zip) |
| [9%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,3780017,1,13)  | [wikia](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#wikia-d) FirstVisualChange | macosx1015-64-shippable-qr | cold fission webrender | 280.67 -> 254.64 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FD-X7YshqQ5ilChonu7Cd2Q%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_wikia.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FPtfDZVl3RIi0uwtbiEa7oA%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_wikia.zip) |
| [8%](https://treeherder.mozilla.org/perfherder/graphs?timerange=1209600&series=autoland,3780101,1,13)  | [imgur](https://firefox-source-docs.mozilla.org/testing/perfdocs/raptor.html#imgur-d) PerceptualSpeedIndex | macosx1015-64-shippable-qr | cold fission webrender | 624.18 -> 573.18 | [Before](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FHpl0GQDBQJy06LIs3TTxKw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_imgur.zip)/[After](https://profiler.firefox.com/from-url/https%3A%2F%2Ffirefox-ci-tc.services.mozilla.com%2Fapi%2Fqueue%2Fv1%2Ftask%2FB8Orr7TjTPu3OH-4303aPw%2Fruns%2F0%2Fartifacts%2Fpublic%2Ftest_info%2Fprofile_imgur.zip) |


Details of the alert can be found in the [alert summary](https://treeherder.mozilla.org/perfherder/alerts?id=149), including links to graphs and comparisons for each of the affected tests. Please follow our [guide to handling regression bugs](https://wiki.mozilla.org/TestEngineering/Performance/Handling_regression_bugs) and **let us know your plans within 3 business days, or the patch(es) may be backed out** in accordance with our [regression policy](https://www.mozilla.org/en-US/about/governance/policies/regressions/).

If you need the profiling jobs you can trigger them yourself from treeherder job view or ask a sheriff to do that for you.

You can run these tests on try with `./mach try perf --alert 149`

For more information on performance sheriffing please see our [FAQ](https://wiki.mozilla.org/TestEngineering/Performance/FAQ).