Bug: Intermittent browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py | single tracking bug
Status: NEW
Priority: P5
Created: 2025-01-14 07:34:01+00:00
Resolved: 2025-03-03 06:23:15+00:00

**Filed by:** nfay [at] mozilla.com
**Parsed log:** https://treeherder.mozilla.org/logviewer?job_id=490021094&repo=mozilla-central
**Full log:** https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/B2OgM2gpQ0yI7nKSszqiSw/runs/0/artifacts/public/logs/live_backing.log

---
```
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO - TEST-START | browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py TestNoToolbarChanges.test_no_toolbar_changes
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643271	Marionette	DEBUG	Closed connection 1
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643273	Marionette	DEBUG	Accepted connection 2 from 127.0.0.1:38460
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643273	Marionette	DEBUG	2 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643273	Marionette	DEBUG	Waiting for initial application window
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643274	RemoteAgent	TRACE	[9] ProgressListener Start: expectNavigation=false resolveWhenStarted=false unloadTimeout=5000 waitForExplicitStart=false
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643274	RemoteAgent	TRACE	[9] ProgressListener Setting unload timer (5000ms)
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643274	RemoteAgent	TRACE	[9] Wait for initial navigation: isInitial=false, isLoadingDocument=false
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643274	RemoteAgent	TRACE	[9] Document already finished loading: about:blank
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643274	RemoteAgent	TRACE	[9] ProgressListener Stop: has error=false url=about:blank
[task 2025-01-14T07:10:43.281Z] 07:10:43     INFO -  1736838643276	Marionette	DEBUG	2 <- [1,1,null,{"sessionId":"b2a30f99-5c8f-4164-b844-2623483ccf48","capabilities":{"acceptInsecureCerts":false,"browserName":"firefox","browserVersion":"136.0a1","platformName":"linux","unhandledPromptBehavior":"dismiss and notify","userAgent":"Mozilla/5.0 (X11; Linux x86_64; rv:136.0) Gecko/20100101 Firefox/136.0","moz:buildID":"20250114045449","moz:headless":true,"moz:platformVersion":"4.4.0-1014-aws","moz:processID":2282,"moz:profile":"/tmp/tmp1eski_56.mozrunner","moz:shutdownTimeout":60000,"pageLoadStrategy":"normal","timeouts":{"implicit":0,"pageLoad":300000,"script":30000},"setWindowRect":true,"strictFileInteractability":true,"moz:accessibilityChecks":false,"moz:webdriverClick":true,"moz:windowless":false,"proxy":{}}}]
[task 2025-01-14T07:10:43.283Z] 07:10:43     INFO -  1736838643282	Marionette	DEBUG	2 -> [0,2,"WebDriver:SetTimeouts",{"script":30000}]
[task 2025-01-14T07:10:43.283Z] 07:10:43     INFO -  1736838643283	Marionette	DEBUG	2 <- [1,2,null,{"value":null}]
[task 2025-01-14T07:10:43.287Z] 07:10:43     INFO -  1736838643287	Marionette	DEBUG	2 -> [0,3,"WebDriver:SetTimeouts",{"pageLoad":300000}]
[task 2025-01-14T07:10:43.287Z] 07:10:43     INFO -  1736838643287	Marionette	DEBUG	2 <- [1,3,null,{"value":null}]
[task 2025-01-14T07:10:43.288Z] 07:10:43     INFO -  1736838643288	Marionette	DEBUG	2 -> [0,4,"WebDriver:SetTimeouts",{"implicit":0}]
[task 2025-01-14T07:10:43.289Z] 07:10:43     INFO -  1736838643288	Marionette	DEBUG	2 <- [1,4,null,{"value":null}]
[task 2025-01-14T07:10:43.290Z] 07:10:43     INFO -  1736838643290	Marionette	DEBUG	2 -> [0,5,"Marionette:SetContext",{"value":"chrome"}]
[task 2025-01-14T07:10:43.290Z] 07:10:43     INFO -  1736838643290	Marionette	DEBUG	2 <- [1,5,null,{"value":null}]
[task 2025-01-14T07:10:43.291Z] 07:10:43     INFO -  1736838643291	Marionette	DEBUG	2 -> [0,6,"WebDriver:ExecuteScript",{"script":"return CustomizableUI.getWidgetIdsInArea(CustomizableUI.AREA_TABSTRIP).map(id => id.includes('spring') ? 'spring' : id)","args":[],"newSandbox":true,"sandbox":"default","line":18,"filename":"tests/browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py"}]
[task 2025-01-14T07:10:43.294Z] 07:10:43     INFO -  1736838643294	RemoteAgent	TRACE	WebDriverProcessData actor created for PID 2282
[task 2025-01-14T07:10:43.295Z] 07:10:43     INFO -  1736838643295	Marionette	TRACE	[1] MarionetteCommands actor created for window id 2
[task 2025-01-14T07:10:43.297Z] 07:10:43     INFO -  1736838643297	Marionette	DEBUG	2 <- [1,6,null,{"value":["firefox-view-button","tabbrowser-tabs","new-tab-button","alltabs-button"]}]
[task 2025-01-14T07:10:43.298Z] 07:10:43     INFO -  1736838643298	Marionette	DEBUG	2 -> [0,7,"WebDriver:ExecuteScript",{"script":"return CustomizableUI.getDefaultPlacementsForArea(CustomizableUI.AREA_TABSTRIP)","args":[],"newSandbox":true,"sandbox":"default","line":23,"filename":"tests/browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py"}]
[task 2025-01-14T07:10:43.299Z] 07:10:43     INFO -  1736838643299	Marionette	DEBUG	2 <- [1,7,null,{"value":["firefox-view-button","tabbrowser-tabs","new-tab-button","alltabs-button"]}]
[task 2025-01-14T07:10:43.300Z] 07:10:43     INFO -  1736838643300	Marionette	DEBUG	2 -> [0,8,"WebDriver:ExecuteScript",{"script":"return CustomizableUI.getDefaultPlacementsForArea(CustomizableUI.AREA_NAVBAR)","args":[],"newSandbox":true,"sandbox":"default","line":23,"filename":"tests/browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py"}]
[task 2025-01-14T07:10:43.301Z] 07:10:43     INFO -  1736838643301	Marionette	DEBUG	2 <- [1,8,null,{"value":["back-button","forward-button","stop-reload-button","spring","vertical-spacer","urlbar-container","spring","save-to-pocket-button","downloads-button","fxa-toolbar-menu-button","reset-pbm-toolbar-button"]}]
[task 2025-01-14T07:10:43.302Z] 07:10:43     INFO -  1736838643302	Marionette	DEBUG	2 -> [0,9,"WebDriver:ExecuteScript",{"script":"return CustomizableUI.getWidgetIdsInArea(CustomizableUI.AREA_NAVBAR).map(id => id.includes('spring') ? 'spring' : id)","args":[],"newSandbox":true,"sandbox":"default","line":18,"filename":"tests/browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py"}]
[task 2025-01-14T07:10:43.303Z] 07:10:43     INFO -  1736838643303	Marionette	DEBUG	2 <- [1,9,null,{"value":["back-button","forward-button","stop-reload-button","spring","vertical-spacer","urlbar-container","spring","save-to-pocket-button","downloads-button","fxa-toolbar-menu-button","reset-pbm-toolbar-button","unified-extensions-button"]}]
[task 2025-01-14T07:10:43.304Z] 07:10:43     INFO -  1736838643303	Marionette	DEBUG	2 -> [0,10,"WebDriver:ExecuteScript",{"script":"return CustomizableUI.getDefaultPlacementsForArea(CustomizableUI.AREA_BOOKMARKS)","args":[],"newSandbox":true,"sandbox":"default","line":23,"filename":"tests/browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py"}]
[task 2025-01-14T07:10:43.305Z] 07:10:43     INFO -  1736838643304	Marionette	DEBUG	2 <- [1,10,null,{"value":["personal-bookmarks"]}]
[task 2025-01-14T07:10:43.305Z] 07:10:43     INFO -  1736838643305	Marionette	DEBUG	2 -> [0,11,"WebDriver:ExecuteScript",{"script":"return CustomizableUI.getWidgetIdsInArea(CustomizableUI.AREA_BOOKMARKS).map(id => id.includes('spring') ? 'spring' : id)","args":[],"newSandbox":true,"sandbox":"default","line":18,"filename":"tests/browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py"}]
[task 2025-01-14T07:10:43.306Z] 07:10:43     INFO -  1736838643306	Marionette	DEBUG	2 <- [1,11,null,{"value":["personal-bookmarks"]}]
[task 2025-01-14T07:10:43.307Z] 07:10:43     INFO -  1736838643307	Marionette	DEBUG	2 -> [0,12,"Marionette:GetContext",{}]
[task 2025-01-14T07:10:43.307Z] 07:10:43     INFO -  1736838643307	Marionette	DEBUG	2 <- [1,12,null,{"value":"chrome"}]
[task 2025-01-14T07:10:43.308Z] 07:10:43     INFO -  1736838643307	Marionette	DEBUG	2 -> [0,13,"Marionette:SetContext",{"value":"chrome"}]
[task 2025-01-14T07:10:43.308Z] 07:10:43     INFO -  1736838643307	Marionette	DEBUG	2 <- [1,13,null,{"value":null}]
[task 2025-01-14T07:10:43.308Z] 07:10:43     INFO -  1736838643308	Marionette	DEBUG	2 -> [0,14,"WebDriver:TakeScreenshot",{"id":null,"full":true,"hash":false,"scroll":true}]
[task 2025-01-14T07:10:43.329Z] 07:10:43     INFO -  1736838643329	Marionette	DEBUG	2 <- [1,14,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAQQCAYAAAC9RfbYAAAgAElEQVR4XuzdCbCkZXkv8Hf2GZhhF1AQr7JlHBBc0XBNNNFctwKNu3EpYhnFUpJoKhdvriYqUWMp0 ... IECBAgAABAgQIECBAgAABAgQOAQfggSVKgAABAgQIECBAgAABAgQIECBAoCbgAKwtpi8BAgQIECBAgAABAgQIECBAgACBQ2A7VuwYF6EJDwAAAABJRU5ErkJggg=="}]
[task 2025-01-14T07:10:43.330Z] 07:10:43     INFO -  1736838643330	Marionette	DEBUG	2 -> [0,15,"Marionette:SetContext",{"value":"chrome"}]
[task 2025-01-14T07:10:43.331Z] 07:10:43     INFO -  1736838643330	Marionette	DEBUG	2 <- [1,15,null,{"value":null}]
[task 2025-01-14T07:10:43.332Z] 07:10:43     INFO -  1736838643331	Marionette	DEBUG	2 -> [0,16,"Marionette:GetContext",{}]
[task 2025-01-14T07:10:43.332Z] 07:10:43     INFO -  1736838643332	Marionette	DEBUG	2 <- [1,16,null,{"value":"chrome"}]
[task 2025-01-14T07:10:43.333Z] 07:10:43     INFO -  1736838643332	Marionette	DEBUG	2 -> [0,17,"Marionette:SetContext",{"value":"content"}]
[task 2025-01-14T07:10:43.333Z] 07:10:43     INFO -  1736838643332	Marionette	DEBUG	2 <- [1,17,null,{"value":null}]
[task 2025-01-14T07:10:43.333Z] 07:10:43     INFO -  1736838643333	Marionette	DEBUG	2 -> [0,18,"WebDriver:GetPageSource",{}]
[task 2025-01-14T07:10:43.336Z] 07:10:43     INFO -  1736838643335	RemoteAgent	TRACE	WebDriverProcessData actor created for PID 2394
[task 2025-01-14T07:10:43.337Z] 07:10:43     INFO -  1736838643337	Marionette	TRACE	[9] MarionetteCommands actor created for window id 8589934593
[task 2025-01-14T07:10:43.339Z] 07:10:43     INFO -  1736838643338	Marionette	DEBUG	2 <- [1,18,null,{"value":"<html><head></head><body></body></html>"}]
[task 2025-01-14T07:10:43.339Z] 07:10:43     INFO -  1736838643339	Marionette	DEBUG	2 -> [0,19,"Marionette:SetContext",{"value":"chrome"}]
[task 2025-01-14T07:10:43.339Z] 07:10:43     INFO -  1736838643339	Marionette	DEBUG	2 <- [1,19,null,{"value":null}]
[task 2025-01-14T07:10:43.368Z] 07:10:43     INFO - TEST-UNEXPECTED-FAIL | browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py TestNoToolbarChanges.test_no_toolbar_changes | AssertionError: Lists differ: ['personal-bookmarks'] != ['import-button', 'personal-bookmarks']
[task 2025-01-14T07:10:43.368Z] 07:10:43     INFO - 
[task 2025-01-14T07:10:43.368Z] 07:10:43     INFO - First differing element 0:
[task 2025-01-14T07:10:43.368Z] 07:10:43     INFO - 'personal-bookmarks'
[task 2025-01-14T07:10:43.368Z] 07:10:43     INFO - 'import-button'
[task 2025-01-14T07:10:43.368Z] 07:10:43     INFO - 
[task 2025-01-14T07:10:43.368Z] 07:10:43     INFO - Second list contains 1 additional elements.
[task 2025-01-14T07:10:43.368Z] 07:10:43     INFO - First extra element 1:
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO - 'personal-bookmarks'
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO - 
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO - - ['personal-bookmarks']
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO - + ['import-button', 'personal-bookmarks'] : AREA_BOOKMARKS placements are as expected
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO - Traceback (most recent call last):
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO -   File "/builds/worker/workspace/build/venv/lib/python3.8/site-packages/marionette_harness/marionette_test/testcases.py", line 198, in run
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO -     testMethod()
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO -   File "/builds/worker/workspace/build/tests/marionette/tests/browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py", line 59, in test_no_toolbar_changes
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO -     self.check_toolbar_placements()
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO -   File "/builds/worker/workspace/build/tests/marionette/tests/browser/components/customizableui/test/marionette/test_assert_no_toolbar_changes.py", line 42, in check_toolbar_placements
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO -     self.assertEqual(
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO - TEST-INFO took 68ms
[task 2025-01-14T07:10:43.369Z] 07:10:43     INFO -  1736838643340	Marionette	DEBUG	2 -> [0,20,"WebDriver:DeleteSession",{}]
[task 2025-01-14T07:10:43.370Z] 07:10:43     INFO -  1736838643341	Marionette	TRACE	[1] MarionetteCommands actor destroyed for window id 2
[task 2025-01-14T07:10:43.370Z] 07:10:43     INFO -  1736838643341	Marionette	TRACE	[9] MarionetteCommands actor destroyed for window id 8589934593
[task 2025-01-14T07:10:43.370Z] 07:10:43     INFO -  1736838643341	Marionette	DEBUG	2 <- [1,20,null,{"value":null}]
[task 2025-01-14T07:10:43.370Z] 07:10:43     INFO -  1736838643342	Marionette	DEBUG	Closed connection 2
[task 2025-01-14T07:10:43.371Z] 07:10:43     INFO - TEST-START | browser/components/migration/tests/marionette/test_refresh_firefox.py TestFirefoxRefresh.testFxANoSync
```