Bug: Intermittent TV browser_RecipeRunner.js | all recipes should have their signature verified - [[{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},{"signature":"abc"},"recipe"],[{"id":3,"name":"missing","action":"missingAction","filt
Status: RESOLVED
Priority: P5
Resolution: INCOMPLETE
Created: 2021-03-12 21:09:57+00:00
Resolved: 2021-04-27 17:05:24+00:00

**Filed by:** btara [at] mozilla.com
**Parsed log:** https://treeherder.mozilla.org/logviewer?job_id=333045160&repo=autoland
**Full log:** https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/U9SstPnUROmotVEbWgEZBw/runs/0/artifacts/public/logs/live_backing.log
**Reftest URL:** https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/U9SstPnUROmotVEbWgEZBw/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---
```
[task 2021-03-12T18:51:22.326Z] 18:51:22     INFO - Entering test bound testReadFromRemoteSettings
[task 2021-03-12T18:51:22.326Z] 18:51:22     INFO - Console message: [JavaScript Error: "Unknown Collection "main/normandy-recipes-capabilities"" {file: "resource://services-settings/RemoteSettingsClient.jsm" line: 160}]
[task 2021-03-12T18:51:22.327Z] 18:51:22     INFO - UnknownCollectionError@resource://services-settings/RemoteSettingsClient.jsm:160:5
[task 2021-03-12T18:51:22.327Z] 18:51:22     INFO - sync@resource://services-settings/RemoteSettingsClient.jsm:470:13
[task 2021-03-12T18:51:22.328Z] 18:51:22     INFO - 
[task 2021-03-12T18:51:22.328Z] 18:51:22     INFO - TEST-PASS | toolkit/components/normandy/test/browser/browser_RecipeRunner.js | The recipes should be accesible from Remote Settings - [{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},{"id":3,"name":"missing","action":"missingAction","filter_expression":"true"}] deepEqual [{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},{"id":3,"name":"missing","action":"missingAction","filter_expression":"true"}] - 
[task 2021-03-12T18:51:22.329Z] 18:51:22     INFO - Buffered messages finished
[task 2021-03-12T18:51:22.332Z] 18:51:22     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/normandy/test/browser/browser_RecipeRunner.js | all recipes should have their signature verified - [[{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},{"signature":"abc"},"recipe"],[{"id":3,"name":"missing","action":"missingAction","filter_expression":"true"},{"signature":"abc"},"recipe"],[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},{"signature":"abc"},"recipe"],[{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},{"signature":"abc"},"recipe"],[{"id":3,"name":"missing","action":"missingAction","filter_expression":"true"},{"signature":"abc"},"recipe"],[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},{"signature":"abc"},"recipe"]] deepEqual [[{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},{"signature":"abc"},"recipe"],[{"id":3,"name":"missing","action":"missingAction","filter_expression":"true"},{"signature":"abc"},"recipe"],[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},{"signature":"abc"},"recipe"]] - JS frame :: chrome://mochitests/content/browser/toolkit/components/normandy/test/browser/browser_RecipeRunner.js :: testReadFromRemoteSettings :: line 344
[task 2021-03-12T18:51:22.333Z] 18:51:22     INFO - Stack trace:
[task 2021-03-12T18:51:22.333Z] 18:51:22     INFO - chrome://mochitests/content/browser/toolkit/components/normandy/test/browser/browser_RecipeRunner.js:testReadFromRemoteSettings:344
[task 2021-03-12T18:51:22.334Z] 18:51:22     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-03-12T18:51:22.335Z] 18:51:22     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/normandy/test/browser/browser_RecipeRunner.js | Recipes should be reported with the correct suitabilities - [[{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},"RECIPE_SUITABILITY_FILTER_MATCH"],[{"id":3,"name":"missing","action":"missingAction","filter_expression":"true"},"RECIPE_SUITABILITY_FILTER_MATCH"],[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},"RECIPE_SUITABILITY_FILTER_MISMATCH"],[{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},"RECIPE_SUITABILITY_FILTER_MATCH"],[{"id":3,"name":"missing","action":"missingAction","filter_expression":"true"},"RECIPE_SUITABILITY_FILTER_MATCH"],[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},"RECIPE_SUITABILITY_FILTER_MISMATCH"]] deepEqual [[{"id":1,"name":"match","action":"matchAction","filter_expression":"true"},"RECIPE_SUITABILITY_FILTER_MATCH"],[{"id":3,"name":"missing","action":"missingAction","filter_expression":"true"},"RECIPE_SUITABILITY_FILTER_MATCH"],[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},"RECIPE_SUITABILITY_FILTER_MISMATCH"]] - JS frame :: chrome://mochitests/content/browser/toolkit/components/normandy/test/browser/browser_RecipeRunner.js :: testReadFromRemoteSettings :: line 353
[task 2021-03-12T18:51:22.335Z] 18:51:22     INFO - Stack trace:
[task 2021-03-12T18:51:22.336Z] 18:51:22     INFO - chrome://mochitests/content/browser/toolkit/components/normandy/test/browser/browser_RecipeRunner.js:testReadFromRemoteSettings:353
[task 2021-03-12T18:51:22.337Z] 18:51:22     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-03-12T18:51:22.337Z] 18:51:22     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/normandy/test/browser/browser_RecipeRunner.js | Filtered-out recipes should be reported - [[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},"backoff"],[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},"backoff"]] deepEqual [[{"id":2,"name":"noMatch","action":"noMatchAction","filter_expression":"false"},"backoff"]] - JS frame :: chrome://mochitests/content/browser/toolkit/components/normandy/test/browser/browser_RecipeRunner.js :: testReadFromRemoteSettings :: line 362
[task 2021-03-12T18:51:22.338Z] 18:51:22     INFO - Stack trace:
[task 2021-03-12T18:51:22.339Z] 18:51:22     INFO - chrome://mochitests/content/browser/toolkit/components/normandy/test/browser/browser_RecipeRunner.js:testReadFromRemoteSettings:362
[task 2021-03-12T18:51:22.339Z] 18:51:22     INFO - Leaving test bound testReadFromRemoteSettings```