(In reply to Malte Jürgens from comment #5) > I am pretty sure that this has nothing to do with my changes, but is rather caused by Bug 1783248, which recently created a check for changed prefs. The timing would fit there. A possible fix would be adding `app.normandy.first_run` to `ignorePrefs.json`, similar to Bug 1829062. Makes sense! That list is appropriate for prefs that might get toggled in the background, in a benign/irrelevant way, while tests happen to be running. That seems to be the case for this pref -- it looks like it starts out `true`, and then gets set to `false` here: https://searchfox.org/mozilla-central/rev/32c74afbb24dce4b5dd6b33be71197e615631d71/toolkit/components/normandy/lib/RecipeRunner.sys.mjs#132-136
Bug 1832358 Comment 7 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
(In reply to Malte Jürgens from comment #5) > I am pretty sure that this has nothing to do with my changes, but is rather caused by Bug 1783248, which recently created a check for changed prefs. The timing would fit there. A possible fix would be adding `app.normandy.first_run` to `ignorePrefs.json`, similar to Bug 1829062. Makes sense! That list is appropriate for prefs that might get toggled in the background, while tests happen to be running, completely independently from the tests themselves. That seems to be the case for this pref -- it looks like it starts out `true`, and then gets set to `false` here: https://searchfox.org/mozilla-central/rev/32c74afbb24dce4b5dd6b33be71197e615631d71/toolkit/components/normandy/lib/RecipeRunner.sys.mjs#132-136