1828086 - Perma toolkit/components/translations/tests/browser/browser_remote_settings.js | The following record was expected to be present but was not found: env.version == 114.0 when Gecko 114 merges to Beta on 2023-05-08

Status: VERIFIED FIXED

(Firefox :: Translations, defect)

Description

[Sandor Molnar[:smolnar]]

Central as beta simulation

How to run these simulations

Failure log

NFO - TEST-PASS | toolkit/components/translations/tests/browser/browser_remote_settings.js | The following record was expected to be present but was not found: empty filter expression
[task 2023-04-14T10:39:50.199Z] 10:39:50     INFO -  - 
[task 2023-04-14T10:39:50.199Z] 10:39:50     INFO - Buffered messages finished
[task 2023-04-14T10:39:50.199Z] 10:39:50     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/translations/tests/browser/browser_remote_settings.js | The following record was expected to be present but was not found: env.version == 114.0
[task 2023-04-14T10:39:50.199Z] 10:39:50     INFO -  - Got false, expected true
[task 2023-04-14T10:39:50.199Z] 10:39:50     INFO - Stack trace:
[task 2023-04-14T10:39:50.199Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:test_is:1522
[task 2023-04-14T10:39:50.199Z] 10:39:50     INFO - chrome://mochitests/content/browser/toolkit/components/translations/tests/browser/browser_remote_settings.js:test_filter_current_firefox_version:112
[task 2023-04-14T10:39:50.199Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:handleTask:1043
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1115
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1257
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1032
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1056
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - TEST-PASS | toolkit/components/translations/tests/browser/browser_remote_settings.js | The following record was expected to be present but was not found: env.version <= 114
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO -  - 
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - TEST-PASS | toolkit/components/translations/tests/browser/browser_remote_settings.js | The following record was expected to be present but was not found: env.version > 114.a0
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO -  - 
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - TEST-PASS | toolkit/components/translations/tests/browser/browser_remote_settings.js | The following record was expected to be absent but was found: env.version < 1
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO -  - 
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - Not taking screenshot here: see the one that was previously logged
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/translations/tests/browser/browser_remote_settings.js | Expected 6 items but got 5 items
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO -  - Got 5, expected 6
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - Stack trace:
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:test_is:1522
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochitests/content/browser/toolkit/components/translations/tests/browser/browser_remote_settings.js:test_filter_current_firefox_version:131
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:handleTask:1043
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:_runTaskBasedTest:1115
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1257
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1032
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1056
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - Leaving test bound test_filter_current_firefox_version
[task 2023-04-14T10:39:50.200Z] 10:39:50     INFO - Entering test bound test_get_records_with_multiple_versions
[task 2023-04-14T10:39:50.201Z] 10:39:50     INFO - GECKO(10818) | console.log: "Mocking RemoteSettings client"
[task 2023-04-14T10:39:50.201Z] 10:39:50     INFO - TEST-PASS | toolkit/components/translations/tests/browser/browser_remote_settings.js | Expected record qualityModel.enes.bin to be contained in the nameToVersionMap, but found none

Comment 1

[Intermittent Failures Robot]

1 failures in 3206 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform and build breakdown:

• macosx1100-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1828086&startday=2023-04-10&endday=2023-04-16&tree=all

Comment 2

[Intermittent Failures Robot]

17 failures in 779 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 17

Platform and build breakdown:

• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 1
  • debug: 1
• windows11-32-2009-qr: 1
  • debug: 1
• windows11-64-2009-qr: 3
  • debug: 3
• linux1804-64-tsan-qr: 1
  • opt: 1
• windows11-64-2009-asan-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-devedition-qr: 1
  • opt: 1
• windows11-64-2009-devedition-qr: 1
  • opt: 1
• windows11-64-2009-shippable-qr: 2
  • opt: 2
• linux1804-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-devedition-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1
• macosx1100-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1828086&startday=2023-04-20&endday=2023-04-20&tree=all

Comment 3

[Intermittent Failures Robot]

18 failures in 4004 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 18

Platform and build breakdown:

• windows11-64-2009-shippable-qr: 3
  • opt: 3
• macosx1015-64-qr: 1
  • debug: 1
• linux1804-64-qr: 1
  • debug: 1
• windows11-32-2009-qr: 1
  • debug: 1
• windows11-64-2009-qr: 3
  • debug: 3
• linux1804-64-tsan-qr: 1
  • opt: 1
• windows11-64-2009-asan-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-devedition-qr: 1
  • opt: 1
• windows11-64-2009-devedition-qr: 1
  • opt: 1
• linux1804-64-shippable-qr: 1
  • opt: 1
• macosx1015-64-devedition-qr: 1
  • opt: 1
• macosx1015-64-shippable-qr: 1
  • opt: 1
• macosx1100-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1828086&startday=2023-04-17&endday=2023-04-23&tree=all

Comment 4

[Erik Nordin [:nordzilla]]

It seems to be the case that AppConstants.MOZ_APP_VERSION is reporting a different version than the RemoteSettings env.version for these particular CI runs.

However, maintaining equality between these two values is not critical or necessary for Firefox Translations. I simply added this test case to help ensure that the count of records retrieved was correct, and because I didn't think these two values would ever have discrepancies.

The other test cases, which are critical to Firefox Translations versioning, appear to be working in CI.

I am going to remove this test case since it is causing inconsistencies in CI, and is not critical.

Comment 5

[Erik Nordin [:nordzilla]]

Attachment: Bug 1828086 - Fix test failure in browser_remote_settings r=gregtatum!

Removes a test case that is failing in some runs of CI due to the
RemoteSettings env.version not being equal to MOZ_APP_VERSION.
This equality is not a critical or necessary test case.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/cad8a9f79a4f
Fix test failure in browser_remote_settings r=gregtatum

Comment 7

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/cad8a9f79a4f

Comment 8

[Cosmin Sabou [:CosminS]]

Fix verified in latest beta-sim.