1820248 - Perma [tier 2] extensions/spellcheck/tests/mochitest/test_bug1272623.html | Test timed out. - | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once. Make sure you use SimpleTest.waitForExplicitFi

Status: RESOLVED FIXED

(Core :: Spelling checker, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=407743586&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/KqjTkyFJSCSehqM63S3cuA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-03-03T17:51:43.715Z] 17:51:43     INFO - TEST-START | extensions/spellcheck/tests/mochitest/test_bug1272623.html
[task 2023-03-03T17:51:44.849Z] 17:51:44     INFO - GECKO(14110) | JavaScript error: resource://services-settings/RemoteSettingsClient.sys.mjs, line 323: Error: Cannot instantiate Remote Settings client in child processes.
[task 2023-03-03T17:51:44.872Z] 17:51:44     INFO - GECKO(14110) | JavaScript error: resource://gre/modules/XULStore.jsm, line 58: Error: Can't find profile directory.
[task 2023-03-03T17:51:47.026Z] 17:51:47     INFO - GECKO(14110) | JavaScript error: resource://gre/modules/XPCOMUtils.sys.mjs, line 137: NS_ERROR_XPC_GS_RETURNED_FAILURE: ServiceManager::GetService returned failure code:
[task 2023-03-03T17:52:02.159Z] 17:52:02     INFO - GECKO(14110) | ALSA lib seq_hw.c:466:(snd_seq_hw_open) open /dev/snd/seq failed: No such file or directory
[task 2023-03-03T17:56:43.715Z] 17:56:43     INFO - TEST-INFO | started process screentopng
[task 2023-03-03T17:56:43.917Z] 17:56:43     INFO - TEST-INFO | screentopng: exit 0
[task 2023-03-03T17:56:43.918Z] 17:56:43     INFO - Buffered messages logged at 17:51:44
[task 2023-03-03T17:56:43.920Z] 17:56:43     INFO - add_task | Entering 
[task 2023-03-03T17:56:43.921Z] 17:56:43     INFO - Buffered messages logged at 17:51:46
[task 2023-03-03T17:56:43.923Z] 17:56:43     INFO - Loaded chrome script
[task 2023-03-03T17:56:43.923Z] 17:56:43     INFO - Buffered messages finished
[task 2023-03-03T17:56:43.924Z] 17:56:43     INFO - TEST-UNEXPECTED-FAIL | extensions/spellcheck/tests/mochitest/test_bug1272623.html | Test timed out. - 
[task 2023-03-03T17:56:44.718Z] 17:56:44     INFO - Not taking screenshot here: see the one that was previously logged
[task 2023-03-03T17:56:44.719Z] 17:56:44     INFO - TEST-UNEXPECTED-FAIL | extensions/spellcheck/tests/mochitest/test_bug1272623.html | [SimpleTest.finish()] No checks actually run. (You need to call ok(), is(), or similar functions at least once.  Make sure you use SimpleTest.waitForExplicitFinish() if you need it.) 
[task 2023-03-03T17:56:44.720Z] 17:56:44     INFO -     SimpleTest.ok@SimpleTest/SimpleTest.js:414:16
[task 2023-03-03T17:56:44.721Z] 17:56:44     INFO -     afterCleanup@SimpleTest/SimpleTest.js:1435:18
[task 2023-03-03T17:56:44.721Z] 17:56:44     INFO -     executeCleanupFunction@SimpleTest/SimpleTest.js:1511:7
[task 2023-03-03T17:56:44.722Z] 17:56:44     INFO -     SimpleTest.finish@SimpleTest/SimpleTest.js:1531:3
[task 2023-03-03T17:56:44.722Z] 17:56:44     INFO -     killTest@SimpleTest/TestRunner.js:201:22
[task 2023-03-03T17:56:44.723Z] 17:56:44     INFO - GECKO(14110) | MEMORY STAT vsizeMaxContiguous not supported in this build configuration.
[task 2023-03-03T17:56:44.724Z] 17:56:44     INFO - GECKO(14110) | MEMORY STAT | vsize 2508MB | residentFast 93MB | heapAllocated 7MB
[task 2023-03-03T17:56:44.741Z] 17:56:44     INFO - TEST-OK | extensions/spellcheck/tests/mochitest/test_bug1272623.html | took 301022ms
[task 2023-03-03T17:56:44.743Z] 17:56:44     INFO - TEST-START | Shutdown
[task 2023-03-03T17:56:44.743Z] 17:56:44     INFO - Passed:  0
[task 2023-03-03T17:56:44.744Z] 17:56:44     INFO - Failed:  1
[task 2023-03-03T17:56:44.744Z] 17:56:44     INFO - Todo:    0
[task 2023-03-03T17:56:44.744Z] 17:56:44     INFO - Mode:    e10s
[task 2023-03-03T17:56:44.744Z] 17:56:44     INFO - Slowest: 301022ms - /tests/extensions/spellcheck/tests/mochitest/test_bug1272623.html
[task 2023-03-03T17:56:44.745Z] 17:56:44     INFO - SimpleTest FINISHED
[task 2023-03-03T17:56:44.751Z] 17:56:44     INFO - TEST-INFO | Ran 1 Loops
[task 2023-03-03T17:56:44.752Z] 17:56:44     INFO - SimpleTest FINISHED

Comment 1

[Norisz Fay [:noriszfay]]

Hey Luca, could you take a look at this failure? It seems it might be caused by Bug 1819940. Thank you!

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1819940

Comment 3

[Luca Greco [:rpl] [:luca] [:lgreco]]

(In reply to Norisz Fay [:noriszfay] from comment #1)

Hey Luca, could you take a look at this failure? It seems it might be caused by Bug 1819940. Thank you!

Sure, I can reproduce the issue locally, it looked really unexpected that the patches landed from Bug 1819940 could be triggering this kind of issue in this two apparently unrelated tests, but I learnt long time ago to never say "never".

The oddest part is that the test pass just fine in non headless mode, but fails consistently in headless mode, which it is odd but not helpful to determine which part of bug 1819940 may have been able to trigger this kind of failure.

Given that we are not in rush to remove the probes expired a long time ago that bug 1819940, it may be reasonable to backout those patches in the short term? wdyt?

So that we can get one more confirmation that the two unexpected failures are gone without those changes and I can have a bit more time to dig more into it and determine how removing those probes may have been able to trigger this as a side effect.

Comment 4

[Norisz Fay [:noriszfay]]

Hello, the failure seems to happen only on central and so far only saw it as a tier 2. Backout it's not a must for tier 2 issues but if you'd prefer it we could back it out from autoland and with a following merge the backout will get into central fixing the issue. Let me know if we should proceed with a backout or just leave it like this for now until a fix will be made!

Comment 5

[Luca Greco [:rpl] [:luca] [:lgreco]]

(In reply to Norisz Fay [:noriszfay] from comment #4)

Hello, the failure seems to happen only on central and so far only saw it as a tier 2. Backout it's not a must for tier 2 issues but if you'd prefer it we could back it out from autoland and with a following merge the backout will get into central fixing the issue. Let me know if we should proceed with a backout or just leave it like this for now until a fix will be made!

My main concern, and reason for proposing a backout even if the test itself is technically a tier 2 test, is not knowing exactly
what is going on yet and if this wouldn't matter in practice or if this test is covering something that would also matter
for real users and this test was the only one covering that corner case just by luck/chance.

Given that removing those probes is mainly a "nice to have" cleanup, I'd prefer to dig into it a bit more before
landing it again.

Btw, thanks a lot for your help on quickly dealing with this unexpected issue.

Comment 6

[Norisz Fay [:noriszfay]]

Understood, will proceed with a backout then so the issue is cleared until a fix can be made for it. Thanks!

Comment 7

[Norisz Fay [:noriszfay]]

Fixed by backout: https://hg.mozilla.org/integration/autoland/rev/da070069775f73519db853b513d8582d07622992

Comment 8

[Iulian Moraru]

This is still perma failing even after the backout of Bug 1819940.
It seems that this was actually regressed by Bug 1805288 - Part 2 from that bug.
More context about the actual bug that caused this can be found in Bug 1819940 - comment 8.

Hi Tooru! Can you please take a look at this?
Thank you!

Comment 9

[Intermittent Failures Robot]

21 failures in 3752 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 21

Platform and build breakdown:

• linux1804-64-shippable-qr: 21
  • opt: 21

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1820248&startday=2023-02-27&endday=2023-03-05&tree=all

Comment 10

[BugBot [:suhaib / :marco/ :calixte]]

:arai, since you are the author of the regressor, bug 1805288, could you take a look?

For more information, please visit auto_nag documentation.

Comment 11

[Iulian Moraru]

The perma failure should be fixed by backout. Backout link: https://hg.mozilla.org/integration/autoland/rev/056c6b740f51f26df3f439385200f3d78bd02a1f

Comment 12

[Intermittent Failures Robot]

2 failures in 3966 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-shippable-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1820248&startday=2023-03-06&endday=2023-03-12&tree=all