1663816 - Intermittent editor/spellchecker/tests/test_bug1205983.html | some misspelled words expected: heute ist ein guter - got "German", expected "heuteisteinguter"

Status: RESOLVED FIXED

(Core :: Spelling checker, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=315166072&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Wne_Daj6T_WExRkDqs4nzg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-09-09T01:09:40.750Z] 01:09:40 INFO - TEST-START | editor/spellchecker/tests/test_bug1205983.html
[task 2020-09-09T01:09:42.930Z] 01:09:42 INFO - GECKO(2012) | [Child 5980, Main Thread] WARNING: '!editingHost', file /builds/worker/checkouts/gecko/editor/libeditor/HTMLEditor.cpp, line 546
[task 2020-09-09T01:09:42.930Z] 01:09:42 INFO - GECKO(2012) | [Child 5980, Main Thread] WARNING: mozInlineSpellCHecker::UpdateCurrentDictionary() failed, but ignored: 'NS_SUCCEEDED(rvIgnored)', file /builds/worker/checkouts/gecko/editor/libeditor/EditorBase.cpp, line 4631
[task 2020-09-09T01:09:47.031Z] 01:09:47 INFO - TEST-INFO | started process screenshot
[task 2020-09-09T01:09:47.091Z] 01:09:47 INFO - TEST-INFO | screenshot: exit 0
[task 2020-09-09T01:09:47.092Z] 01:09:47 INFO - Buffered messages logged at 01:09:40
[task 2020-09-09T01:09:47.092Z] 01:09:47 INFO - must wait for load
[task 2020-09-09T01:09:47.092Z] 01:09:47 INFO - TEST-PASS | editor/spellchecker/tests/test_bug1205983.html | true expected (de_DE directory should exist)
[task 2020-09-09T01:09:47.093Z] 01:09:47 INFO - Buffered messages logged at 01:09:42
[task 2020-09-09T01:09:47.093Z] 01:09:47 INFO - TEST-PASS | editor/spellchecker/tests/test_bug1205983.html | one misspelled word expected: German
[task 2020-09-09T01:09:47.093Z] 01:09:47 INFO - Buffered messages logged at 01:09:44
[task 2020-09-09T01:09:47.094Z] 01:09:47 INFO - TEST-PASS | editor/spellchecker/tests/test_bug1205983.html | expected en-US
[task 2020-09-09T01:09:47.094Z] 01:09:47 INFO - TEST-PASS | editor/spellchecker/tests/test_bug1205983.html | one misspelled word expected: Nogoodword
[task 2020-09-09T01:09:47.094Z] 01:09:47 INFO - TEST-PASS | editor/spellchecker/tests/test_bug1205983.html | one misspelled word expected: German
[task 2020-09-09T01:09:47.095Z] 01:09:47 INFO - Buffered messages finished
[task 2020-09-09T01:09:47.095Z] 01:09:47 INFO - TEST-UNEXPECTED-FAIL | editor/spellchecker/tests/test_bug1205983.html | some misspelled words expected: heute ist ein guter - got "German", expected "heuteisteinguter"
[task 2020-09-09T01:09:47.095Z] 01:09:47 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:500:14
[task 2020-09-09T01:09:47.095Z] 01:09:47 INFO - enFocus/</<@editor/spellchecker/tests/test_bug1205983.html:120:9
[task 2020-09-09T01:09:47.095Z] 01:09:47 INFO - GECKO(2012) | MEMORY STAT | vsize 545MB | vsizeMaxContiguous 629MB | residentFast 89MB | heapAllocated 7MB
[task 2020-09-09T01:09:47.095Z] 01:09:47 INFO - TEST-OK | editor/spellchecker/tests/test_bug1205983.html | took 6316ms

Comment 1

[Intermittent Failures Robot]

5 failures in 3410 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform breakdown:

• windows7-32: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1663816&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 2

[Intermittent Failures Robot]

5 failures in 3760 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• try: 1
• autoland: 3

Platform breakdown:

• windows7-32: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1663816&startday=2020-09-14&endday=2020-09-20&tree=all

Comment 3

[Intermittent Failures Robot]

8 failures in 4019 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 1

Platform breakdown:

• windows7-32: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1663816&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 4

[Intermittent Failures Robot]

2 failures in 4195 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• windows7-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1663816&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 4275 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1663816&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 4128 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1663816&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 7

[Intermittent Failures Robot]

12 failures in 525 pushes (0.023 failures/push) were associated with this bug in the last 7 days.

This is the #40 most frequent failure this week.

Repository breakdown:

• mozilla-central: 5
• autoland: 6
• try: 1

Platform breakdown:

• windows10-64-shippable-qr: 1
• windows10-64: 2
• linux1804-64-asan: 3
• windows10-64-shippable: 2
• windows7-32-shippable: 1
• windows7-32: 1
• linux1804-64-shippable-qr: 1
• linux1804-64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1663816&startday=2020-12-28&endday=2021-01-03&tree=all

Comment 8

[Intermittent Failures Robot]

34 failures in 2956 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #26 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 18
• mozilla-central: 13
• try: 3

Platform breakdown:

• linux1804-64-asan: 15
• linux1804-64-qr: 4
• windows10-64-shippable: 2
• linux1804-64-shippable-qr: 2
• linux1804-64: 1
• windows10-64: 3
• windows10-64-shippable-qr: 2
• linux1804-64-shippable: 3
• windows10-64-devedition: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1663816&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 9

[Cosmin Sabou [:CosminS]]

This looks to be a regression from Bug 1676966 https://hg.mozilla.org/integration/autoland/rev/02d875d4f7d769cd03be3175490377dc600355fe
Retriggers: https://treeherder.mozilla.org/jobs?repo=autoland&selectedTaskRun=KvYXplSzQverwWbxP9IdBQ.0&resultStatus=pending%2Crunning%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&test_paths=editor%2Fspellchecker%2Ftests&searchStr=linux%2C18.04%2Cx64%2Casan%2Copt&tochange=02d875d4f7d769cd03be3175490377dc600355fe&fromchange=69ae5f925fbc67d86a6fda1ed0a4b02ae8fc4588&group_state=expanded
Jonathan, could you please have a look over this one?

Comment 10

[Atila Butkovits]

There have been 38 failure in the last 7 days: https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2021-01-10&endday=2021-01-17&tree=trunk&bug=1663816

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=326966691&repo=autoland&lineNumber=5313

Comment 11

[Intermittent Failures Robot]

42 failures in 3810 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #9 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 22
• try: 6
• mozilla-central: 14

Platform breakdown:

• linux1804-64-qr: 4
• windows10-64: 7
• windows10-64-qr: 5
• windows10-64-shippable: 6
• linux1804-64-shippable-qr: 1
• windows10-64-devedition: 2
• linux1804-64-shippable: 1
• linux1804-64-asan: 13
• windows10-64-shippable-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1663816&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 12

[Intermittent Failures Robot]

16 failures in 587 pushes (0.027 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• try: 1
• mozilla-central: 3

Platform breakdown:

• windows10-64-qr: 3
• linux1804-64-shippable-qr: 2
• linux1804-64-asan: 8
• windows10-64-shippable: 1
• linux1804-64-qr: 1
• windows10-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1663816&startday=2021-01-19&endday=2021-01-19&tree=all

Comment 13

[Intermittent Failures Robot]

28 failures in 649 pushes (0.043 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 4
• try: 11

Platform breakdown:

• linux1804-64-asan: 19
• windows10-64: 4
• linux1804-64-shippable-qr: 1
• linux1804-64-qr: 1
• windows10-64-shippable: 2
• linux1804-64-tsan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1663816&startday=2021-01-20&endday=2021-01-20&tree=all

Comment 14

[Intermittent Failures Robot]

18 failures in 720 pushes (0.025 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 12
• mozilla-central: 5
• try: 1

Platform and build breakdown:

• linux1804-64-asan: 12
  • opt: 12
• linux1804-64-shippable-qr: 1
  • opt: 1
• linux1804-64-qr: 3
  • debug: 1
  • opt: 2
• windows10-64-shippable-qr: 1
  • opt: 1
• linux1804-64-shippable: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1663816&startday=2021-01-21&endday=2021-01-21&tree=all

Comment 15

[Alexandru Michis [:malexandru]]

Attachment: Bug 1663816 - Disable test_bug1205983.html and test_bug697981.html on windows and linux. r=#intermittent-reviewers

Comment 16

[Intermittent Failures Robot]

94 failures in 3488 pushes (0.027 failures/push) were associated with this bug in the last 7 days.

This is the #7 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 52
• try: 20
• mozilla-central: 22

Platform and build breakdown:

• linux1804-64-qr: 11
  • opt: 10
  • debug: 1
• linux1804-64-asan: 50
  • opt: 50
• windows10-64-shippable-qr: 5
  • opt: 5
• windows10-64-devedition: 1
  • opt: 1
• linux1804-64-shippable: 3
  • opt: 3
• windows10-64-shippable: 6
  • opt: 6
• windows10-64-qr: 4
  • opt: 4
• linux1804-64-shippable-qr: 6
  • opt: 6
• windows10-64: 6
  • opt: 6
• linux1804-64-tsan: 1
  • opt: 1
• linux1804-64: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1663816&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 17

[Joel Maher ( :jmaher ) (UTC -8)]

heads up, we are disabling two additional tests- there has been a needinfo here for a while

Comment 18

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ae4e77e52a24
Disable test_bug1205983.html and test_bug697981.html on windows and linux. r=intermittent-reviewers,jmaher

Comment 19

[Mirko Brodesser (:mbrodesser-Igalia), offline until April 25h]

@jfkthame: would you mind having a look at this?

Comment 20

[Mirko Brodesser (:mbrodesser-Igalia), offline until April 25h]

Since the spelling checker is unowned code, I'm a little concerned about silently disabling tests.

Comment 21

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/ae4e77e52a24

Comment 22

[Jonathan Kew [:jfkthame]]

(In reply to Mirko Brodesser (:mbrodesser) from comment #20)

Since the spelling checker is unowned code, I'm a little concerned about silently disabling tests.

Yeah, it's not great. I guess these tests are fragile in the face of unexpected reflow, which resets the spell-checking state of the element or something like that.

Maybe we can try running this directory with gfx.font_rendering.fallback.async set to false, and see if that helps. We already have a couple of custom prefs here to try and avoid the effects of lazy font loading. I'll push a try job with the added pref and see if it looks any better.

Comment 23

[Jonathan Kew [:jfkthame]]

I retriggered a bunch of test runs and haven't seen this failure happen with the pref set to false: https://treeherder.mozilla.org/jobs?repo=try&revision=fd7c700249d18a91434f12f8f8b92873d838e1aa&duplicate_jobs=visible. So I think that's a better solution here.

Comment 24

[Jonathan Kew [:jfkthame]]

Attachment: Bug 1663816 - Disable async font fallback for spell-checker tests. r=#intermittent-reviewers

Comment 25

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/295f22bac772
Disable async font fallback for spell-checker tests. r=intermittent-reviewers,jmaher

Comment 26

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/295f22bac772

Comment 27

[Julien Cristau [:jcristau] (back April 22)]

https://hg.mozilla.org/releases/mozilla-beta/rev/5e4f73f329db

Comment 28

[Intermittent Failures Robot]

14 failures in 3891 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 3
• mozilla-beta: 7
• try: 3
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-qr: 3
  • opt: 2
  • debug: 1
• linux1804-64-asan: 6
  • opt: 6
• windows10-64-shippable: 1
  • opt: 1
• windows10-64: 1
  • asan: 1
• linux1804-64-shippable: 1
  • opt: 1
• linux1804-64: 1
  • opt: 1
• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1663816&startday=2021-01-25&endday=2021-01-31&tree=all