Closed Bug 1576191 Opened 6 years ago Closed 6 years ago

Intermittent editor/reftests/spellcheck-comma-valid.html == editor/reftests/spellcheck-comma-valid-ref.html | image comparison, max difference: 191, number of differing pixels: 435

Categories

(Core :: DOM: Editor, defect, P5)

Product:
Core
Component:
DOM: Editor
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure, regression)

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=263185145&repo=mozilla-inbound
Full log: https://queue.taskcluster.net/v1/task/Lbn9FfEqRrqbU99tFKBTqA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/Lbn9FfEqRrqbU99tFKBTqA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2019-08-23T14:48:09.071Z] 14:48:09 INFO - REFTEST TEST-START | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid-ref.html
[task 2019-08-23T14:48:09.071Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html | 7443 / 7700 (96%)
[task 2019-08-23T14:48:09.073Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid-ref.html | 7443 / 7700 (96%)
[task 2019-08-23T14:48:09.075Z] 14:48:09 INFO - REFTEST TEST-UNEXPECTED-FAIL | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid-ref.html | image comparison, max difference: 191, number of differing pixels: 435
[task 2019-08-23T14:48:09.078Z] 14:48:09 INFO - REFTEST IMAGE 1 (TEST): data:image/png;base64,iVBORw0KGgoAAAANSUhEUg...
[task 2019-08-23T14:48:09.083Z] 14:48:09 INFO - REFTEST IMAGE 2 (REFERENCE): data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAy....
[task 2019-08-23T14:48:09.084Z] 14:48:09 INFO - REFTEST INFO | Saved log: START http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html
[task 2019-08-23T14:48:09.085Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering WaitForTestEnd
[task 2019-08-23T14:48:09.085Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] WaitForTestEnd: Adding listeners
[task 2019-08-23T14:48:09.086Z] 14:48:09 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2019-08-23T14:48:09.086Z] 14:48:09 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2019-08-23T14:48:09.086Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2019-08-23T14:48:09.087Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2019-08-23T14:48:09.087Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html
[task 2019-08-23T14:48:09.087Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] SendUpdateCanvasForEvent with 0 rects
[task 2019-08-23T14:48:09.088Z] 14:48:09 INFO - REFTEST INFO | Saved log: Updating canvas for invalidation
[task 2019-08-23T14:48:09.088Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html
[task 2019-08-23T14:48:09.089Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] SendUpdateCanvasForEvent with 1 rects
[task 2019-08-23T14:48:09.089Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] Rect: 0 0 800 1000
[task 2019-08-23T14:48:09.089Z] 14:48:09 INFO - REFTEST INFO | Saved log: Updating canvas for invalidation
[task 2019-08-23T14:48:09.089Z] 14:48:09 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2019-08-23T14:48:09.090Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FIRE_INVALIDATE_EVENT
[task 2019-08-23T14:48:09.090Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: dispatching MozReftestInvalidate
[task 2019-08-23T14:48:09.091Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_REFTEST_WAIT_REMOVAL
[task 2019-08-23T14:48:09.091Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_SPELL_CHECKS
[task 2019-08-23T14:48:09.091Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for spell checks to end
[task 2019-08-23T14:48:09.092Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_SPELL_CHECKS
[task 2019-08-23T14:48:09.092Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for spell checks to end
[task 2019-08-23T14:48:09.093Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_SPELL_CHECKS
[task 2019-08-23T14:48:09.093Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_FOR_APZ_FLUSH
[task 2019-08-23T14:48:09.094Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: done requesting APZ flush
[task 2019-08-23T14:48:09.098Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: apz-repaints-flushed fired
[task 2019-08-23T14:48:09.098Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FINISH
[task 2019-08-23T14:48:09.098Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: waiting for MozAfterPaint
[task 2019-08-23T14:48:09.098Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] AfterPaintListener in http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] SendUpdateCanvasForEvent with 0 rects
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: Updating canvas for invalidation
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: STATE_WAITING_TO_FINISH
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] MakeProgress: Completed
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: START http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid-ref.html
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST TEST-END | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid-ref.html
[task 2019-08-23T14:48:09.101Z] 14:48:09 INFO - REFTEST TEST-START | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-valid-ref.html
[task 2019-08-23T14:48:09.101Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-valid.html | 7444 / 7700 (96%)
[task 2019-08-23T14:48:09.101Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-valid-ref.html | 7444 / 7700 (96%)
[task 2019-08-23T14:48:09.101Z] 14:48:09 INFO - REFTEST TEST-PASS | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-valid-ref.html | image comparison, max difference: 0, number of differing pixels: 0
[task 2019-08-23T14:48:09.101Z] 14:48:09 INFO - REFTEST TEST-END | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-valid-ref.html
[task 2019-08-23T14:48:09.102Z] 14:48:09 INFO - REFTEST TEST-START | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-invalid.html != http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-invalid-ref.html
[task 2019-08-23T14:48:09.102Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-invalid.html | 7445 / 7700 (96%)
[task 2019-08-23T14:48:09.102Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-invalid-ref.html | 7445 / 7700 (96%)
[task 2019-08-23T14:48:09.102Z] 14:48:09 INFO - REFTEST TEST-KNOWN-FAIL | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-invalid.html != http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-invalid-ref.html | image comparison, max difference: 0, number of differing pixels: 0
[task 2019-08-23T14:48:09.102Z] 14:48:09 INFO - REFTEST TEST-END | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-invalid.html != http://10.0.2.2:8854/tests/editor/reftests/spellcheck-hyphen-multiple-invalid-ref.html
[task 2019-08-23T14:48:09.103Z] 14:48:09 INFO - REFTEST TEST-START | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-dotafterquote-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-dotafterquote-valid-ref.html
[task 2019-08-23T14:48:09.103Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-dotafterquote-valid.html | 7446 / 7700 (96%)
[task 2019-08-23T14:48:09.103Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-dotafterquote-valid-ref.html | 7446 / 7700 (96%)
[task 2019-08-23T14:48:09.103Z] 14:48:09 INFO - REFTEST TEST-PASS | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-dotafterquote-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-dotafterquote-valid-ref.html | image comparison, max difference: 0, number of differing pixels: 0
[task 2019-08-23T14:48:09.104Z] 14:48:09 INFO - REFTEST TEST-END | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-dotafterquote-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-dotafterquote-valid-ref.html
[task 2019-08-23T14:48:09.104Z] 14:48:09 INFO - REFTEST TEST-START | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-url-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-url-valid-ref.html
[task 2019-08-23T14:48:09.104Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-url-valid.html | 7447 / 7700 (96%)
[task 2019-08-23T14:48:09.104Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-url-valid-ref.html | 7447 / 7700 (96%)
[task 2019-08-23T14:48:09.104Z] 14:48:09 INFO - REFTEST TEST-PASS | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-url-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-url-valid-ref.html | image comparison, max difference: 0, number of differing pixels: 0
[task 2019-08-23T14:48:09.105Z] 14:48:09 INFO - REFTEST TEST-END | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-url-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-url-valid-ref.html
[task 2019-08-23T14:48:09.105Z] 14:48:09 INFO - REFTEST TEST-START | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-non-latin-arabic.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-non-latin-arabic-ref.html
[task 2019-08-23T14:48:09.105Z] 14:48:09 INFO - REFTEST TEST-LOAD | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-non-latin-arabic.html | 7448 / 7700 (96%)
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2019-08-23T14:48:09.099Z] 14:48:09 INFO - REFTEST INFO | Saved log: START http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid-ref.html
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] OnDocumentLoad triggering AfterOnLoadScripts
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: Initializing canvas snapshot
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: DoDrawWindow 0,0,800,1000
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: [CONTENT] RecordResult fired
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST INFO | Saved log: RecordResult fired
[task 2019-08-23T14:48:09.100Z] 14:48:09 INFO - REFTEST TEST-END | http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid.html == http://10.0.2.2:8854/tests/editor/reftests/spellcheck-comma-valid-ref.html

If frequency failure, we should skip this test on android since android doesn't have spellchecker.

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.