1143317 - intermittent test_canvas.html | pixel 25,25 of c458 is 0,255,0,255; expected 0,255,0,255 +/- 2 - Result logged after SimpleTest.finish(), then same for pixel 75,25

David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)

Reporter

Description

•

10 years ago

Many of these intermittent failures were logged in bug 1036583, but it really looks like a separate bug.

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=2355111 repository: fx-team start_time: 2015-03-20T19:39:08 who: philringnalda[at]gmail[dot]com machine: t-w864-ix-130 buildname: Windows 8 64-bit fx-team debug test mochitest-1 revision: 86d77e15b8e1 ValueError: invalid literal for int() with base 10: 'ps:' ValueError: invalid literal for int() with base 10: 'ps:' 106 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #9 (spell-add-dictionaries-main) name - got spell-check-enabled, expected spell-add-dictionaries-main 143 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #0 (*chubbiness) name - got context-undo, expected *chubbiness 144 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #0 (*chubbiness) enabled state - got false, expected true 145 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #1 (spell-add-to-dictionary) name - got ---, expected spell-add-to-dictionary 146 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #1 (spell-add-to-dictionary) enabled state - got null, expected true 147 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #2 (---) name - got context-cut, expected --- 148 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #3 (context-undo) name - got context-copy, expected context-undo 150 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #4 (---) name - got context-paste, expected --- 151 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #5 (context-cut) name - got context-delete, expected context-cut 153 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #6 (context-copy) name - got ---, expected context-copy 154 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #6 (context-copy) enabled state - got null, expected false 155 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #7 (context-paste) name - got context-selectall, expected context-paste 156 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #8 (context-delete) name - got ---, expected context-delete 157 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #8 (context-delete) enabled state - got null, expected false 158 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #9 (---) name - got spell-check-enabled, expected --- 159 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #10 (context-selectall) name - got ---, expected context-selectall 160 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #10 (context-selectall) enabled state - got null, expected true 161 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #11 (---) name - got context-inspect, expected --- 162 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #12 (spell-check-enabled) name - got undefined, expected spell-check-enabled 163 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #12 (spell-check-enabled) enabled state - got undefined, expected true 164 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #13 (spell-dictionaries) name - got undefined, expected spell-dictionaries 165 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #13 (spell-dictionaries) enabled state - got undefined, expected true 173 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #0 (spell-check-dictionary-en-US) name - got spell-add-dictionaries, expected spell-check-dictionary-en-US 175 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #1 (---) name - got undefined, expected --- 176 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #2 (spell-add-dictionaries) name - got undefined, expected spell-add-dictionaries 177 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #2 (spell-add-dictionaries) enabled state - got undefined, expected true 178 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking expected number of menu entries - got 2, expected 6 179 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #15 (---) name - got undefined, expected --- 180 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #16 (context-inspect) name - got undefined, expected context-inspect 181 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #16 (context-inspect) enabled state - got undefined, expected true 182 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking expected number of menu entries - got 24, expected 34 289 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #12 (spell-dictionaries) name - got ---, expected spell-dictionaries 290 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #12 (spell-dictionaries) enabled state - got null, expected true 298 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #0 (spell-check-dictionary-en-US) name - got spell-add-dictionaries, expected spell-check-dictionary-en-US 300 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #1 (---) name - got undefined, expected --- 301 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #2 (spell-add-dictionaries) name - got undefined, expected spell-add-dictionaries 302 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #2 (spell-add-dictionaries) enabled state - got undefined, expected true 303 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking expected number of menu entries - got 2, expected 6 304 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #14 (---) name - got undefined, expected --- 305 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #15 (context-inspect) name - got undefined, expected context-inspect 306 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #15 (context-inspect) enabled state - got undefined, expected true 307 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking expected number of menu entries - got 28, expected 32 341 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #0 (spell-no-suggestions) name - got context-undo, expected spell-no-suggestions 343 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #1 (spell-add-to-dictionary) name - got ---, expected spell-add-to-dictionary 344 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #1 (spell-add-to-dictionary) enabled state - got null, expected true 345 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #2 (---) name - got context-cut, expected --- 346 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #3 (context-undo) name - got context-copy, expected context-undo 348 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #4 (---) name - got context-paste, expected --- 349 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #5 (context-cut) name - got context-delete, expected context-cut 351 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #6 (context-copy) name - got ---, expected context-copy 352 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #6 (context-copy) enabled state - got null, expected false 353 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #7 (context-paste) name - got context-selectall, expected context-paste 354 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #8 (context-delete) name - got ---, expected context-delete 355 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #8 (context-delete) enabled state - got null, expected false 356 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #9 (---) name - got spell-check-enabled, expected --- 357 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #10 (context-selectall) name - got spell-dictionaries, expected context-selectall 359 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #11 (---) name - got , expected --- 360 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #12 (spell-check-enabled) name - got ---, expected spell-check-enabled 361 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #12 (spell-check-enabled) enabled state - got null, expected true 362 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #13 (spell-dictionaries) name - got context-inspect, expected spell-dictionaries 380 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #15 (---) name - got undefined, expected --- 381 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #16 (context-inspect) name - got undefined, expected context-inspect 382 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking item #16 (context-inspect) enabled state - got undefined, expected true 383 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | checking expected number of menu entries - got 28, expected 34 386 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu.html | uncaught exception - NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIController.doCommand] at chrome://specialpowers/content/specialpowersAPI.js:161 393 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_contextmenu_input.html | Test timed out. - expected PASS 438 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_offlineNotification.html | 2 notifications being displayed - got 0, expected 2 439 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_offlineNotification.html | uncaught exception - TypeError: panel.firstElementChild is null at http://mochi.test:8888/tests/browser/base/content/test/general/test_offlineNotification.html:119 446 INFO TEST-UNEXPECTED-FAIL | browser/base/content/test/general/test_offline_gzip.html | uncaught exception - TypeError: panel.firstElementChild is null at http://mochi.test:8888/tests/browser/base/content/test/general/test_offline_gzip.html:109 Return code: 1

Comment hidden (Legacy TBPL/Treeherder Robot)

Botond Ballo [:botond]

Comment 95

•

10 years ago

cc'ing George.

Whiteboard: [gfx-noted]

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=821570 repository: mozilla-aurora start_time: 2015-05-11T16:26:27 who: rvandermeulen[at]mozilla[dot]com machine: tst-linux64-spot-670 buildname: Android 4.3 armv7 API 11+ mozilla-aurora opt test mochitest-5 revision: d3e83bbee2cb 73 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 12,40 of c667 is 1,3,254,255; expected 1,3,254,255 +/- 0 - Result logged after SimpleTest.finish() 74 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 37,40 of c667 is 6,250,246,191; expected 8,252,248,191 +/- 2 - Result logged after SimpleTest.finish() 75 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 62,40 of c667 is 5,9,247,128; expected 6,10,250,127 +/- 4 - Result logged after SimpleTest.finish() 76 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 87,40 of c667 is 11,15,239,64; expected 12,16,244,63 +/- 8 - Result logged after SimpleTest.finish() 77 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 12,20 of c672 is 255,255,0,255; expected 255,255,0,255 +/- 0 - Result logged after SimpleTest.finish() 78 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 50,20 of c672 is 0,255,255,255; expected 0,255,255,255 +/- 0 - Result logged after SimpleTest.finish() 79 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 87,20 of c672 is 0,0,255,255; expected 0,0,255,255 +/- 0 - Result logged after SimpleTest.finish() 80 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 50,45 of c672 is 255,255,255,255; expected 255,255,255,255 +/- 0 - Result logged after SimpleTest.finish() 81 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 25,25 of c458 is 0,255,0,255; expected 0,255,0,255 +/- 2 - Result logged after SimpleTest.finish() 82 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 75,25 of c458 is 0,255,0,255; expected 0,255,0,255 +/- 2 - Result logged after SimpleTest.finish()

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=10033334 repository: mozilla-inbound start_time: 2015-05-20T20:35:44 who: philringnalda[at]gmail[dot]com machine: tst-linux64-spot-1916 buildname: Android 4.3 armv7 API 11+ mozilla-inbound opt test mochitest-5 revision: ce5fcf2f2218 69 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 25,25 of c458 is 0,255,0,255; expected 0,255,0,255 +/- 2 - Result logged after SimpleTest.finish() 70 INFO TEST-UNEXPECTED-FAIL | dom/canvas/test/test_canvas.html | pixel 75,25 of c458 is 0,255,0,255; expected 0,255,0,255 +/- 2 - Result logged after SimpleTest.finish() 122 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Generate a DH key - expected PASS 123 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Derive bits from a DH key - expected PASS 124 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Derive bits from a DH key - expected PASS 125 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the public key is not a DH key - expected PASS 126 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the public key is not a DH key - expected PASS 127 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the public key is not a DH key - expected PASS 128 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the public key is not a DH key - expected PASS 131 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 132 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the given keys' primes or bases don't match - expected PASS 134 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 135 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the given keys' primes or bases don't match - expected PASS 137 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 138 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the given keys' primes or bases don't match - expected PASS 140 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 141 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the given keys' primes or bases don't match - expected PASS 143 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 144 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the given keys' primes or bases don't match - expected PASS 146 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 147 INFO TEST-UNEXPECTED-FAIL | dom/crypto/test/test_WebCrypto_DH.html | Test that DH deriveBits() fails when the given keys' primes or bases don't match - expected PASS 149 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 152 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 155 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 158 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times 161 INFO TEST-UNEXPECTED-ERROR | dom/crypto/test/test_WebCrypto_DH.html | called finish() multiple times

Comment hidden (Legacy TBPL/Treeherder Robot)

Geoff Brown [:gbrown]

Assignee

Updated

•

10 years ago

Assignee: nobody → gbrown

Geoff Brown [:gbrown]

Assignee

Comment 240

•

10 years ago

Attached patch update asyncTestsDone — Details — Splinter Review

The problem here is obvious once you find it! :) Note that isPixel() is not failing in this bug, it is just happening after SimpleTest.finish(). isDone_test_2d_pattern_animated_gif has been set in the 2d.pattern.animated.gif test, but it has never been used; I've just added isDone_test_2d_pattern_animated_gif to the list of conditions in asyncTestsDone() for which it was no doubt intended. https://treeherder.mozilla.org/#/jobs?repo=try&revision=b9b362bb39cb

Attachment #8610546 - Flags: review?(gwright)

Comment hidden (Legacy TBPL/Treeherder Robot)

Ryan VanderMeulen [:RyanVM]

Updated

•

10 years ago

status-firefox38: --- → wontfix

status-firefox38.0.5: --- → wontfix

status-firefox39: --- → affected

status-firefox40: --- → affected

status-firefox41: --- → affected

status-firefox-esr31: --- → unaffected

status-firefox-esr38: --- → unaffected

George Wright (:gw280) (needinfo me!)

Comment 245

•

10 years ago

Comment on attachment 8610546 [details] [diff] [review] update asyncTestsDone Review of attachment 8610546 [details] [diff] [review]: ----------------------------------------------------------------- Nice catch! Thanks.

Attachment #8610546 - Flags: review?(gwright) → review+

Pulsebot

Comment 246

•

10 years ago

https://hg.mozilla.org/integration/mozilla-inbound/rev/d551aa12ebb1

Comment hidden (Legacy TBPL/Treeherder Robot)

Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)

Comment 250

•

10 years ago

https://hg.mozilla.org/mozilla-central/rev/d551aa12ebb1

Status: NEW → RESOLVED

Closed: 10 years ago

status-firefox41: affected → fixed

Resolution: --- → FIXED

Target Milestone: --- → mozilla41

Ryan VanderMeulen [:RyanVM]

Comment 251

•

10 years ago

https://hg.mozilla.org/releases/mozilla-aurora/rev/8eda1041be10

status-firefox40: affected → fixed

Flags: in-testsuite+

Ryan VanderMeulen [:RyanVM]

Comment 252

•

10 years ago

https://hg.mozilla.org/releases/mozilla-beta/rev/ddf891831a04

status-firefox39: affected → fixed