Closed
Bug 1777980
Opened 2 years ago
Closed 2 years ago
Intermittent testing/marionette/harness/marionette_harness/tests/unit/test_reftest.py TestReftest.test_cache_multiple_sizes | AssertionError: 'PASS' != 'FAIL'
Categories
(Testing :: Marionette Client and Harness, defect, P5)
Testing
Marionette Client and Harness
Tracking
(Not tracked)
RESOLVED
DUPLICATE
of bug 1727207
People
(Reporter: intermittent-bug-filer, Unassigned)
Details
(Keywords: assertion, intermittent-failure)
Filed by: ccozmuta [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=383290975&repo=mozilla-release
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XSLx_AKxQLW_59RRdgwsfQ/runs/0/artifacts/public/logs/live_backing.log
[task 2022-07-04T13:54:24.738Z] 13:54:24 INFO - TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_reftest.py TestReftest.test_cache_multiple_sizes
[task 2022-07-04T13:54:24.739Z] 13:54:24 INFO - 1656942864739 Marionette DEBUG Closed connection 23
[task 2022-07-04T13:54:24.741Z] 13:54:24 INFO - 1656942864741 Marionette DEBUG Accepted connection 24 from 127.0.0.1:46196
[task 2022-07-04T13:54:24.743Z] 13:54:24 INFO - 1656942864743 Marionette DEBUG 24 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
[task 2022-07-04T13:54:24.745Z] 13:54:24 INFO - 1656942864744 Marionette DEBUG Waiting for initial application window
[task 2022-07-04T13:54:24.747Z] 13:54:24 INFO - 1656942864747 RemoteAgent TRACE [64] Document already finished loading: data:text/html;charset=utf-8,%3Cselect%20multiple%3E%20%3Coption%3Efirst%20%3C/select%3E
[task 2022-07-04T13:54:24.752Z] 13:54:24 INFO - 1656942864751 Marionette DEBUG 24 <- [1,1,null,{"sessionId":"75bf4ba7-b2a8-436c-8947-c958dfbfd66f","capabilities":{"browserName":"firefox","browserVersion":"102.0 ... wnTimeout":300000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true,"moz:windowless":false,"proxy":{}}}]
[task 2022-07-04T13:54:24.754Z] 13:54:24 INFO - 1656942864754 Marionette DEBUG 24 -> [0,2,"WebDriver:SetTimeouts",{"script":30000}]
[task 2022-07-04T13:54:24.757Z] 13:54:24 INFO - 1656942864756 Marionette DEBUG 24 <- [1,2,null,{"value":null}]
[task 2022-07-04T13:54:24.761Z] 13:54:24 INFO - 1656942864760 Marionette DEBUG 24 -> [0,3,"WebDriver:SetTimeouts",{"pageLoad":300000}]
[task 2022-07-04T13:54:24.762Z] 13:54:24 INFO - 1656942864761 Marionette DEBUG 24 <- [1,3,null,{"value":null}]
[task 2022-07-04T13:54:24.763Z] 13:54:24 INFO - 1656942864762 Marionette DEBUG 24 -> [0,4,"WebDriver:SetTimeouts",{"implicit":0}]
[task 2022-07-04T13:54:24.764Z] 13:54:24 INFO - 1656942864763 Marionette DEBUG 24 <- [1,4,null,{"value":null}]
[task 2022-07-04T13:54:24.765Z] 13:54:24 INFO - 1656942864764 Marionette DEBUG 24 -> [0,5,"Marionette:GetContext",{}]
[task 2022-07-04T13:54:24.766Z] 13:54:24 INFO - 1656942864765 Marionette DEBUG 24 <- [1,5,null,{"value":"content"}]
[task 2022-07-04T13:54:24.768Z] 13:54:24 INFO - 1656942864767 Marionette DEBUG 24 -> [0,6,"Marionette:SetContext",{"value":"content"}]
[task 2022-07-04T13:54:24.769Z] 13:54:24 INFO - 1656942864769 Marionette DEBUG 24 <- [1,6,null,{"value":null}]
[task 2022-07-04T13:54:24.770Z] 13:54:24 INFO - 1656942864770 Marionette DEBUG 24 -> [0,7,"WebDriver:GetWindowHandle",{}]
[task 2022-07-04T13:54:24.771Z] 13:54:24 INFO - 1656942864770 Marionette DEBUG 24 <- [1,7,null,{"value":"0e807cc6-ff74-4f6a-88d8-ed9c7230dfa2"}]
[task 2022-07-04T13:54:24.772Z] 13:54:24 INFO - 1656942864772 Marionette DEBUG 24 -> [0,8,"Marionette:SetContext",{"value":"content"}]
[task 2022-07-04T13:54:24.774Z] 13:54:24 INFO - 1656942864772 Marionette DEBUG 24 <- [1,8,null,{"value":null}]
[task 2022-07-04T13:54:24.775Z] 13:54:24 INFO - 1656942864774 Marionette DEBUG 24 -> [0,9,"Marionette:GetContext",{}]
[task 2022-07-04T13:54:24.776Z] 13:54:24 INFO - 1656942864775 Marionette DEBUG 24 <- [1,9,null,{"value":"content"}]
[task 2022-07-04T13:54:24.776Z] 13:54:24 INFO - 1656942864776 Marionette DEBUG 24 -> [0,10,"Marionette:SetContext",{"value":"chrome"}]
[task 2022-07-04T13:54:24.777Z] 13:54:24 INFO - 1656942864776 Marionette DEBUG 24 <- [1,10,null,{"value":null}]
[task 2022-07-04T13:54:24.779Z] 13:54:24 INFO - 1656942864778 Marionette DEBUG 24 -> [0,11,"WebDriver:ExecuteScript",{"script":"const { Preferences } = ChromeUtils.import(\n \"resource://gre/mo ... ox":true,"sandbox":"default","line":849,"filename":"../../venv/lib/python3.6/site-packages/marionette_driver/marionette.py"}]
[task 2022-07-04T13:54:24.780Z] 13:54:24 INFO - 1656942864780 Marionette TRACE [7] MarionetteCommands actor created for window id 2
[task 2022-07-04T13:54:24.786Z] 13:54:24 INFO - 1656942864786 Marionette DEBUG 24 <- [1,11,null,{"value":null}]
[task 2022-07-04T13:54:24.787Z] 13:54:24 INFO - 1656942864787 Marionette DEBUG 24 -> [0,12,"Marionette:SetContext",{"value":"content"}]
[task 2022-07-04T13:54:24.788Z] 13:54:24 INFO - 1656942864787 Marionette DEBUG 24 <- [1,12,null,{"value":null}]
[task 2022-07-04T13:54:24.789Z] 13:54:24 INFO - 1656942864788 Marionette DEBUG 24 -> [0,13,"Marionette:GetContext",{}]
[task 2022-07-04T13:54:24.789Z] 13:54:24 INFO - 1656942864789 Marionette DEBUG 24 <- [1,13,null,{"value":"content"}]
<...>
[task 2022-07-04T13:54:26.822Z] 13:54:26 INFO - 1656942866822 Marionette DEBUG Comparing 1 pages
[task 2022-07-04T13:54:26.825Z] 13:54:26 INFO - 1656942866823 Marionette DEBUG lhs canvas size 600x600
[task 2022-07-04T13:54:26.825Z] 13:54:26 INFO - 1656942866823 Marionette DEBUG rhs canvas size 600x600
[task 2022-07-04T13:54:26.827Z] 13:54:26 INFO - 1656942866826 Marionette INFO No differences allowed
[task 2022-07-04T13:54:26.827Z] 13:54:26 INFO - 1656942866826 Marionette DEBUG Page 1 maxDifferences: 150 pixelsDifferent: 2994
[task 2022-07-04T13:54:26.828Z] 13:54:26 INFO - 1656942866826 Marionette DEBUG Page 1 compare unequal
[task 2022-07-04T13:54:26.866Z] 13:54:26 INFO - 1656942866866 Marionette DEBUG Canvas pool (600x600) is of length 2
[task 2022-07-04T13:54:26.869Z] 13:54:26 INFO - 1656942866868 Marionette DEBUG 24 <- [1,18,null,{"value":{"status":"FAIL","message":"Testing http://127.0.0.1:42138/reftest/teal-700x700.html == http://127.0.0.1: ... F6RJa8sgwCBAgQIHBcgS2r7o+4+nO/H/clvdlnYPkFyxoIECBAgMDxBfyCdfz/oy+/YP0fr+stCRAgQIAAAQLHF/gALUm3l694otYAAAAASUVORK5CYII="}]}}}]
[task 2022-07-04T13:54:26.872Z] 13:54:26 INFO - 1656942866871 Marionette DEBUG 24 -> [0,19,"Marionette:GetContext",{}]
[task 2022-07-04T13:54:26.873Z] 13:54:26 INFO - 1656942866872 Marionette DEBUG 24 <- [1,19,null,{"value":"content"}]
[task 2022-07-04T13:54:26.874Z] 13:54:26 INFO - 1656942866874 Marionette DEBUG 24 -> [0,20,"Marionette:SetContext",{"value":"chrome"}]
[task 2022-07-04T13:54:26.875Z] 13:54:26 INFO - 1656942866875 Marionette DEBUG 24 <- [1,20,null,{"value":null}]
[task 2022-07-04T13:54:26.877Z] 13:54:26 INFO - 1656942866877 Marionette DEBUG 24 -> [0,21,"WebDriver:TakeScreenshot",{"id":null,"full":true,"hash":false,"scroll":true}]
[task 2022-07-04T13:54:26.879Z] 13:54:26 INFO - 1656942866878 Marionette TRACE [66] MarionetteCommands actor created for window id 50
[task 2022-07-04T13:54:26.916Z] 13:54:26 INFO - 1656942866915 Marionette DEBUG 24 <- [1,21,null,{"value":"iVBORw0KGgoAAAANSUhEUgAAAlgAAAJYCAYAAAC+ZpjcAAAfJUlEQVR4Xu3aMXJWBRSG4fsXdJAwRkezEToK3YEuwo49ZA90LkJ3oAUd ... 8qsB6c2AMIECBAgEArILBaz4dY+/9PhP/+FusrfyJ8CGObBAgQIEAgE/jzvz8R+u1V5vlQQ/6T+0PJ2iVAgAABAgTWCvwD69Kb8e3MmOAAAAAASUVORK5CYII="}]
[task 2022-07-04T13:54:26.918Z] 13:54:26 INFO - 1656942866917 Marionette DEBUG 24 -> [0,22,"Marionette:SetContext",{"value":"content"}]
[task 2022-07-04T13:54:26.920Z] 13:54:26 INFO - 1656942866918 Marionette DEBUG 24 <- [1,22,null,{"value":null}]
[task 2022-07-04T13:54:26.922Z] 13:54:26 INFO - 1656942866922 Marionette DEBUG 24 -> [0,23,"Marionette:GetContext",{}]
[task 2022-07-04T13:54:26.925Z] 13:54:26 INFO - 1656942866923 Marionette DEBUG 24 <- [1,23,null,{"value":"content"}]
[task 2022-07-04T13:54:26.927Z] 13:54:26 INFO - 1656942866927 Marionette DEBUG 24 -> [0,24,"Marionette:SetContext",{"value":"content"}]
[task 2022-07-04T13:54:26.929Z] 13:54:26 INFO - 1656942866927 Marionette DEBUG 24 <- [1,24,null,{"value":null}]
[task 2022-07-04T13:54:26.932Z] 13:54:26 INFO - 1656942866931 Marionette DEBUG 24 -> [0,25,"WebDriver:GetPageSource",{}]
[task 2022-07-04T13:54:26.939Z] 13:54:26 INFO - 1656942866938 Marionette TRACE [67] MarionetteCommands actor created for window id 10737418242
[task 2022-07-04T13:54:26.943Z] 13:54:26 INFO - 1656942866942 Marionette DEBUG 24 <- [1,25,null,{"value":"<html><head><style>\n * {\n margin: 0;\n padding: 0;\n }\n\n html {\n background: teal ... ight: 100px;\n width: 100px;\n background: transparent;\n }\n</style>\n</head><body><div></div>\n</body></html>"}]
[task 2022-07-04T13:54:26.944Z] 13:54:26 INFO - 1656942866944 Marionette DEBUG 24 -> [0,26,"Marionette:SetContext",{"value":"content"}]
[task 2022-07-04T13:54:26.945Z] 13:54:26 INFO - 1656942866945 Marionette DEBUG 24 <- [1,26,null,{"value":null}]
[task 2022-07-04T13:54:26.957Z] 13:54:26 INFO - TEST-UNEXPECTED-FAIL | testing/marionette/harness/marionette_harness/tests/unit/test_reftest.py TestReftest.test_cache_multiple_sizes | AssertionError: 'PASS' != 'FAIL'
[task 2022-07-04T13:54:26.957Z] 13:54:26 INFO - - PASS
[task 2022-07-04T13:54:26.958Z] 13:54:26 INFO - + FAIL
[task 2022-07-04T13:54:26.958Z] 13:54:26 INFO - Traceback (most recent call last):
[task 2022-07-04T13:54:26.959Z] 13:54:26 INFO - File "/builds/worker/workspace/build/venv/lib/python3.6/site-packages/marionette_harness/marionette_test/testcases.py", line 202, in run
[task 2022-07-04T13:54:26.959Z] 13:54:26 INFO - testMethod()
[task 2022-07-04T13:54:26.960Z] 13:54:26 INFO - File "/builds/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_reftest.py", line 91, in test_cache_multiple_sizes
[task 2022-07-04T13:54:26.960Z] 13:54:26 INFO - self.assertEqual(u"PASS", rv[u"value"][u"status"])
[task 2022-07-04T13:54:26.960Z] 13:54:26 INFO - TEST-INFO took 2208ms
[task 2022-07-04T13:54:26.961Z] 13:54:26 INFO - 1656942866952 Marionette DEBUG 24 -> [0,27,"reftest:teardown",{}]
[task 2022-07-04T13:54:26.964Z] 13:54:26 INFO - 1656942866956 Marionette DEBUG 24 <- [1,27,null,{"value":null}]
[task 2022-07-04T13:54:27.013Z] 13:54:27 INFO - 1656942867012 Marionette TRACE Received observer notification xul-window-destroyed
[task 2022-07-04T13:54:27.019Z] 13:54:27 INFO - 1656942867018 RemoteAgent TRACE Received DOM event activate for [object Window]
[task 2022-07-04T13:54:27.020Z] 13:54:27 INFO - 1656942867019 RemoteAgent TRACE Received DOM event focus for [object HTMLDocument]
[task 2022-07-04T13:54:27.048Z] 13:54:27 INFO - 1656942867048 Marionette DEBUG 24 -> [0,28,"WebDriver:SwitchToWindow",{"handle":"0e807cc6-ff74-4f6a-88d8-ed9c7230dfa2","focus":true}]
[task 2022-07-04T13:54:27.050Z] 13:54:27 INFO - 1656942867050 Marionette DEBUG 24 <- [1,28,null,{"value":null}]
[task 2022-07-04T13:54:27.055Z] 13:54:27 INFO - 1656942867054 Marionette DEBUG 24 -> [0,29,"Marionette:GetContext",{}]
[task 2022-07-04T13:54:27.056Z] 13:54:27 INFO - 1656942867055 Marionette DEBUG 24 <- [1,29,null,{"value":"content"}]
[task 2022-07-04T13:54:27.057Z] 13:54:27 INFO - 1656942867057 Marionette DEBUG 24 -> [0,30,"Marionette:SetContext",{"value":"chrome"}]
[task 2022-07-04T13:54:27.058Z] 13:54:27 INFO - 1656942867058 Marionette DEBUG 24 <- [1,30,null,{"value":null}]
[task 2022-07-04T13:54:27.060Z] 13:54:27 INFO - 1656942867059 Marionette DEBUG 24 -> [0,31,"WebDriver:ExecuteScript",{"script":"const { Preferences } = ChromeUtils.import(\n \"resource://gre/mod ... ox":true,"sandbox":"default","line":777,"filename":"../../venv/lib/python3.6/site-packages/marionette_driver/marionette.py"}]
[task 2022-07-04T13:54:27.076Z] 13:54:27 INFO - 1656942867075 Marionette DEBUG 24 <- [1,31,null,{"value":null}]
[task 2022-07-04T13:54:27.078Z] 13:54:27 INFO - 1656942867077 Marionette DEBUG 24 -> [0,32,"Marionette:SetContext",{"value":"content"}]
[task 2022-07-04T13:54:27.078Z] 13:54:27 INFO - 1656942867077 Marionette DEBUG 24 <- [1,32,null,{"value":null}]
[task 2022-07-04T13:54:27.080Z] 13:54:27 INFO - 1656942867079 Marionette DEBUG 24 -> [0,33,"Marionette:GetContext",{}]
[task 2022-07-04T13:54:27.080Z] 13:54:27 INFO - 1656942867079 Marionette DEBUG 24 <- [1,33,null,{"value":"content"}]
[task 2022-07-04T13:54:27.081Z] 13:54:27 INFO - 1656942867081 Marionette DEBUG 24 -> [0,34,"Marionette:SetContext",{"value":"chrome"}]
[task 2022-07-04T13:54:27.082Z] 13:54:27 INFO - 1656942867081 Marionette DEBUG 24 <- [1,34,null,{"value":null}]
[task 2022-07-04T13:54:27.087Z] 13:54:27 INFO - 1656942867086 Marionette DEBUG 24 -> [0,35,"WebDriver:ExecuteScript",{"script":"const { Preferences } = ChromeUtils.import(\n \"resource://gre/mod ... ox":true,"sandbox":"default","line":777,"filename":"../../venv/lib/python3.6/site-packages/marionette_driver/marionette.py"}]
[task 2022-07-04T13:54:27.094Z] 13:54:27 INFO - 1656942867093 Marionette DEBUG 24 <- [1,35,null,{"value":null}]
[task 2022-07-04T13:54:27.095Z] 13:54:27 INFO - 1656942867095 Marionette DEBUG 24 -> [0,36,"Marionette:SetContext",{"value":"content"}]
[task 2022-07-04T13:54:27.096Z] 13:54:27 INFO - 1656942867095 Marionette DEBUG 24 <- [1,36,null,{"value":null}]
[task 2022-07-04T13:54:27.098Z] 13:54:27 INFO - 1656942867097 Marionette DEBUG 24 -> [0,37,"WebDriver:DeleteSession",{}]
[task 2022-07-04T13:54:27.105Z] 13:54:27 INFO - 1656942867105 Marionette DEBUG 24 <- [1,37,null,{"value":null}]
[task 2022-07-04T13:54:27.107Z] 13:54:27 INFO - TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_reftest.py TestReftest.test_url_comparison
This is just bug 1727207.
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → DUPLICATE
|
||
Updated•2 years ago
|
Product: Testing → Remote Protocol
|
|
||
Comment 2•2 years ago
|
||
Moving bug to Testing::Marionette Client and Harness component per bug 1815831.
Component: Marionette → Marionette Client and Harness
Product: Remote Protocol → Testing
You need to log in
before you can comment on or make changes to this bug.
Description
•