1681113 - Intermittent mozilla/tests/webdriver/take_full_screenshot/iframe.py | test_source_origin[same_origin] - assert (1280, 966) == (800, 526)

Status: RESOLVED INCOMPLETE

(Remote Protocol :: Marionette, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=323793254&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/S2nLn_b3QJmuMdPq98UasA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2020-12-07T16:41:38.705Z] 16:41:38     INFO - PID 18456 | 1607359298702	Marionette	DEBUG	0 <- [1,41,null,{"x":100,"y":100,"width":800,"height":600}]
[task 2020-12-07T16:41:38.705Z] 16:41:38     INFO - PID 18456 | 1607359298702	webdriver::server	DEBUG	<- 200 OK {"value":{"x":100,"y":100,"width":800,"height":600}}
[task 2020-12-07T16:41:38.708Z] 16:41:38     INFO - PID 18456 | 1607359298704	webdriver::server	DEBUG	-> POST /session/db7247d0-a49a-414e-a505-1dd347aca4d3/frame {"id": null}
[task 2020-12-07T16:41:38.708Z] 16:41:38     INFO - PID 18456 | 1607359298705	Marionette	DEBUG	0 -> [0,42,"WebDriver:SwitchToFrame",{"id":null}]
[task 2020-12-07T16:41:38.710Z] 16:41:38     INFO - PID 18456 | 1607359298706	Marionette	DEBUG	0 <- [1,42,null,{"value":null}]
[task 2020-12-07T16:41:38.710Z] 16:41:38     INFO - PID 18456 | 1607359298706	webdriver::server	DEBUG	<- 200 OK {"value":null}
[task 2020-12-07T16:41:38.711Z] 16:41:38     INFO - STDOUT: =================================== FAILURES ===================================
[task 2020-12-07T16:41:38.711Z] 16:41:38     INFO - STDOUT: _______________________ test_source_origin[same_origin] ________________________
[task 2020-12-07T16:41:38.713Z] 16:41:38     INFO - STDOUT: session = <Session db7247d0-a49a-414e-a505-1dd347aca4d3>
[task 2020-12-07T16:41:38.713Z] 16:41:38     INFO - STDOUT: url = <function url at 0x7fac666c1cd0>, domain = ''
[task 2020-12-07T16:41:38.717Z] 16:41:38     INFO - STDOUT:     @pytest.mark.parametrize("domain", ["", "alt"], ids=["same_origin", "cross_origin"])
[task 2020-12-07T16:41:38.717Z] 16:41:38     INFO - STDOUT:     def test_source_origin(session, url, domain):
[task 2020-12-07T16:41:38.717Z] 16:41:38     INFO - STDOUT:         session.url = inline("""{0}{1}""".format(DEFAULT_CSS_STYLE, DEFAULT_CONTENT))
[task 2020-12-07T16:41:38.717Z] 16:41:38     INFO - STDOUT:     
[task 2020-12-07T16:41:38.717Z] 16:41:38     INFO - STDOUT:         response = take_full_screenshot(session)
[task 2020-12-07T16:41:38.717Z] 16:41:38     INFO - STDOUT:         reference_screenshot = assert_success(response)
[task 2020-12-07T16:41:38.717Z] 16:41:38     INFO - STDOUT: >       assert png_dimensions(reference_screenshot) == document_dimensions(session)
[task 2020-12-07T16:41:38.717Z] 16:41:38     INFO - STDOUT: E       assert (1280, 966) == (800, 526)
[task 2020-12-07T16:41:38.718Z] 16:41:38     INFO - STDOUT: E         At index 0 diff: 1280 != 800
[task 2020-12-07T16:41:38.718Z] 16:41:38     INFO - STDOUT: E         Full diff:
[task 2020-12-07T16:41:38.718Z] 16:41:38     INFO - STDOUT: E         - (1280, 966)
[task 2020-12-07T16:41:38.718Z] 16:41:38     INFO - STDOUT: E         + (800, 526)
[task 2020-12-07T16:41:38.718Z] 16:41:38     INFO - STDOUT: domain     = ''
[task 2020-12-07T16:41:38.719Z] 16:41:38     INFO - STDOUT: reference_screenshot =
[task 2020-12-07T16:41:38.720Z] 16:41:38     INFO - STDOUT: response   = <Responsetatus=200 body={"value": "
[task 2020-12-07T16:41:38.720Z] 16:41:38     INFO - STDOUT: session    = <Session db7247d0-a49a-414e-a505-1dd347aca4d3>
[task 2020-12-07T16:41:38.721Z] 16:41:38     INFO - STDOUT: url        = <function url at 0x7fac666c1cd0>
[task 2020-12-07T16:41:38.721Z] 16:41:38     INFO - STDOUT: tests/web-platform/mozilla/tests/webdriver/take_full_screenshot/iframe.py
[task 2020-12-07T16:41:38.722Z] 16:41:38     INFO - STDOUT: :39: AssertionError
[task 2020-12-07T16:41:38.722Z] 16:41:38     INFO - STDOUT: ====================== 1 failed, 1 passed in 3.21 seconds ======================
[task 2020-12-07T16:41:38.742Z] 16:41:38     INFO - 
[task 2020-12-07T16:41:38.742Z] 16:41:38     INFO - TEST-UNEXPECTED-FAIL | /_mozilla/webdriver/take_full_screenshot/iframe.py | test_source_origin[same_origin] - assert (1280, 966) == (800, 526)
[task 2020-12-07T16:41:38.743Z] 16:41:38     INFO - session = <Session db7247d0-a49a-414e-a505-1dd347aca4d3>
[task 2020-12-07T16:41:38.743Z] 16:41:38     INFO - url = <function url at 0x7fac666c1cd0>, domain = ''
[task 2020-12-07T16:41:38.743Z] 16:41:38     INFO - 
[task 2020-12-07T16:41:38.743Z] 16:41:38     INFO -     @pytest.mark.parametrize("domain", ["", "alt"], ids=["same_origin", "cross_origin"])
[task 2020-12-07T16:41:38.743Z] 16:41:38     INFO -     def test_source_origin(session, url, domain):
[task 2020-12-07T16:41:38.743Z] 16:41:38     INFO -         session.url = inline("""{0}{1}""".format(DEFAULT_CSS_STYLE, DEFAULT_CONTENT))
[task 2020-12-07T16:41:38.743Z] 16:41:38     INFO -     
[task 2020-12-07T16:41:38.743Z] 16:41:38     INFO -         response = take_full_screenshot(session)
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO -         reference_screenshot = assert_success(response)
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - >       assert png_dimensions(reference_screenshot) == document_dimensions(session)
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - E       assert (1280, 966) == (800, 526)
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - E         At index 0 diff: 1280 != 800
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - E         Full diff:
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - E         - (1280, 966)
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - E         + (800, 526)
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - 
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - domain     = ''
[task 2020-12-07T16:41:38.744Z] 16:41:38     INFO - reference_screenshot = 'iVBORw0KGgoAAAANSUhEUgAABQAAAAPGCAYAAAC8hTdkAAAgAElEQVR4nOzc0W4iSxIEUP//T+8+rXeYS5ENmIrrinMkHqZpmsaklBGWPF//AQAA2OQLA...AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAALgF5nE6xxfIOv8AAAAASUVORK5CYII='
[task 2020-12-07T16:41:38.745Z] 16:41:38     INFO - response   = <Responsetatus=200 body={"value": "iVBORw0KGgoAAAANSUhEUgAABQAAAAPGCAYAAAC8hTd...AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAALgF5nE6xxfIOv8AAAAASUVORK5CYII="}>
[task 2020-12-07T16:41:38.745Z] 16:41:38     INFO - session    = <Session db7247d0-a49a-414e-a505-1dd347aca4d3>
[task 2020-12-07T16:41:38.745Z] 16:41:38     INFO - url        = <function url at 0x7fac666c1cd0>
[task 2020-12-07T16:41:38.745Z] 16:41:38     INFO - 
[task 2020-12-07T16:41:38.745Z] 16:41:38     INFO - tests/web-platform/mozilla/tests/webdriver/take_full_screenshot/iframe.py:39: AssertionError
[task 2020-12-07T16:41:38.745Z] 16:41:38     INFO - .
[task 2020-12-07T16:41:38.745Z] 16:41:38     INFO - TEST-OK | /_mozilla/webdriver/take_full_screenshot/iframe.py | took 3456ms
[task 2020-12-07T16:41:38.802Z] 16:41:38     INFO - Closing logging queue
[task 2020-12-07T16:41:38.802Z] 16:41:38     INFO - queue closed
[task 2020-12-07T16:41:38.804Z] 16:41:38     INFO - Starting runner
[task 2020-12-07T16:41:38.820Z] 16:41:38     INFO - PID 18770 | 1607359298816	geckodriver	INFO	Listening on 127.0.0.1:43291
[task 2020-12-07T16:41:38.820Z] 16:41:38     INFO - WebDriver HTTP server listening at http://127.0.0.1:43291/
[task 2020-12-07T16:41:38.821Z] 16:41:38     INFO - TEST-START | /_mozilla/webdriver/take_full_screenshot/screenshot.py```

Comment 1

[Intermittent Failures Robot]

5 failures in 4060 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 1

Platform breakdown:

• linux1804-64-shippable-qr: 1
• linux1804-64: 2
• linux1804-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1681113&startday=2020-12-07&endday=2020-12-13&tree=all

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Parts of the taken screenshot are grey. Similar to what I noticed on bug 1681090. So the grey part might not be part of the screenshot at all.

Comment 3

[Intermittent Failures Robot]

6 failures in 3421 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1

Platform breakdown:

• linux1804-64-qr: 4
• linux1804-64-asan: 1
• linux1804-64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1681113&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 4

[Intermittent Failures Robot]

3 failures in 1450 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• linux1804-64: 1
• linux1804-64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1681113&startday=2020-12-21&endday=2020-12-27&tree=all

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 6

[BMO Automation]

Moving bug to Remote Protocol::Marionette component per bug 1815831.