1472363 - Intermittent testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_allow_a_user_to_switch_from_an_iframe_back_to_the_main_content_of_the_page | AssertionError: u'' != 'This is the heading'

Status: RESOLVED INCOMPLETE

(Testing :: Marionette Client and Harness, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dluca [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=185626571&repo=autoland

https://queue.taskcluster.net/v1/task/UA0JEmiNRoiJY_a0wbMipQ/runs/0/artifacts/public/logs/live_backing.log

TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_allow_a_user_to_switch_from_an_iframe_back_to_the_main_content_of_the_page
[task 2018-06-29T18:12:51.936Z]  WARNING -  TEST-UNEXPECTED-FAIL | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_allow_a_user_to_switch_from_an_iframe_back_to_the_main_content_of_the_page | AssertionError: u'' != 'This is the heading'
[task 2018-06-29T18:12:51.937Z]     INFO -  Traceback (most recent call last):
[task 2018-06-29T18:12:51.938Z]     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_harness/marionette_test/testcases.py", line 159, in run
[task 2018-06-29T18:12:51.938Z]     INFO -      testMethod()
[task 2018-06-29T18:12:51.939Z]     INFO -    File "/builds/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py", line 104, in test_should_allow_a_user_to_switch_from_an_iframe_back_to_the_main_content_of_the_page
[task 2018-06-29T18:12:51.939Z]     INFO -      self.assertEqual(header.text, "This is the heading")
[task 2018-06-29T18:12:51.939Z]     INFO -  TEST-INFO took 7364ms
[task 2018-06-29T18:12:52.197Z]     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_be_able_to_carry_on_working_if_the_frame_is_deleted_from_under_us
[task 2018-06-29T18:13:00.094Z]  WARNING -  TEST-UNEXPECTED-FAIL | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_be_able_to_carry_on_working_if_the_frame_is_deleted_from_under_us | AssertionError: 0 != 1
[task 2018-06-29T18:13:00.094Z]     INFO -  Traceback (most recent call last):
[task 2018-06-29T18:13:00.094Z]     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_harness/marionette_test/testcases.py", line 159, in run
[task 2018-06-29T18:13:00.095Z]     INFO -      testMethod()
[task 2018-06-29T18:13:00.096Z]     INFO -    File "/builds/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py", line 88, in test_should_be_able_to_carry_on_working_if_the_frame_is_deleted_from_under_us
[task 2018-06-29T18:13:00.096Z]     INFO -      self.assertEqual(0, len(self.marionette.find_elements(By.ID, "iframe1")))
[task 2018-06-29T18:13:00.096Z]     INFO -  TEST-INFO took 7897ms

Comment 1

[Intermittent Failures Robot]

1 failures in 718 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1472363&startday=2018-06-25&endday=2018-07-01&tree=trunk

Comment 2

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 3

[Cristian Brindusan [:cbrindusan]]

Recent log failure:
https://treeherder.mozilla.org/logviewer.html#?job_id=206624742&repo=autoland&lineNumber=1552

Comment 4

[Intermittent Failures Robot]

1 failures in 2759 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1472363&startday=2018-10-15&endday=2018-10-21&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 2584 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1472363&startday=2018-10-22&endday=2018-10-28&tree=all

Comment 6

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 7

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 8

[Andreea Pavel [:apavel]]

Central as Beta simulation 
Recent failure log:

https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=215423732&repo=try&lineNumber=1545

[task 2018-12-04T16:44:54.814Z] 16:44:54     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_allow_a_user_to_switch_from_an_iframe_back_to_the_main_content_of_the_page
[task 2018-12-04T16:45:00.277Z] 16:45:00  WARNING -  TEST-UNEXPECTED-FAIL | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_allow_a_user_to_switch_from_an_iframe_back_to_the_main_content_of_the_page | AssertionError: u'' != 'This is the heading'
[task 2018-12-04T16:45:00.278Z] 16:45:00     INFO -  Traceback (most recent call last):
[task 2018-12-04T16:45:00.278Z] 16:45:00     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_harness/marionette_test/testcases.py", line 159, in run
[task 2018-12-04T16:45:00.278Z] 16:45:00     INFO -      testMethod()
[task 2018-12-04T16:45:00.278Z] 16:45:00     INFO -    File "/builds/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py", line 104, in test_should_allow_a_user_to_switch_from_an_iframe_back_to_the_main_content_of_the_page
[task 2018-12-04T16:45:00.279Z] 16:45:00     INFO -      self.assertEqual(header.text, "This is the heading")
[task 2018-12-04T16:45:00.280Z] 16:45:00     INFO -  TEST-INFO took 5462ms
[task 2018-12-04T16:45:00.546Z] 16:45:00     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_be_able_to_carry_on_working_if_the_frame_is_deleted_from_under_us
[task 2018-12-04T16:45:06.676Z] 16:45:06  WARNING -  TEST-UNEXPECTED-FAIL | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_be_able_to_carry_on_working_if_the_frame_is_deleted_from_under_us | AssertionError: 0 != 1
[task 2018-12-04T16:45:06.676Z] 16:45:06     INFO -  Traceback (most recent call last):
[task 2018-12-04T16:45:06.676Z] 16:45:06     INFO -    File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/marionette_harness/marionette_test/testcases.py", line 159, in run
[task 2018-12-04T16:45:06.677Z] 16:45:06     INFO -      testMethod()
[task 2018-12-04T16:45:06.677Z] 16:45:06     INFO -    File "/builds/worker/workspace/build/tests/marionette/tests/testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py", line 88, in test_should_be_able_to_carry_on_working_if_the_frame_is_deleted_from_under_us
[task 2018-12-04T16:45:06.678Z] 16:45:06     INFO -      self.assertEqual(0, len(self.marionette.find_elements(By.ID, "iframe1")))
[task 2018-12-04T16:45:06.678Z] 16:45:06     INFO -  TEST-INFO took 6130ms
[task 2018-12-04T16:45:07.081Z] 16:45:07     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_be_able_to_switch_to_a_frame_by_its_index
[task 2018-12-04T16:45:20.484Z] 16:45:20     INFO -  TEST-PASS | testing/marionette/harness/marionette_harness/tests/unit/test_switch_frame.py TestSwitchFrame.test_should_be_able_to_switch_to_a_frame_by_its_index | took 13403ms

Comment 9

[Intermittent Failures Robot]

1 failures in 1862 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1472363&startday=2018-12-03&endday=2018-12-09&tree=all

Comment 10

[Intermittent Failures Robot]

1 failures in 1008 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* try: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1472363&startday=2018-12-24&endday=2018-12-30&tree=all

Comment 11

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 12

[BMO Automation]

Moving bug to Testing::Marionette Client and Harness component per bug 1815831.