1704242 - Permafailing tier 2 toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be 0px from right side of anchor: -9.050003051757812 should be equal(-ish) to 0

Status: RESOLVED FIXED

(Toolkit :: UI Widgets, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dluca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=336042489&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/H58nTGNTQ-OhXeBTieI9yg/runs/0/artifacts/public/logs/live_backing.log

---

INFO - TEST-START | toolkit/content/tests/widgets/test_popupanchor.xhtml
[task 2021-04-10T01:32:50.443Z] 01:32:50     INFO - TEST-INFO | started process screencapture
[task 2021-04-10T01:32:50.685Z] 01:32:50     INFO - TEST-INFO | screencapture: exit 0
[task 2021-04-10T01:32:50.686Z] 01:32:50     INFO - Buffered messages logged at 01:32:50
[task 2021-04-10T01:32:50.686Z] 01:32:50     INFO - sub-test middle.simpleResizeHorizontal starting
[task 2021-04-10T01:32:50.686Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be on the right of the panel 
[task 2021-04-10T01:32:50.686Z] 01:32:50     INFO - Buffered messages finished
[task 2021-04-10T01:32:50.686Z] 01:32:50     INFO - TEST-UNEXPECTED-FAIL | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be 0px from right side of anchor: -9.050003051757812 should be equal(-ish) to 0 
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - SimpleTest.ok@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:417:16
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - is_close@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:23:5
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - isArrowPositionedOn@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:66:15
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - tests</<@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:148:26
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - onEvent@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:133:7
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - popupshown@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:136:5
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | top of panel should be at bottom of anchor: 122 should be equal(-ish) to 122 
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be on the right of the panel 
[task 2021-04-10T01:32:50.687Z] 01:32:50     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - TEST-UNEXPECTED-FAIL | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be 0px from right side of anchor: -9.050003051757812 should be equal(-ish) to 0 
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - SimpleTest.ok@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:417:16
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - is_close@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:23:5
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - isArrowPositionedOn@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:66:15
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - tests</<@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:151:26
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - onEvent@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:133:7
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - popupshown@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:136:5
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | top of panel should be at bottom of anchor: 122 should be equal(-ish) to 122 
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be on the right of the panel 
[task 2021-04-10T01:32:50.688Z] 01:32:50     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - TEST-UNEXPECTED-FAIL | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be 0px from right side of anchor: -9.050003051757812 should be equal(-ish) to 0 
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - SimpleTest.ok@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:417:16
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - is_close@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:23:5
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - isArrowPositionedOn@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:66:15
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - tests</<@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:153:26
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - onEvent@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:133:7
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - popupshown@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:136:5
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | top of panel should be at bottom of anchor: 122 should be equal(-ish) to 122 
[task 2021-04-10T01:32:50.689Z] 01:32:50     INFO - sub-test middle.simpleResizeVertical starting
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be on the bottom of the panel 
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - TEST-UNEXPECTED-FAIL | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be 0px from bottom side of anchor: -9 should be equal(-ish) to 0 
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - SimpleTest.ok@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:417:16
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - is_close@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:23:5
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - isArrowPositionedOn@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:71:15
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - tests</<@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:160:26
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - onEvent@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:133:7
[task 2021-04-10T01:32:50.690Z] 01:32:50     INFO - imageload@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:139:5
[task 2021-04-10T01:32:50.691Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | right of panel should be left of anchor: 191 should be equal(-ish) to 191.03334045410156 
[task 2021-04-10T01:32:50.691Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be on the bottom of the panel 
[task 2021-04-10T01:32:50.691Z] 01:32:50     INFO - Not taking screenshot here: see the one that was previously logged
[task 2021-04-10T01:32:50.691Z] 01:32:50     INFO - TEST-UNEXPECTED-FAIL | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be 0px from bottom side of anchor: -9 should be equal(-ish) to 0 
[task 2021-04-10T01:32:50.691Z] 01:32:50     INFO - SimpleTest.ok@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:417:16
[task 2021-04-10T01:32:50.691Z] 01:32:50     INFO - is_close@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:23:5
[task 2021-04-10T01:32:50.691Z] 01:32:50     INFO - isArrowPositionedOn@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:71:15
[task 2021-04-10T01:32:50.691Z] 01:32:50     INFO - tests</<@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:163:26
[task 2021-04-10T01:32:50.692Z] 01:32:50     INFO - onEvent@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:133:7
[task 2021-04-10T01:32:50.692Z] 01:32:50     INFO - imageload@chrome://mochitests/content/chrome/toolkit/content/tests/widgets/test_popupanchor.xhtml:139:5
[task 2021-04-10T01:32:50.692Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | right of panel should be left of anchor: 191 should be equal(-ish) to 191.03334045410156 
[task 2021-04-10T01:32:50.692Z] 01:32:50     INFO - TEST-PASS | toolkit/content/tests/widgets/test_popupanchor.xhtml | arrow should be on the bottom of the panel ```

Comment 1

[Natalia Csoregi [:nataliaCs]]

Backfills point to Bug 1695702.

Emma, could you take a look please?
Thank you.

Comment 2

[Intermittent Failures Robot]

23 failures in 191 pushes (0.12 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 16
• mozilla-central: 6
• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 19
  • opt: 11
  • debug: 8
• macosx1015-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-10&endday=2021-04-10&tree=all

Comment 3

[Intermittent Failures Robot]

40 failures in 3854 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

This is the #36 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 26
• mozilla-central: 10
• try: 4

Platform and build breakdown:

• macosx1015-64-qr: 31
  • opt: 16
  • debug: 15
• macosx1015-64-shippable-qr: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-05&endday=2021-04-11&tree=all

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1695702

Comment 5

[Intermittent Failures Robot]

17 failures in 779 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 10
• mozilla-central: 6
• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 13
  • debug: 8
  • opt: 5
• macosx1015-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-12&endday=2021-04-12&tree=all

Comment 6

[Intermittent Failures Robot]

30 failures in 649 pushes (0.046 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 18
• mozilla-central: 8
• try: 4

Platform and build breakdown:

• macosx1015-64-qr: 25
  • debug: 15
  • opt: 10
• macosx1015-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-13&endday=2021-04-13&tree=all

Comment 7

[Emma Malysz]

Attachment: Bug 1704242, fix test_popupanchor.xhtml failures by accounting for new macosx placements

Comment 8

[Intermittent Failures Robot]

28 failures in 1076 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 19
• mozilla-central: 6
• try: 3

Platform and build breakdown:

• macosx1015-64-qr: 24
  • opt: 11
  • debug: 13
• macosx1015-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-14&endday=2021-04-14&tree=all

Comment 9

[Mike Conley (:mconley) (:⚙️)]

Hey emalysz,

Instead of hardcoding this variation in, I wonder if we should try moving those panel rules out of toolkit into browser (see bug 1705539), and that way, the toolkit test doesn't need to be affected by them. What do you think?

Comment 10

[Emma Malysz]

I like that idea. Going to assign myself to bug 1705539, and we can close this bug out once it lands

Comment 11

[Emma Malysz]

Hm, I think we need to still hardcode the variation in because the 9px failures are coming from the switch from -25px to -16px. The toolkit test will still be affected by those rules: https://searchfox.org/mozilla-central/rev/5e70cd673a0ba0ad19b662c1cf656e0823781596/toolkit/themes/osx/global/popup.css#34-37,58-61,82-92

mconley, does that match your understanding?

Comment 12

[Mike Conley (:mconley) (:⚙️)]

That makes sense, but can we move those adjustments into the browser style sheets instead? That way the panels in the test get the "old" behaviour and margin.

Comment 13

[Intermittent Failures Robot]

23 failures in 870 pushes (0.026 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 8
• try: 1

Platform and build breakdown:

• macosx1015-64-qr: 18
  • opt: 7
  • debug: 11
• macosx1015-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-15&endday=2021-04-15&tree=all

Comment 14

[Emma Malysz]

Got it! Wasn't sure if we should apply them to the generic panel rules as well. Went ahead and updated the patch

Comment 15

[Intermittent Failures Robot]

29 failures in 648 pushes (0.045 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 6
• autoland: 19
• try: 4

Platform and build breakdown:

• macosx1015-64-qr: 24
  • debug: 15
  • opt: 9
• macosx1015-64-shippable-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-16&endday=2021-04-16&tree=all

Comment 16

[Atila Butkovits]

Attachment: Bug 1704242 - disable test_popupanchor.xhtml on Mac for frequent failures. r=aryx

Comment 17

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ff81ecac5c24
disable test_popupanchor.xhtml on Mac for frequent failures. r=aryx DONTBUILD

Comment 18

[Intermittent Failures Robot]

25 failures in 149 pushes (0.168 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 20
• mozilla-central: 3
• try: 2

Platform and build breakdown:

• macosx1015-64-qr: 21
  • opt: 17
  • debug: 4
• macosx1015-64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-17&endday=2021-04-17&tree=all

Comment 19

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/ff81ecac5c24

Comment 20

[Intermittent Failures Robot]

154 failures in 4255 pushes (0.036 failures/push) were associated with this bug in the last 7 days.

This is the #6 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 102
• mozilla-central: 37
• try: 15

Platform and build breakdown:

• macosx1015-64-qr: 127
  • debug: 67
  • opt: 60
• macosx1015-64-shippable-qr: 27
  • opt: 27

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1704242&startday=2021-04-12&endday=2021-04-18&tree=all

Comment 21

[Emma Malysz]

Attachment: Bug 1704242, reenable toolkit/content/tests/widgets/test_popupanchor.xhtml on mac

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/25268e7d8fe6
reenable toolkit/content/tests/widgets/test_popupanchor.xhtml on  mac r=aryx

Comment 23

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/25268e7d8fe6

Comment 24

[Emma Malysz]

This can be closed now that bug 1705539 has landed.

Comment 25

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/8a71a0ce5747