1457050 - Intermittent TEST-UNEXPECTED-PASS | layout/base/crashtests/453894-1.xhtml | assertion count 1 is less than expected 2 assertions

Status: RESOLVED FIXED

(Core :: Layout, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: philringnalda [at] gmail.com

https://treeherder.mozilla.org/logviewer.html#?job_id=175557748&repo=autoland

https://queue.taskcluster.net/v1/task/fbvcWgY6RHGwPPzfX7yJrg/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/fbvcWgY6RHGwPPzfX7yJrg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

Comment 1

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 2

[Arthur Iakab [arthur_iakab]]

Failed here https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=87d27981670d8f01a9e25548c9cb3d090aa072bf&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-classifiedState=unclassified

Link o the failure log https://treeherder.mozilla.org/logviewer.html#?job_id=180345793&repo=autoland&lineNumber=2307

Part of tht log [task 2018-05-26T01:15:25.673Z] 01:15:25     INFO -  REFTEST TEST-START | http://10.0.2.2:8888/tests/layout/base/crashtests/453894-1.xhtml
[task 2018-05-26T01:15:25.673Z] 01:15:25     INFO -  REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/base/crashtests/453894-1.xhtml | 123 / 356 (34%)
[task 2018-05-26T01:15:36.407Z] 01:15:36     INFO -  REFTEST TEST-PASS | http://10.0.2.2:8888/tests/layout/base/crashtests/453894-1.xhtml | (LOAD ONLY)
[task 2018-05-26T01:15:36.408Z] 01:15:36     INFO -  REFTEST TEST-END | http://10.0.2.2:8888/tests/layout/base/crashtests/453894-1.xhtml
[task 2018-05-26T01:15:36.409Z] 01:15:36     INFO -  REFTEST TEST-UNEXPECTED-PASS | http://10.0.2.2:8888/tests/layout/base/crashtests/453894-1.xhtml | assertion count 1 is less than expected 2 assertions
[task 2018-05-26T01:15:36.410Z] 01:15:36     INFO -  REFTEST TEST-START | http://10.0.2.2:8888/tests/layout/base/crashtests/454751-1.xul
[task 2018-05-26T01:15:36.411Z] 01:15:36     INFO -  REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/base/crashtests/454751-1.xul | 124 / 356 (34%)
[task 2018-05-26T01:15:36.413Z] 01:15:36     INFO -  REFTEST TEST-PASS | http://10.0.2.2:8888/tests/layout/base/crashtests/454751-1.xul | (LOAD ONLY)
[task 2018-05-26T01:15:36.414Z] 01:15:36     INFO -  REFTEST TEST-END | http://10.0.2.2:8888/tests/layout/base/crashtests/454751-1.xul
[task 2018-05-26T01:15:36.415Z] 01:15:36     INFO -  REFTEST TEST-START | http://10.0.2.2:8888/tests/layout/base/crashtests/455063-1.html
[task 2018-05-26T01:15:36.415Z] 01:15:36     INFO -  REFTEST TEST-LOAD | http://10.0.2.2:8888/tests/layout/base/crashtests/455063-1.html | 125 / 356 (35%)
[task 2018-05-26T01:15:47.251Z] 01:15:47     INFO -  REFTEST TEST-PASS | http://10.0.2.2:8888/tests/layout/base/crashtests/455063-1.html | (LOAD ONLY)

Comment 3

[Intermittent Failures Robot]

2 failures in 632 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* android-4-3-armv7-api16: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2018-05-21&endday=2018-05-27&tree=trunk

Comment 4

[Intermittent Failures Robot]

1 failures in 669 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2018-06-04&endday=2018-06-10&tree=trunk

Comment 5

[Intermittent Failures Robot]

2 failures in 718 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 2

Platform breakdown:
* android-em-4-3-armv7-api16: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2018-06-25&endday=2018-07-01&tree=trunk

Comment 6

[Intermittent Failures Robot]

1 failures in 622 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2018-07-02&endday=2018-07-08&tree=trunk

Comment 7

[Intermittent Failures Robot]

1 failures in 623 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2018-07-09&endday=2018-07-15&tree=trunk

Comment 8

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 9

[Natalia Csoregi [:nataliaCs]]

https://treeherder.mozilla.org/logviewer.html#?job_id=193601450&repo=mozilla-inbound&lineNumber=2297

Comment 10

[Intermittent Failures Robot]

1 failures in 2672 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 2568 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 1

Platform breakdown:
* android-em-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2018-08-20&endday=2018-08-26&tree=all

Comment 12

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 13

[Razvan Maries]

New occurrence: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=261531491&repo=mozilla-inbound&lineNumber=8412

Comment 14

[Intermittent Failures Robot]

8 failures in 4839 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 2
• try: 2
• autoland: 4

Platform breakdown:

• android-em-7-0-x86_64: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2019-08-12&endday=2019-08-18&tree=all

Comment 15

[Intermittent Failures Robot]

13 failures in 5073 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 10
• mozilla-central: 3

Platform breakdown:

• android-em-7-0-x86_64: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2019-08-19&endday=2019-08-25&tree=all

Comment 16

[Intermittent Failures Robot]

1 failures in 5047 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2019-08-26&endday=2019-09-01&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 4350 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• android-em-7-0-x86_64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2019-09-16&endday=2019-09-22&tree=all

Comment 18

[Intermittent Failures Robot]

12 failures in 4530 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 12

Platform breakdown:

• android-em-7-0-x86_64: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1457050&startday=2019-09-23&endday=2019-09-29&tree=all

Comment 19

[Geoff Brown [:gbrown]]

All recent unexpected passes are on Android, where 2 assertions are expected; all other platforms expect 1 assertion.

Comment 20

[Geoff Brown [:gbrown]]

Attachment: Bug 1457050 - Allow range of assertions in crashtest 453894-1.xhtml on Android; r=

Avoid intermittent test failures on android.
The existing android assertion count was introduced by bug 1405550, to avoid
assertion count failures with stylo.

Comment 21

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/cc59307314ec
Allow range of assertions in crashtest 453894-1.xhtml on Android; r=m_kato

Comment 22

[Daniel Varga [:dvarga]]

https://hg.mozilla.org/mozilla-central/rev/cc59307314ec