1430572 - Intermittent reftest failures due to failure to load/use the expected font [was: Intermittent race between taking the reftest and loading the WOFF]

Status: RESOLVED FIXED

(Core :: Graphics, defect, P3)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

+++ This bug was initially created as a clone of Bug #1396260 +++

https://treeherder.mozilla.org/#/jobs?repo=mozilla-release&revision=4c230b89e05e6a4d87d3f26e2ca862dd59e617d0&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-resultStatus=retry&filter-resultStatus=usercancel&filter-resultStatus=runnable has two 2 reftest failures which looks similar to bug 139620 which got fixed for firefox 57.

See the failures in the reftest analyzer:
https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/eG9n-65xT1uJxy6-lHSIRQ/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1
https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/T17ICTEOTkK_HW_8Qq2V2w/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

Comment 1

[Jonathan Kew [:jfkthame]]

(In reply to Sebastian Hengst [:aryx][:archaeopteryx] (needinfo on intermittent or backout) from comment #0)
> +++ This bug was initially created as a clone of Bug #1396260 +++
> 
> https://treeherder.mozilla.org/#/jobs?repo=mozilla-
> release&revision=4c230b89e05e6a4d87d3f26e2ca862dd59e617d0&filter-
> resultStatus=testfailed&filter-resultStatus=busted&filter-
> resultStatus=exception&filter-resultStatus=retry&filter-
> resultStatus=usercancel&filter-resultStatus=runnable has two 2 reftest
> failures which looks similar to bug 139620 which got fixed for firefox 57.

I think the issue here is that bug 1396260 was not really "fixed" at all; the patch there made us run reftests in more (smaller) chunks on Win7, which substantially reduced the frequency of these failures, but the underlying problem (which looks like some kind of failure in Gfx, perhaps related to resource exhaustion) hasn't changed.

Comment 2

[Jonathan Kew [:jfkthame]]

I currently believe this is a Graphics issue rather than Layout/CSS, fwiw.

Comment 3

[Intermittent Failures Robot]

2 failures in 657 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-release: 2

Platform breakdown:
* windows7-32-nightly: 1
* linux32-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1430572&startday=2018-01-15&endday=2018-01-21&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 735 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* linux64-devedition: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1430572&startday=2018-01-29&endday=2018-02-04&tree=all

Comment 5

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

I am considering removing the "hyper-chunking" solution and pulling the fonts out into their own job- most likely that will fail a lot, but we can move that to tier-2 until the graphics issue is resolved.

Comment 6

[Gregory Szorc [:gps]]

(In reply to Joel Maher ( :jmaher) (UTC-5) from comment #5)
> I am considering removing the "hyper-chunking" solution and pulling the
> fonts out into their own job- most likely that will fail a lot, but we can
> move that to tier-2 until the graphics issue is resolved.

+1

Comment 7

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

it looks like we still have the same volume of font based failures- I want to:
1) shrink back to <=8 chunks of reftests
2) move font reftests to their own job and mark as tier-2 or 3 to remove the failures we are seeing

Comment 8

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

with running tests by manifest as well as reducing the chunks (2 opt/pgo, 4 debug), I consider this bug not useful to keep around.  We still have a lot of font failures on win7 reftests; that rate of failure hasn't changed at all.  If we decide this is still too much to work with, I will create a new bug and move font-face reftests to their own job as tier2 or tier3.

Comment 9

[Intermittent Failures Robot]

8 failures in 660 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 5
* mozilla-inbound: 3

Platform breakdown:
* windows7-32: 7
* android-4-3-armv7-api16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1430572&startday=2018-05-07&endday=2018-05-13&tree=trunk

Comment 10

[Intermittent Failures Robot]

3 failures in 639 pushes (0.005 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* windows7-32: 2
* windows7-32-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1430572&startday=2018-05-14&endday=2018-05-20&tree=trunk

Comment 11

[Intermittent Failures Robot]

13 failures in 655 pushes (0.02 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 13

Platform breakdown:
* windows7-32: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1430572&startday=2018-05-28&endday=2018-06-03&tree=trunk

Comment 12

[Intermittent Failures Robot]

2 failures in 521 pushes (0.004 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* windows7-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1430572&startday=2018-06-18&endday=2018-06-24&tree=trunk