1452308 - Perma tier2 TVw /css/css-shapes/shape-outside/shape-box/shape-outside-box-009.html | Testing http://web-platform.test:8000/css/css-shapes/shape-outside/shape-box/shape-outside-box-009.html

Status: RESOLVED INVALID

(Core :: Graphics, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ebalazs [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=172407696&repo=autoland

https://queue.taskcluster.net/v1/task/Pr07NfH5TZuCq_Y9j43n1Q/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

18 failures in 51 pushes (0.353 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-central: 10
* mozilla-inbound: 8

Platform breakdown:
* windows7-32: 6
* windows10-64: 6
* osx-10-10: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1452308&startday=2018-04-07&endday=2018-04-07&tree=trunk

Comment 2

[Intermittent Failures Robot]

46 failures in 765 pushes (0.06 failures/push) were associated with this bug in the last 7 days. 

This is the #41 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 26
* mozilla-central: 10
* autoland: 10

Platform breakdown:
* windows10-64: 27
* windows7-32: 9
* osx-10-10: 8
* windows2012-32: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1452308&startday=2018-04-02&endday=2018-04-08&tree=trunk

Comment 3

[Tiberius Oros[:tiberius_oros]]

There have been 46 failures in the last 7 days. This was filed 4 days ago.

Failures per affected platforms and build types:
	windows2012-32 / debug: 2
	OS X 10.10 / opt & debug: 8
	Windows 7 / opt, debug & pgo: 9 
	windows10-64 / opt, debug & pgo: 27

Recent log with failure:
https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=172556609&lineNumber=1375

Summary: Perma tier2 TVw /css/css-shapes/shape-outside/shape-box/shape-outside-box-009.html | Testing http://web-platform.test:8000/css/css-shapes/shape-outside/shape-box/shape-outside-box-009.html

On April 8th this seemed to stop failing.

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

if TVw failed, this indicates it is a newer test that isn't passing our stability tests

Comment 5

[Andrew Osmond [:aosmond] (he/him)]

The test was added by bug 1328236, landed last week. Revision windows from the failure being introduced to it going away:

https://treeherder.mozilla.org/#/jobs?repo=autoland&filter-searchStr=tvw&fromchange=b5bc270f3795&tochange=12a824f8d55a
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&filter-searchStr=TVw&fromchange=a44f62799a10&tochange=ea3453cc7d92
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&filter-searchStr=tvw&tochange=ee6283795f41&fromchange=0e0ec6c01e25

Given there is no overlap between the changesets and all of the trees, I am not sure what to make of it getting fixed.

Comment 6

[Brad Werth [:bradwerth]]

See https://bugzilla.mozilla.org/show_bug.cgi?id=1328236#c17

WPT reftests are disabled on macOS because the Ahem font is not loaded by the test harness. The TVw test runs these tests unconditionally -- they aren't run as part of the regular Wr job(s) on macOS.

Comment 7

[Andrew Osmond [:aosmond] (he/him)]

(In reply to Brad Werth [:bradwerth] from comment #6)
> See https://bugzilla.mozilla.org/show_bug.cgi?id=1328236#c17
> 
> WPT reftests are disabled on macOS because the Ahem font is not loaded by
> the test harness. The TVw test runs these tests unconditionally -- they
> aren't run as part of the regular Wr job(s) on macOS.

Ah, and from the logs, it looks like they aren't running on Windows either. That explains it, thanks!