Intermittent webkit-text-fill-color-property-003.html | /compat/webkit-text-fill-color-property-003.html 798b8ed19e9fc078bba7ee8baf13f181c59ee8a0

RESOLVED WORKSFORME

Status

RESOLVED WORKSFORME
2 years ago
6 months ago

People

(Reporter: KWierso, Unassigned)

Tracking

({intermittent-failure})

unspecified
intermittent-failure
Points:
---

Firefox Tracking Flags

(firefox48 affected, firefox49 affected)

Details

5 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 2
* autoland: 2
* fx-team: 1

Platform breakdown:
* linux64: 4
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-06-27&endday=2016-07-03&tree=all
5 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 2
* fx-team: 2
* mozilla-central: 1

Platform breakdown:
* linux32: 4
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-07-04&endday=2016-07-10&tree=all
11 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 4
* fx-team: 3
* try: 2
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* linux64: 6
* linux32: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-07-18&endday=2016-07-24&tree=all
22 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 8
* fx-team: 7
* mozilla-inbound: 6
* mozilla-central: 1

Platform breakdown:
* linux32: 12
* linux64: 10

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-07-25&endday=2016-07-31&tree=all
27 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 10
* mozilla-inbound: 9
* fx-team: 4
* mozilla-beta: 2
* mozilla-central: 1
* mozilla-aurora: 1

Platform breakdown:
* linux64: 18
* linux32: 8
* windows8-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-08-01&endday=2016-08-07&tree=all
20 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 9
* mozilla-inbound: 6
* fx-team: 4
* mozilla-central: 1

Platform breakdown:
* linux32: 12
* linux64: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-08-08&endday=2016-08-14&tree=all
14 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 5
* fx-team: 5
* autoland: 4

Platform breakdown:
* linux32: 10
* linux64: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-08-15&endday=2016-08-21&tree=all
42 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 17
* autoland: 17
* fx-team: 3
* try: 2
* mozilla-central: 2
* mozilla-aurora: 1

Platform breakdown:
* linux64: 31
* linux32: 11

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-08-22&endday=2016-08-28&tree=all
53 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 18
* autoland: 14
* fx-team: 9
* mozilla-central: 8
* mozilla-aurora: 2
* try: 1
* mozilla-beta: 1

Platform breakdown:
* linux64: 34
* linux32: 18
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-08-29&endday=2016-09-04&tree=all
41 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 18
* mozilla-inbound: 13
* mozilla-central: 4
* mozilla-aurora: 2
* fx-team: 2
* try: 1
* mozilla-release: 1

Platform breakdown:
* linux64: 32
* linux32: 8
* android-4-3-armv7-api15: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-09-05&endday=2016-09-11&tree=all
50 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 21
* autoland: 14
* mozilla-central: 7
* fx-team: 7
* mozilla-beta: 1

Platform breakdown:
* linux64: 40
* linux32: 10

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-09-12&endday=2016-09-18&tree=all
Jeremy, this is somewhat high on the Orange Factor list. Can you please take a look?
Flags: needinfo?(jeremychen)
(In reply to Andrew Overholt [:overholt] from comment #12)
> Jeremy, this is somewhat high on the Orange Factor list. Can you please take
> a look?

Sure. I took a look and found that this is likely a focus problem from reftest framework. (See bug 1292460 comment 17)

I suspect this a scenario that the test file is finishing loading while the framework (xul parts) is not. Therefore, the focus is changed to xul instead of the test file. However, on linux, the color of selected texts could be different between w/ and w/o focus. So, we would see texts within an unfocused color in the failed tests. Taking try runs to prove my assumptions.
Flags: needinfo?(jeremychen)
Second thoughts, this may not be chunk related since some of the failures are not in the first of a chunk. Still figuring out why the focus is been changed before taking a screenshot.
Here's a brief about my investigation:

From the test failures, it is very likely caused through following steps:
1. load test page and execute the script to select texts
2. somehow something (maybe relates to reftest framework or testing build bot environment) causes a focus change so the color of selected texts become another color which presents for selected texts w/o focus. so, an unexpected reftest screenshot is taken.

As comment 14 said, this is not chunk related. Some failures happen even though they are not the first test right after the testing browser restarted.

So, I add debugging focus-logs to see if there's any clue. However, focus-logs looks exact the same from failed tests to success tests. (https://treeherder.mozilla.org/#/jobs?repo=try&revision=e7855f3b89ff)

To ensure that a reftest screenshot is taken on test page while focus on it, I do have a patch which extends the waiting time for test page to take a reftest screenshot. This seems eliminate the symptom from 1~2 out of 20 (https://treeherder.mozilla.org/#/jobs?repo=try&revision=0a43d502f77c&filter-searchStr=Linux%20opt%20W3C%20Web%20Platform%20Reftests%20(Wr))to 0 out of 20 ( https://treeherder.mozilla.org/#/jobs?repo=try&revision=dcae8b31c79f)

But, I doubt if this is something worth to do for three reasons: 1) extending waiting time may not be reliable enough; 2) adding additional codes confuses developers to read/maintain the test; 3) the cost (TC/buildbot resource usage) is definitely increased.

There're still some mysteries need to be dug, e.g., why this only happens on linux platform? However, to do that, I might need to take much more time (probably less time for a reftest framework expert!?) to study reftest framework, and to tell the difference of environments between running tests on linux platform machines and those on other platform machines.

From what I can tell, the feature functions finely, the tests seems fine as well. Maybe we should just keep tracking this instead of working around it for now?
Flags: needinfo?(overholt)
46 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 17
* autoland: 17
* fx-team: 5
* mozilla-beta: 3
* mozilla-central: 2
* mozilla-aurora: 2

Platform breakdown:
* linux64: 28
* linux32: 18

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-09-19&endday=2016-09-25&tree=all
Thanks for the analysis, Jeremy! I'm not sure what's best in this case but Ryan probably has thoughts.
As to reftest issues, Ted can probably help.
Flags: needinfo?(ted)
Flags: needinfo?(ryanvm)
Flags: needinfo?(overholt)
Linux focus issues are usually the domain of Neil, but he's on PTO until next week. This is the web-platform-test harness, not our regular reftest harness, so you might want to ping James first. But I suspect he'll end up deferring to Neil, so I don't know.
Flags: needinfo?(ted)
Flags: needinfo?(ryanvm)
Flags: needinfo?(james)
Yeah, I think Ryan is right that I don't know off the top of my head. It is possible that the wpt harness needs to be more aggressive about ensuring the window is focused when a screenshot is taken. I can check what the other reftest harness does ofc.
Flags: needinfo?(james) → needinfo?(enndeakin)
Unfortunately I don't know much about the wpt harness. Hopefully Enn can help you!
43 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 17
* mozilla-inbound: 15
* fx-team: 7
* try: 2
* mozilla-central: 2

Platform breakdown:
* linux64: 26
* linux32: 17

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-09-26&endday=2016-10-02&tree=all
48 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 17
* autoland: 13
* fx-team: 7
* mozilla-central: 5
* mozilla-aurora: 4
* mozilla-beta: 2

Platform breakdown:
* linux64: 27
* linux32: 21

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-10-03&endday=2016-10-09&tree=all
60 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 26
* autoland: 20
* mozilla-central: 7
* mozilla-aurora: 3
* fx-team: 2
* try: 1
* mozilla-beta: 1

Platform breakdown:
* linux64: 37
* linux32: 23

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-10-10&endday=2016-10-16&tree=all
19 automation job failures were associated with this bug yesterday.

Repository breakdown:
* autoland: 8
* mozilla-inbound: 5
* fx-team: 3
* mozilla-aurora: 2
* mozilla-central: 1

Platform breakdown:
* linux64: 15
* linux32: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-10-20&endday=2016-10-20&tree=all
62 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 23
* mozilla-inbound: 14
* mozilla-aurora: 8
* fx-team: 7
* mozilla-central: 6
* try: 4

Platform breakdown:
* linux64: 46
* linux32: 16

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-10-17&endday=2016-10-23&tree=all
23 automation job failures were associated with this bug yesterday.

Repository breakdown:
* mozilla-inbound: 14
* autoland: 6
* mozilla-central: 1
* mozilla-aurora: 1
* fx-team: 1

Platform breakdown:
* linux64: 15
* linux32: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-10-27&endday=2016-10-27&tree=all
72 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 25
* autoland: 21
* mozilla-central: 15
* mozilla-aurora: 5
* try: 3
* fx-team: 3

Platform breakdown:
* linux64: 43
* linux32: 29

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-10-24&endday=2016-10-30&tree=all
18 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 6
* mozilla-inbound: 5
* autoland: 5
* try: 1
* mozilla-release: 1

Platform breakdown:
* linux64: 9
* linux32: 9

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-10-31&endday=2016-11-06&tree=all
15 automation job failures were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 9
* autoland: 4
* try: 1
* mozilla-central: 1

Platform breakdown:
* linux64: 10
* linux32: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-11-07&endday=2016-11-13&tree=all
12 failures in 715 pushes (0.017 failures/push) were associated with this bug in the last 7 days.  

Repository breakdown:
* mozilla-inbound: 6
* autoland: 4
* mozilla-aurora: 2

Platform breakdown:
* linux32: 7
* linux64: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1267486&startday=2016-11-14&endday=2016-11-20&tree=all

Comment 31

2 years ago
It looks like this doesn't happen anymore.
Flags: needinfo?(enndeakin)
Status: NEW → RESOLVED
Last Resolved: 6 months ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.