1363896 - Intermittent editor/reftests/input-text-onfocus-reframe.html == editor/reftests/input-text-onfocus-reframe-ref.html | image comparison, max difference: 1, number of differing pixels: 1

Status: RESOLVED FIXED

(Core :: DOM: Editor, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: wkocher [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=98025614&repo=autoland

https://queue.taskcluster.net/v1/task/FO62LUIJT_i8l4Pw5XSv0Q/runs/0/artifacts/public/logs/live_backing.log

https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/FO62LUIJT_i8l4Pw5XSv0Q/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

Comment 1

[Intermittent Failures Robot]

6 failures in 879 pushes (0.007 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 3
* autoland: 2
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 6

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-05-08&endday=2017-05-14&tree=all

Comment 2

[Intermittent Failures Robot]

31 failures in 777 pushes (0.04 failures/push) were associated with this bug in the last 7 days. 

This is the #44 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 15
* mozilla-inbound: 7
* try: 5
* mozilla-central: 2
* graphics: 2

Platform breakdown:
* android-4-3-armv7-api15: 31

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-05-15&endday=2017-05-21&tree=all

Comment 3

[Intermittent Failures Robot]

32 failures in 891 pushes (0.036 failures/push) were associated with this bug in the last 7 days. 

This is the #45 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 15
* mozilla-inbound: 6
* try: 5
* mozilla-central: 5
* graphics: 1

Platform breakdown:
* android-4-3-armv7-api15: 32

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-05-22&endday=2017-05-28&tree=all

Comment 4

[Makoto Kato [:m_kato] (PTO until 5/6)]

We should add fuzzy-if(Android) for workaround.

Comment 5

[Intermittent Failures Robot]

23 failures in 820 pushes (0.028 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 12
* mozilla-inbound: 5
* graphics: 3
* try: 2
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 23

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-05-29&endday=2017-06-04&tree=all

Comment 6

[Intermittent Failures Robot]

20 failures in 864 pushes (0.023 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 8
* autoland: 8
* try: 2
* mozilla-central: 2

Platform breakdown:
* android-4-3-armv7-api15: 20

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-06-05&endday=2017-06-11&tree=all

Comment 7

[Intermittent Failures Robot]

12 failures in 814 pushes (0.015 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 6
* mozilla-inbound: 4
* try: 1
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 12

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-06-12&endday=2017-06-18&tree=all

Comment 8

[Intermittent Failures Robot]

19 failures in 892 pushes (0.021 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 8
* autoland: 6
* try: 2
* mozilla-central: 2
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api15: 19

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-06-19&endday=2017-06-25&tree=all

Comment 9

[Intermittent Failures Robot]

17 failures in 718 pushes (0.024 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 8
* mozilla-inbound: 5
* mozilla-central: 2
* try: 1
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api15: 17

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-06-26&endday=2017-07-02&tree=all

Comment 10

[Intermittent Failures Robot]

10 failures in 656 pushes (0.015 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 5
* autoland: 3
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api15: 10

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 11

[Intermittent Failures Robot]

14 failures in 720 pushes (0.019 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 6
* autoland: 5
* try: 1
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api15: 14

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-07-10&endday=2017-07-16&tree=all

Comment 12

[Intermittent Failures Robot]

15 failures in 822 pushes (0.018 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 6
* autoland: 6
* mozilla-beta: 2
* try: 1

Platform breakdown:
* android-4-3-armv7-api15: 15

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 13

[Intermittent Failures Robot]

9 failures in 1008 pushes (0.009 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 4
* autoland: 3
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api15: 9

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-07-24&endday=2017-07-30&tree=all

Comment 14

[Intermittent Failures Robot]

11 failures in 888 pushes (0.012 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 4
* autoland: 4
* mozilla-release: 1
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* android-4-3-armv7-api15: 11

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-07-31&endday=2017-08-06&tree=all

Comment 15

[Intermittent Failures Robot]

15 failures in 901 pushes (0.017 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 6
* mozilla-inbound: 4
* mozilla-release: 2
* mozilla-beta: 2
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api15: 15

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-08-07&endday=2017-08-13&tree=all

Comment 16

[Intermittent Failures Robot]

18 failures in 949 pushes (0.019 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 9
* autoland: 6
* mozilla-central: 2
* mozilla-release: 1

Platform breakdown:
* android-4-3-armv7-api15: 18

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 17

[Intermittent Failures Robot]

14 failures in 908 pushes (0.015 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 5
* mozilla-inbound: 4
* mozilla-central: 2
* mozilla-beta: 2
* try: 1

Platform breakdown:
* android-4-3-armv7-api15: 14

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-08-21&endday=2017-08-27&tree=all

Comment 18

[Joel Maher ( :jmaher ) (UTC -8)]

this has doubled in frequency, I see 30 failures in the last 7 days:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896

all on android/debug.

:m_kato, I see you are the triage owner for this component- could you help look into this or find the right person to look at this failure?  I don't think we need to fix this asap, but it would be good to put this in a queue for work in the upcoming weeks.

Comment 19

[Makoto Kato [:m_kato] (PTO until 5/6)]

see comment #4 for fix.  I will work this next week.

Comment 20

[Intermittent Failures Robot]

47 failures in 939 pushes (0.05 failures/push) were associated with this bug in the last 7 days. 

This is the #48 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* autoland: 31
* mozilla-inbound: 10
* try: 4
* mozilla-central: 2

Platform breakdown:
* android-4-3-armv7-api-16: 25
* android-4-3-armv7-api16: 17
* android-4-3-armv7-api15: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-08-28&endday=2017-09-03&tree=all

Comment 21

[Makoto Kato [:m_kato] (PTO until 5/6)]

Attachment: Bug 1363896 - Adjust fuzzy-if for Android's reftest.

editor/reftests/input-text-onfocus-reframe-ref.html is sometimes failed due to "image comparison, max difference: 1, number of differing pixels: 1".

As long as I check both images, I don't know why this occurs.  But this is 1 pixel only diff, so we should use fuzz-if.

Review commit: https://reviewboard.mozilla.org/r/175898/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/175898/

Comment 22

[Masayuki Nakano [:masayuki] (he/him)(JST, +0900)(away 4/27 - 5/6)]

Comment on attachment 8904112 [details]
Bug 1363896 - Adjust fuzzy-if for Android's reftest.

https://reviewboard.mozilla.org/r/175898/#review180916

Hmm, I'd like you to include what is the difference in the commit message, though. (e.g., caret height, focus ring, etc.)

Comment 23

[Makoto Kato [:m_kato] (PTO until 5/6)]

Comment on attachment 8904112 [details]
Bug 1363896 - Adjust fuzzy-if for Android's reftest.

Review request updated; see interdiff: https://reviewboard.mozilla.org/r/175898/diff/1-2/

Comment 24

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b0599327dfdd
Adjust fuzzy-if for Android's reftest. r=masayuki

Comment 25

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/b0599327dfdd

Comment 26

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/8bdd1bbd948f

Comment 27

[Intermittent Failures Robot]

5 failures in 924 pushes (0.005 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 4
* mozilla-central: 1

Platform breakdown:
* android-4-3-armv7-api16: 5

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1363896&startday=2017-09-04&endday=2017-09-10&tree=all