1543933 - Intermittent [DON'T USE FOR CLASSIFICATION] PERFHERDER_DATA was seen 0 times, expected 1.

Status: RESOLVED INCOMPLETE

(Testing :: Raptor, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: mbrodesser [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=239861796&repo=try

https://queue.taskcluster.net/v1/task/EThX0MZKT0yHJxCrH8_kMg/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

7 failures in 3025 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• mozilla-beta: 1
• mozilla-central: 3

Platform breakdown:

• linux64: 3
• macosx64-nightly: 1
• windows7-32-shippable: 1
• windows10-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-08&endday=2019-04-14&tree=all

Comment 2

[Intermittent Failures Robot]

29 failures in 2673 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 13
• autoland: 14
• try: 1
• mozilla-inbound: 1

Platform breakdown:

• osx-10-10-shippable: 2
• linux64-shippable-qr: 2
• android-hw-p2-8-0-android-aarch64: 10
• android-hw-p2-8-0-arm7-api-16: 6
• windows10-64-shippable: 2
• android-hw-g5-7-0-arm7-api-16: 6
• linux64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 3

[Intermittent Failures Robot]

42 failures in 307 pushes (0.137 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 8
• try: 33
• autoland: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 11
• android-hw-g5-7-0-arm7-api-16: 11
• lint: 1
• android-hw-p2-8-0-arm7-api-16: 9
• android-hw-p2-8-0-arm7-api-16-nightly: 8
• linux64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-22&endday=2019-04-22&tree=all

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+2]]

There is a timeout similar to bug 1506936:

08:00:00 INFO - raptor-control-server received webext_status: test tab updated 2
08:14:59 INFO - 127.0.0.1 - - [12/Apr/2019 08:14:59] "POST / HTTP/1.1" 200 -
08:14:59 INFO - raptor-control-server received webext_raptor-page-timeout: [u'raptor-unity-webgl-firefox', u'http://127.0.0.1:51456/unity-webgl/index.html?raptor']

Also here a screenshot of Firefox would be great.

Comment 5

[Intermittent Failures Robot]

30 failures in 577 pushes (0.052 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 1
• autoland: 5
• mozilla-central: 23
• try: 1

Platform breakdown:

• linux64-shippable-qr: 2
• osx-10-10-shippable: 4
• windows7-32-shippable: 4
• linux64-shippable: 7
• windows10-64-shippable: 4
• android-hw-g5-7-0-arm7-api-16: 3
• windows10-64-ux: 2
• android-hw-p2-8-0-android-aarch64: 2
• android-hw-p2-8-0-arm7-api-16: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-25&endday=2019-04-25&tree=all

Comment 6

[Intermittent Failures Robot]

17 failures in 763 pushes (0.022 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 14
• autoland: 3

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 2
• osx-10-10-shippable: 3
• linux64-shippable: 2
• windows7-32-shippable: 2
• windows10-64-shippable: 2
• windows10-64-ux: 3
• android-hw-g5-7-0-arm7-api-16: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-26&endday=2019-04-26&tree=all

Comment 7

[Intermittent Failures Robot]

25 failures in 224 pushes (0.112 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 3
• mozilla-central: 22

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 1
• linux64: 1
• osx-10-10-shippable: 21
• linux64-shippable-qr: 1
• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-27&endday=2019-04-27&tree=all

Comment 8

[Intermittent Failures Robot]

188 failures in 3031 pushes (0.062 failures/push) were associated with this bug in the last 7 days.

This is the #10 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 135
• try: 34
• autoland: 16
• mozilla-inbound: 3

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 22
• android-hw-g5-7-0-arm7-api-16: 17
• lint: 1
• android-hw-p2-8-0-arm7-api-16: 15
• android-hw-p2-8-0-arm7-api-16-nightly: 8
• linux64-shippable-qr: 5
• linux64-shippable: 11
• osx-10-10-shippable: 84
• windows7-32-shippable: 8
• windows10-64-shippable: 8
• windows10-64-ux: 8
• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 9

[Intermittent Failures Robot]

28 failures in 741 pushes (0.038 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 25
• try: 1
• autoland: 1
• mozilla-inbound: 1

Platform breakdown:

• osx-10-10-shippable: 22
• android-hw-p2-8-0-android-aarch64: 2
• windows10-64-ux: 3
• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-29&endday=2019-04-29&tree=all

Comment 10

[Daniel Varga [:dvarga]]

In the last 7 days this has 172 failures

https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-04-24&endday=2019-05-01&tree=all&bug=1543933

Comment 11

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Note that the failure count dropped a lot within the last 2 days. Most likely because bug 1548008 got fixed.

Comment 12

[Intermittent Failures Robot]

50 failures in 4131 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

This is the #49 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 35
• try: 1
• autoland: 10
• mozilla-inbound: 4

Platform breakdown:

• osx-10-10-shippable: 25
• android-hw-p2-8-0-android-aarch64: 5
• windows10-64-ux: 6
• android-hw-g5-7-0-arm7-api-16: 7
• windows7-32: 1
• linux64-qr: 1
• linux64-shippable: 2
• linux64-shippable-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 13

[Andreea Pavel [:apavel]]

Failure rate decreased, however in the last 7 days there are 49 total failures on

*pgo: android-hw-g5-7-0-arm7-api-16
*opt: linux64-shippable, linux64-qr, osx-10-10-shippable and windows10-64-ux

Looked through several of these and most of them are misclassifications.

Comment 14

[Intermittent Failures Robot]

15 failures in 777 pushes (0.019 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 9
• mozilla-inbound: 2
• autoland: 4

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 6
• android-hw-p2-8-0-android-aarch64: 2
• windows10-64-ux: 2
• android-hw-p2-8-0-arm7-api-16: 1
• android-em-7-0-x86: 1
• linux64-shippable-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-05-07&endday=2019-05-07&tree=all

Comment 15

[Florin Strugariu [:Bebe]]

from looking at the errors these are multiple issues bundled in one:

05:46:45     INFO -  raptor-main TEST-UNEXPECTED-FAIL: no raptor test results were found for raptor-wasm-godot-chromium
05:46:45    ERROR - Return code: 1

 mozproxy Aborting: Mitmproxy process did not startup
10:53:47     INFO -  mozproxy Stopping mitmproxy playback, killing process 5072

10:53:47     INFO -  mozrunner.errors.RunnerNotStartedError: returncode accessed before runner started
10:53:47    ERROR - Return code: 1

10:40:46     INFO -  raptor-main TEST-UNEXPECTED-FAIL: no raptor test results were found for raptor-tp6m-aframeio-animation-geckoview
10:40:46    ERROR - Return code: 1

16:09:05     INFO -      remote_dir = posixpath.join(self.device_profile, 'minidumps')
16:09:05     INFO -  AttributeError: 'RaptorAndroid' object has no attribute 'device_profile'

13:11:34     INFO -  mozproxy Aborting: Mitmproxy process did not startup
13:11:34     INFO -  mozproxy Stopping mitmproxy playback, killing process 704
13:11:34     INFO -  mozproxy Mitmproxy exited with error code 572

Comment 16

[Intermittent Failures Robot]

32 failures in 4705 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• mozilla-central: 18
• mozilla-inbound: 5
• autoland: 7
• try: 2

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 3
• android-hw-p2-8-0-android-aarch64: 6
• android-hw-g5-7-0-arm7-api-16: 15
• windows10-64-ux: 2
• android-em-7-0-x86: 1
• linux64-shippable-qr: 4
• osx-10-10-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 17

[Daniel Varga [:dvarga]]

Most of the are misclassifications.

Comment 18

[Intermittent Failures Robot]

16 failures in 887 pushes (0.018 failures/push) were associated with this bug yesterday.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 15
• mozilla-central: 1

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 8
• android-hw-g5-7-0-arm7-api-16: 4
• android-em-4-3-armv7-api16: 1
• windows10-64: 2
• android-hw-p2-8-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-05-16&endday=2019-05-16&tree=all

Comment 19

[Andreea Pavel [:apavel]]

Recent occurrences here are missclassifications. Android ones are bug 1549209, Bug 1548739, bug 1550150, linux bug 1524545 etc.

Comment 20

[Intermittent Failures Robot]

52 failures in 4658 pushes (0.011 failures/push) were associated with this bug in the last 7 days.

This is the #31 most frequent failure this week.

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. **

Repository breakdown:

• autoland: 33
• mozilla-inbound: 5
• try: 4
• mozilla-central: 10

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 20
• android-hw-p2-8-0-android-aarch64: 17
• osx-10-10-shippable: 1
• linux64-shippable-qr: 4
• windows10-64: 1
• android-hw-p2-8-0-arm7-api-16: 7
• windows10-64-shippable-qr: 1
• macosx1010-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-05-13&endday=2019-05-19&tree=all

Comment 21

[Intermittent Failures Robot]

7 failures in 4730 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• mozilla-inbound: 1
• mozilla-beta: 1
• try: 1
• autoland: 1

Platform breakdown:

• windows10-64-shippable: 1
• android-hw-g5-7-0-arm7-api-16: 2
• android-hw-p2-8-0-android-aarch64: 3
• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-05-20&endday=2019-05-26&tree=all

Comment 22

[Intermittent Failures Robot]

15 failures in 632 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 12
• mozilla-beta: 1
• mozilla-central: 2

Platform breakdown:

• linux64-shippable-qr: 6
• windows10-64-shippable-qr: 2
• macosx1014-64-shippable: 1
• linux64-shippable: 3
• android-hw-p2-8-0-android-aarch64: 2
• android-hw-p2-8-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-05-27&endday=2019-05-27&tree=all

Comment 23

[Intermittent Failures Robot]

37 failures in 4337 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 20
• mozilla-beta: 1
• mozilla-central: 14
• mozilla-inbound: 2

Platform breakdown:

• macosx1014-64-shippable: 1
• linux64-shippable-qr: 7
• windows10-64-shippable-qr: 2
• linux64-shippable: 3
• android-hw-p2-8-0-android-aarch64: 8
• android-hw-p2-8-0-arm7-api-16: 8
• android-hw-g5-7-0-arm7-api-16: 7
• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-05-27&endday=2019-06-02&tree=all

Comment 24

[Alexandru Michis [:malexandru]]

All of these are miss classifications.

Comment 25

[Henrik Skupin [:whimboo][⌚️UTC+2]]

It's still an intermittent failure even with a low occurrence those days.

Comment 26

[Intermittent Failures Robot]

23 failures in 955 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 14
• autoland: 7
• mozilla-inbound: 2

Platform breakdown:

• android-hw-p2-8-0-android-aarch64: 4
• linux64-shippable-qr: 4
• linux64-shippable: 4
• linux64: 1
• linux64-qr: 1
• windows10-64-shippable-qr: 5
• android-hw-g5-7-0-arm7-api-16: 3
• windows10-64-ux: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-06-07&endday=2019-06-07&tree=all

Comment 27

[Intermittent Failures Robot]

65 failures in 5197 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #24 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 26
• mozilla-central: 28
• mozilla-inbound: 11

Platform breakdown:

• android-hw-p2-8-0-arm7-api-16: 5
• android-hw-g5-7-0-arm7-api-16: 16
• linux64-shippable: 7
• android-hw-p2-8-0-android-aarch64: 17
• windows10-64-ux: 3
• linux64-shippable-qr: 7
• linux64: 2
• linux64-qr: 1
• windows10-64-shippable-qr: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-06-03&endday=2019-06-09&tree=all

Comment 28

[Cosmin Sabou [:CosminS]]

All of these all misclasifications. Please check the first failure lines before classifying.

Comment 29

[Intermittent Failures Robot]

19 failures in 4753 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 10
• mozilla-inbound: 2
• autoland: 7

Platform breakdown:

• linux64-shippable: 6
• android-hw-g5-7-0-arm7-api-16: 6
• android-hw-p2-8-0-arm7-api-16: 1
• linux64: 2
• linux64-shippable-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-06-10&endday=2019-06-16&tree=all

Comment 30

[Intermittent Failures Robot]

3 failures in 2581 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1
• mozilla-central: 2

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 31

[Intermittent Failures Robot]

1 failures in 4409 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-06-24&endday=2019-06-30&tree=all

Comment 32

[Intermittent Failures Robot]

2 failures in 3501 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1
• mozilla-central: 1

Platform breakdown:

• android-hw-g5-7-0-arm7-api-16: 1
• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1543933&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 33

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup