1513520 - Intermittent devtools/server/tests/mochitest/test_framerate_04.html | More ticks should be recorded in the second batch.

Status: RESOLVED INCOMPLETE

(DevTools :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: opoprus [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=216556081&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/VIH6nBJZTxC7gGiREzkgzQ/runs/0/artifacts/public/logs/live_backing.log

TEST-PASS | devtools/server/tests/mochitest/test_framerate_04.html | There should be a second batch recording available. 
09:24:05     INFO - Difference in ticks: 0
09:24:05     INFO - Buffered messages finished
09:24:05     INFO - TEST-UNEXPECTED-FAIL | devtools/server/tests/mochitest/test_framerate_04.html | More ticks should be recorded in the second batch. 
09:24:05     INFO - SimpleTest.ok@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:275:7
09:24:05     INFO - onRecordingStopped@chrome://mochitests/content/chrome/devtools/server/tests/mochitest/test_framerate_04.html:55:3
09:24:05     INFO - window.onload@chrome://mochitests/content/chrome/devtools/server/tests/mochitest/test_framerate_04.html:39:9
09:24:05     INFO - TEST-PASS | devtools/server/tests/mochitest/test_framerate_04.html | All the ticks in the first batch should be in the second batch as well. 
09:24:05     INFO - TEST-PASS | devtools/server/tests/mochitest/test_framerate_04.html | All the ticks in the final batch should be ascending in value. 
09:24:05     INFO - GECKO(5600) | MEMORY STAT | vsize 1732MB | vsizeMaxContiguous 130743099MB | residentFast 279MB | heapAllocated 114MB
09:24:05     INFO - TEST-OK | devtools/server/tests/mochitest/test_framerate_04.html | took 3164ms

Comment 1

[Intermittent Failures Robot]

1 failures in 2485 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2018-12-10&endday=2018-12-16&tree=all

Comment 2

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 3

[Andrei Ciure[:aciure]]

New occurrence:

https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception&classifiedState=unclassified&fromchange=d62b974d529cb8a011bc89b8c1693ff1d67d0eb4&selectedJob=229986254&searchStr=linux%2Cx64%2Cquantumrender%2Cpgo%2Copt%2Cmochitests%2Ctest-linux64-pgo-qr%2Fopt-mochitest-chrome-1%2Cm%28c1%29

Comment 4

[Intermittent Failures Robot]

1 failures in 2602 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-pgo-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-02-18&endday=2019-02-24&tree=all

Comment 5

[Intermittent Failures Robot]

1 failures in 2981 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-02-25&endday=2019-03-03&tree=all

Comment 6

[Intermittent Failures Robot]

1 failures in 2771 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• linux64-pgo-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-03-11&endday=2019-03-17&tree=all

Comment 7

[Intermittent Failures Robot]

2 failures in 3910 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• linux64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 2843 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 9

[Intermittent Failures Robot]

1 failures in 3025 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-inbound: 1

Platform breakdown:

• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-04-08&endday=2019-04-14&tree=all

Comment 10

[Intermittent Failures Robot]

4 failures in 2673 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4

Platform breakdown:

• linux64-shippable-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 11

[Intermittent Failures Robot]

8 failures in 3031 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-inbound: 2
• try: 1
• mozilla-central: 1

Platform breakdown:

• linux64-shippable-qr: 6
• linux64-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 4131 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-04-29&endday=2019-05-05&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 4705 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform breakdown:

• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-05-06&endday=2019-05-12&tree=all

Comment 14

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 15

[Raul Gurzau (:RaulG)]

New failure: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=254331071&repo=mozilla-central&lineNumber=48929

Comment 16

[Intermittent Failures Robot]

3 failures in 3501 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 2

Platform breakdown:

• linux64-qr: 1
• linux64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 17

[Intermittent Failures Robot]

1 failures in 4710 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-07-08&endday=2019-07-14&tree=all

Comment 18

[Intermittent Failures Robot]

1 failures in 4439 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-07-29&endday=2019-08-04&tree=all

Comment 19

[Firefox Bug Husbandry Bot]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup

Comment 20

[Cristian Brindusan [:cbrindusan]]

New occurrence:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=267398798&repo=autoland&lineNumber=48571

Comment 21

[Intermittent Failures Robot]

2 failures in 4350 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux64-shippable-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-09-16&endday=2019-09-22&tree=all

Comment 22

[Intermittent Failures Robot]

15 failures in 850 pushes (0.018 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 6
• try: 1

Platform breakdown:

• linux64-shippable-qr: 11
• linux64-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-09-27&endday=2019-09-27&tree=all

Comment 23

[Andreea Pavel [:apavel]]

Retrigger range: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&selectedJob=268928963&searchStr=linux%2Cx64%2Cquantumrender%2Cshippable%2Copt%2Cmochitests%2Cwithout%2Ce10s%2Ctest-linux64-shippable-qr%2Fopt-mochitest-chrome-1proc-1%2Cm-1proc%28c1%29&tochange=2083ea3c6230e912a23d0ff50691d269e0d28274&fromchange=5837862212545b9ca4c7f20bee817a75389d832e

Glenn this seems to be a regression of Bug 1581757, please take a look.

Comment 24

[Glenn Watson [:gw]]

I suspect (based on the history of the failures above and from a quick look at what's being tested) that the test failure is caused by a bug elsewhere and that my patch has somehow affected timings of that test in a way that make it more likely to occur.

Although, I don't have a great understanding of what exactly this test is checking for, and if it could be related to the WR change above.

Do you know who we could ask about this test to get a better understanding of what might cause the failure? Markus, would you know anything about this test? Otherwise, I'll do some further investigation first thing Monday morning.

Comment 25

[Intermittent Failures Robot]

25 failures in 4530 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 14
• mozilla-central: 8
• try: 3

Platform breakdown:

• linux64-shippable-qr: 21
• linux64-qr: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-09-23&endday=2019-09-29&tree=all

Comment 26

[Andreea Pavel [:apavel]]

Hi Patrick, can you answer the question above regarding who might have a better understanding of this failure?

Comment 27

[Markus Stange [:mstange]]

The test seems to be testing that requestAnimationFrame keeps firing after a reload(), and that the "framerate actor" (defined in devtools/server/performance/framerate.js) re-registers itself as a rAF listener when the reload navigation occurs. The test waits for 1 second between the reload() and the check. So we'd need to debug why requestAnimationFrame does not fire during that one second wait.

Comment 28

[Intermittent Failures Robot]

20 failures in 820 pushes (0.024 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 14
• mozilla-central: 3
• try: 3

Platform breakdown:

• linux64-shippable-qr: 17
• linux64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-09-30&endday=2019-09-30&tree=all

Comment 29

[Intermittent Failures Robot]

33 failures in 4292 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 19
• mozilla-central: 4
• try: 10

Platform breakdown:

• linux64-shippable-qr: 25
• linux64-qr: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-09-30&endday=2019-10-06&tree=all

Comment 30

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Comment 31

[Cristian Brindusan [:cbrindusan]]

New occurrence:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=275997709&repo=try&lineNumber=47416

Comment 32

[Intermittent Failures Robot]

12 failures in 4207 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• mozilla-central: 4
• autoland: 5

Platform breakdown:

• linux64-shippable-qr: 9
• linux64-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-11-11&endday=2019-11-17&tree=all

Comment 33

[Intermittent Failures Robot]

9 failures in 5444 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 3
• try: 2

Platform breakdown:

• linux64-shippable-qr: 7
• linux64-shippable: 1
• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1513520&startday=2019-11-18&endday=2019-11-24&tree=all

Comment 34

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.