1193023 - Intermittent test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Status: RESOLVED FIXED

(DevTools :: Performance Tools (Profiler/Timeline), defect)

Comment 1

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4177173
repository: fx-team
start_time: 2015-08-10T08:36:49
who: wkocher[at]mozilla[dot]com
machine: t-w864-ix-064
buildname: Windows 8 64-bit fx-team debug test mochitest-other
revision: 86b3b49cae37

3213 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 2

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4177709
repository: fx-team
start_time: 2015-08-10T09:10:49
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-1164
buildname: Ubuntu VM 12.04 x64 fx-team debug test mochitest-other
revision: bdea09cdb622

3195 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 3

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=1990819
repository: mozilla-central
start_time: 2015-08-10T16:09:10
who: wkocher[at]mozilla[dot]com
machine: t-w732-ix-009
buildname: Windows 7 32-bit mozilla-central debug test mochitest-other
revision: 22aeb4618c99

3224 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 4

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12734439
repository: mozilla-inbound
start_time: 2015-08-11T04:13:09
who: archaeopteryx[at]coole-files[dot]de
machine: t-yosemite-r5-0070
buildname: Rev5 MacOSX Yosemite 10.10 mozilla-inbound debug test mochitest-other
revision: 4aca9861fa7b

2071 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 5

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12737258
repository: mozilla-inbound
start_time: 2015-08-11T06:01:33
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-409
buildname: Ubuntu VM 12.04 x64 mozilla-inbound debug test mochitest-other
revision: 7c2524bbcb40

3187 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 6

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12740552
repository: mozilla-inbound
start_time: 2015-08-11T07:15:25
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-448
buildname: Ubuntu VM 12.04 x64 mozilla-inbound debug test mochitest-other
revision: 4a579559b0da

3205 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 7

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4198361
repository: fx-team
start_time: 2015-08-11T09:56:09
who: rvandermeulen[at]mozilla[dot]com
machine: t-yosemite-r5-0071
buildname: Rev5 MacOSX Yosemite 10.10 fx-team debug test mochitest-other
revision: 23a18ed8ddc5

2073 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 8

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4196514
repository: fx-team
start_time: 2015-08-11T07:58:15
who: rvandermeulen[at]mozilla[dot]com
machine: t-w864-ix-003
buildname: Windows 8 64-bit fx-team debug test mochitest-other
revision: 2e61c9725c74

3216 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 9

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=1035138
repository: mozilla-aurora
start_time: 2015-08-11T15:05:06
who: wkocher[at]mozilla[dot]com
machine: t-yosemite-r5-0058
buildname: Rev5 MacOSX Yosemite 10.10 mozilla-aurora debug test mochitest-other
revision: a695ecb82d4d

2070 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 10

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4204396
repository: fx-team
start_time: 2015-08-11T16:02:14
who: philringnalda[at]gmail[dot]com
machine: tst-linux64-spot-1788
buildname: Ubuntu VM 12.04 x64 fx-team debug test mochitest-other
revision: 09feeb70edac

3196 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 11

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4207530
repository: fx-team
start_time: 2015-08-11T18:27:13
who: philringnalda[at]gmail[dot]com
machine: t-yosemite-r5-0085
buildname: Rev5 MacOSX Yosemite 10.10 fx-team opt test mochitest-5
revision: 09feeb70edac

1603 INFO TEST-UNEXPECTED-FAIL | toolkit/content/tests/widgets/test_videocontrols_audio_direction.html | Test timed out.

Comment 12

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12778338
repository: mozilla-inbound
start_time: 2015-08-12T05:19:15
who: rvandermeulen[at]mozilla[dot]com
machine: t-xp32-ix-003
buildname: Windows XP 32-bit mozilla-inbound debug test mochitest-other
revision: a837c35902be

3207 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 13

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12762729
repository: mozilla-inbound
start_time: 2015-08-11T16:18:13
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-1055
buildname: Ubuntu VM 12.04 x64 mozilla-inbound debug test mochitest-other
revision: 89afeb8eb962

3197 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 14

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12782130
repository: mozilla-inbound
start_time: 2015-08-12T07:41:35
who: rvandermeulen[at]mozilla[dot]com
machine: t-w732-ix-006
buildname: Windows 7 32-bit mozilla-inbound debug test mochitest-other
revision: 2c3c8a927e3f

3217 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 15

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4221962
repository: fx-team
start_time: 2015-08-12T22:19:20
who: philringnalda[at]gmail[dot]com
machine: t-w864-ix-084
buildname: Windows 8 64-bit fx-team debug test mochitest-other
revision: 00db61e6f388

3217 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 16

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=2523369
repository: b2g-inbound
start_time: 2015-08-12T16:57:23
who: philringnalda[at]gmail[dot]com
machine: t-w732-ix-024
buildname: Windows 7 32-bit b2g-inbound debug test mochitest-other
revision: 7649ffe28b67

3216 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 17

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=1037840
repository: mozilla-aurora
start_time: 2015-08-12T16:48:16
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-792
buildname: Ubuntu VM 12.04 x64 mozilla-aurora debug test mochitest-other
revision: 29300721bb12

3207 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 18

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12842689
repository: mozilla-inbound
start_time: 2015-08-13T12:19:49
who: rvandermeulen[at]mozilla[dot]com
machine: t-xp32-ix-094
buildname: Windows XP 32-bit mozilla-inbound debug test mochitest-other
revision: c8ad1b01b299

3216 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 19

[Ryan VanderMeulen [:RyanVM]]

Any idea what might be going on here, Jordan?

Comment 20

[Jordan Santell [:jsantell] [@jsantell]]

Checking it out, it's a fragile test that really needs to be solidified

Comment 21

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12844883
repository: mozilla-inbound
start_time: 2015-08-13T13:08:12
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-786
buildname: Ubuntu VM 12.04 x64 mozilla-inbound debug test mochitest-other
revision: 8a50c71ddeda

3202 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 22

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12853707
repository: mozilla-inbound
start_time: 2015-08-13T14:46:20
who: wkocher[at]mozilla[dot]com
machine: tst-linux64-spot-1194
buildname: Ubuntu VM 12.04 x64 mozilla-inbound debug test mochitest-other
revision: c68650295053

3192 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 23

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12869667
repository: mozilla-inbound
start_time: 2015-08-13T22:25:13
who: archaeopteryx[at]coole-files[dot]de
machine: tst-linux64-spot-1338
buildname: Ubuntu VM 12.04 x64 mozilla-inbound debug test mochitest-other
revision: 7bd651ae54dd

3184 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 24

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12873106
repository: mozilla-inbound
start_time: 2015-08-14T01:00:09
who: nigelbabu[at]gmail[dot]com
machine: t-xp32-ix-046
buildname: Windows XP 32-bit mozilla-inbound debug test mochitest-other
revision: c2a85adcd4c0

3212 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 25

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12871613
repository: mozilla-inbound
start_time: 2015-08-13T23:55:09
who: nigelbabu[at]gmail[dot]com
machine: tst-linux64-spot-1790
buildname: Android armv7 API 9 mozilla-inbound opt test mochitest-9
revision: c2a85adcd4c0

TEST-UNEXPECTED-FAIL | dom/media/test/test_timeupdate_small_files.html | application ran for longer than allowed maximum time
PROCESS-CRASH | dom/media/test/test_timeupdate_small_files.html | application crashed [@ libc.so + 0xc51c]
Return code: 1
No tests run or test summary not found

Comment 26

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12881060
repository: mozilla-inbound
start_time: 2015-08-14T07:35:39
who: rvandermeulen[at]mozilla[dot]com
machine: tst-linux64-spot-1027
buildname: Ubuntu VM 12.04 x64 mozilla-inbound debug test mochitest-other
revision: 6a3692b7918c

3189 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 27

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12897518
repository: mozilla-inbound
start_time: 2015-08-14T12:49:31
who: rvandermeulen[at]mozilla[dot]com
machine: t-xp32-ix-141
buildname: Windows XP 32-bit mozilla-inbound debug test mochitest-other
revision: 9bea8fc16ae2

3219 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 28

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12914255
repository: mozilla-inbound
start_time: 2015-08-15T07:11:09
who: philringnalda[at]gmail[dot]com
machine: t-w864-ix-093
buildname: Windows 8 64-bit mozilla-inbound debug test mochitest-other
revision: 4612c09141ae

3209 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
3722 INFO TEST-UNEXPECTED-FAIL | widget/tests/test_wheeltransaction.xul | uncaught exception - TypeError: gCurrentTest is undefined at chrome://mochitests/content/chrome/widget/tests/window_wheeltransaction.xul:1442
Return code: 1
Return code: 1
Return code: 1

Comment 29

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=12915372
repository: mozilla-inbound
start_time: 2015-08-15T09:16:53
who: archaeopteryx[at]coole-files[dot]de
machine: t-snow-r4-0074
buildname: Rev4 MacOSX Snow Leopard 10.6 mozilla-inbound debug test mochitest-other
revision: 51eebda696d4

3113 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 30

[Jordan Santell [:jsantell] [@jsantell]]

Attachment: 1193023-intermittent.patch

Comment 31

[Victor Porof [:vporof][:vp]]

Comment on attachment 8648504 [details] [diff] [review]
1193023-intermittent.patch

Review of attachment 8648504 [details] [diff] [review]:
-----------------------------------------------------------------

::: toolkit/devtools/server/tests/mochitest/test_framerate_06.html
@@ +64,5 @@
>      // when we get ticks from other frames they're usually at diffs of < 1. Sometimes
>      // ticks can still be less than 16ms even on one frame (usually following a very slow
>      // frame), so use a low number (2) to be our threshold
>      var THRESHOLD = 2;
> +    ok(ticks.length >= 20, "we should have atleast 20 ticks over the course of two seconds.");

Well, this is a stronger assumption, but still an assumption. Let's see how this goes.

Comment 32

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=try&job_id=10393717
repository: try
start_time: 2015-08-13T06:25:16
who: Ms2ger[at]gmail[dot]com
machine: t-w732-ix-012
buildname: Windows 7 32-bit try debug test mochitest-other
revision: cb30a12f675e

3214 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks
Return code: 1
Return code: 1
Return code: 1

Comment 33

[Pulsebot]

https://hg.mozilla.org/integration/fx-team/rev/cc3c25bf13e2

Comment 34

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/cc3c25bf13e2

Comment 35

[Legacy TBPL/Treeherder Robot]

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=1072530
repository: mozilla-aurora
start_time: 2015-08-25T18:13:16
who: rvandermeulen[at]mozilla[dot]com
machine: t-snow-r4-0128
buildname: Rev4 MacOSX Snow Leopard 10.6 mozilla-aurora debug test mochitest-other
revision: 95ea1b781b0f

3117 INFO TEST-UNEXPECTED-FAIL | toolkit/devtools/server/tests/mochitest/test_framerate_06.html | we should have 2 seconds worth of ticks, atleast 60 ticks

Comment 36

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-aurora/rev/51aca28acd76