1021577 - Disable b2gperf fps tests running in CI

Status: RESOLVED FIXED

(Firefox OS Graveyard :: Performance, defect, P2)

Description

[Dave Hunt [:davehunt] [he/him] ⌚BST]

As I understand, the FPS results posted to datazilla from Jenkins are of limited use. They're also currently failing for some apps, including homescreen due to the new vertical homescreen in master.

If there's no objections I'd like to disable the jobs that are running these tests. I would also propose to remove this feature from b2gperf rather than continue to support it.

The Jenkins jobs in question are:
b2g.hamachi.mozilla-b2g30_v1_4.perf.fps
b2g.hamachi.mozilla-central.perf.fps

Comment 1

[Dave Hunt [:davehunt] [he/him] ⌚BST]

In datazilla, the results in question are:
https://datazilla.mozilla.org/b2g/?branch=v1.4&device=hamachi&range=30&test=fps
https://datazilla.mozilla.org/b2g/?branch=v1.4&device=hamachi&range=30&test=fps_hwc
https://datazilla.mozilla.org/b2g/?branch=master&device=hamachi&range=30&test=fps
https://datazilla.mozilla.org/b2g/?branch=master&device=hamachi&range=30&test=fps_hwc

Mike: could you comment, or needinfo the appropriate people to determine if we need to continue to provide these metrics?

Comment 2

[Mike Lee [:mlee]]

Dave,
You're okay to remove these as we don't use them. Mason (cc'd:mchang) has implemented a more accurate measurement in bug 990835 though it doesn't yet post to datazilla.

Kyle,
Will removing these negatively impact the datazilla ingestion/regression email alerts?

Comment 3

[Kyle Lahnakoski [:ekyle]]

There is no negative impact to the datazilla alerts if any test is turned off.  Go ahead.

Comment 4

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I have now disabled these jobs.

Comment 5

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I've raised bug 1022549 to remove this feature from b2gperf.