1014135 - Startup Time of Contacts App Regressed

Status: RESOLVED INVALID

(Firefox OS Graveyard :: Gaia::Contacts, defect, P1)

Description

[Mason Chang [Inactive] [:mchang]]

From datazilla:

https://datazilla.mozilla.org/b2g/?branch=master&device=hamachi&range=7&test=startup_%3E_startup-path-done&app_list=communications/contacts,fm&app=communications/contacts&gaia_rev=9ad117d9d7f4d9e7&gecko_rev=cb9f34f73ebe&plot=avg

Good Gaia / Gecko
Gaia Revision: 9ad117d9d7f4d9e7
Gecko Revision: cb9f34f73ebe

Bad Gaia / Gecko
Gaia Revision: 1609e724e10ca78b
Gecko Revision: cb9f34f73ebe

Since Gecko is the same, this is probably a Gaia regression.

Comment 1

[Mason Chang [Inactive] [:mchang]]

Attachment: Bad Gaia Revision of make test-perf

Comment 2

[Mason Chang [Inactive] [:mchang]]

Attachment: Good Gaia make test-perf results

Comment 3

[Mason Chang [Inactive] [:mchang]]

Attachment: make test perf result for gaia 4160d9839817b0e1

Comment 4

[Mason Chang [Inactive] [:mchang]]

Looking at a diff between the good / bad revisions, I don't see anything other than an added test suite to the Contacts app. The time difference between the good / bad revisions are actually flipped, where the good gaia revision actually performs worse than the bad version. From datazilla, the variance is incredible compared to the versions before, so I'm not convinced this is a real regression.

Comment 5

[Mason Chang [Inactive] [:mchang]]

This is an error with datazilla / make test perf. 

For reference - good contacts
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Perf/job/b2g.hamachi.mozilla-central.master.mozperftest/2814/console
Gaia Revision: d3b16b36d76b5713
Gecko Revision: 41a54c8add09

bad contacts
Gaia Revision: 17da68db9f9fa777
Gecko Revision: 9d8d16695f6a
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Perf/job/b2g.hamachi.mozilla-central.master.mozperftest/2846/

tip
Gaia Revision: f3b5d74dd3428c89
Gecko Revision: e9b2b72f4e6c
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Perf/job/b2g.hamachi.mozilla-central.master.mozperftest/2897/


Attaching good / bad logs before they get cleaned by datazilla.

Comment 6

[Mason Chang [Inactive] [:mchang]]

Attachment: Good make test perf log from datazilla

make test perf log
good contacts
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Perf/job/b2g.hamachi.mozilla-central.master.mozperftest/2814/console
Gaia Revision: d3b16b36d76b5713
Gecko Revision: 41a54c8add09

Comment 7

[Mason Chang [Inactive] [:mchang]]

Attachment: bad make test-perf log

bad contacts
Gaia Revision: 17da68db9f9fa777
Gecko Revision: 9d8d16695f6a
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Perf/job/b2g.hamachi.mozilla-central.master.mozperftest/2846/

Comment 8

[Mason Chang [Inactive] [:mchang]]

Attachment: tip make test-perf log

tip
Gaia Revision: f3b5d74dd3428c89
Gecko Revision: e9b2b72f4e6c
http://selenium.qa.mtv2.mozilla.com:8080/view/B2G%20Perf/job/b2g.hamachi.mozilla-central.master.mozperftest/2897/