964588 - [META] Set up Tarako results on Datazilla

Status: RESOLVED FIXED

(Firefox OS Graveyard :: General, defect, P1)

Description

[Jonathan Griffin (:jgriffin)]

+++ This bug was initially created as a clone of Bug #950691 +++

Hi,

This bug is a request to have a Tarako device set up on datazilla to understand the performance numbers on 
- B2G_v1.3
- B2G_Master

Thanks

Comment 1

[Jonathan Griffin (:jgriffin)]

Tarako results are now live on datazilla for the 1.3 branch only; there are still some errors that occur during test (see dependent bugs), but they don't prevent us from completing the test and posting data to datazilla.

Comment 2

[Joe Cheng [:jcheng] (please needinfo)]

hi Johnathan, can we get the data with tarako from 1.3T branch? Thanks

Comment 3

[[:fabrice] Fabrice Desré]

Joe, even if it's labeled as '1.3' I believe these results are using the 1.3t branch:

https://datazilla.mozilla.org/b2g/?branch=v1.3&device=tarako&range=7&test=cold_load_time&app_list=browser,calendar,camera,clock,contacts,email%20FTU,fm_radio,gallery,messages,music,phone,settings,template,usage,video&app=phone&gaia_rev=8280f6749b8183e4&gecko_rev=5ee51aa77d88a533&plot=avg

Comment 4

[Hubert Figuiere [:hub]]

Can we build master (1.4) for tarako? Last time I tried from our tree it didn't work (couldn't find revision in the repos) and the sprd tree only builds 1.3T.

For now, I don't recommend runing make test-perf on tarako (1.3T). There are a few issues that needs to be addressed first.

Comment 5

[[:fabrice] Fabrice Desré]

Which issues? We need results from the shipping branch, not 1.4 (it builded and ran last time I tried btw).

Comment 6

[Hubert Figuiere [:hub]]

(In reply to Fabrice Desré [:fabrice] from comment #5)
> Which issues?

Bug 980993 to track running the test with 1.3T.
They are mostly on the testing framework side. But I get crashes and hangs on tarako. Like bug 980541

Comment 7

[Jonathan Griffin (:jgriffin)]

Since we're not flashing gaia onto the devices at test time, they're using whatever gaia the Taipei team uses to create the builds, which is 1.3t.  We're already running b2gperf on that branch and reporting to Datazilla.

We can add 'make test-perf' as soon as bug 980993 is resolved.

Comment 8

[Jonathan Griffin (:jgriffin)]

Since we're not flashing gaia onto the devices at test time, they're using whatever gaia the Taipei team uses to create the builds, which is 1.3t.  We're already running b2gperf on that branch and reporting to Datazilla.

We can add 'make test-perf' as soon as bug 980993 is resolved.

Comment 9

[Stephen Donner [:stephend] Not actively reading bugmail]

(Just added bug 981075, for https://bugzilla.mozilla.org/show_bug.cgi?id=981075#c55, which covers opening the right flow/port for downloading the build from Taipei, for now.)

Comment 10

[Dave Hunt [:davehunt] [he/him] ⌚BST]

I believe there's nothing left to do here. The remaining blocker is bug 980829 but I've just removed the Template app for now and raised bug 999368 to add it back again once the issue is resolved.