Add support for running page load tests against Fennec
Categories
(Testing :: Raptor, enhancement, P1)
Tracking
(firefox68 fixed)
| Tracking | Status | |
|---|---|---|
| firefox68 | --- | fixed |
People
(Reporter: davehunt, Assigned: alexandrui)
References
Details
Attachments
(1 file, 1 obsolete file)
We need to be able to compare Fennec page load results with GeckoView.
|
Reporter | |
Comment 1•7 years ago
|
||
|
||
Comment 2•6 years ago
|
||
Hi Alex, once Bug 1536758 lands and is all merged to central, can you please take over this work to get Raptor pageload running on Fennec?
:davehunt Already created a patch (comment 1) that you can start with (you can apply that to your latest repo once Bug 1536758 is merged). Ping me on IRC if you have any questions, thanks!
|
|
Assignee | |
Comment 4•6 years ago
|
||
|
|
Assignee | |
Comment 5•6 years ago
•
|
||
Hi Rob, below is a try build. Sorry, I had some issues importing the patch and I applied the changes manually that's why there are 2 phab revisions.
https://treeherder.mozilla.org/#/jobs?repo=try&revision=cf5c23efd7dbb60d268311efe2e59643e1c5d965
All seems to be green.
|
|
||
Comment 6•6 years ago
|
||
I've commented in the phab request (no need to NI me in the bug when you've submitted a phab review, thanks!)
:davehunt, I'm assuming for now we want to land this for local use only (i.e. so we can run tp6 on a local device with a specific version of fennec). Do we want these tp6 suites to land in production also? Maybe just on try for now? If so then we'll need taskcluster configs added to your patch Alex.
|
|
||
Comment 7•6 years ago
|
||
Since FCP ins't available in fennec v64, and that's the version we want to compare - let's just land local support for now (without FCP). If we want to add taskcluster production jobs in the future to run on newer Fennec then we can add FCP at that time.
|
|
Assignee | |
Comment 8•6 years ago
|
||
|
|
Reporter | |
Comment 9•6 years ago
|
||
(In reply to Robert Wood [:rwood] from comment #6)
I've commented in the phab request (no need to NI me in the bug when you've submitted a phab review, thanks!)
:davehunt, I'm assuming for now we want to land this for local use only (i.e. so we can run tp6 on a local device with a specific version of fennec). Do we want these tp6 suites to land in production also? Maybe just on try for now? If so then we'll need taskcluster configs added to your patch Alex.
It would be good to include try support in this patch.
|
|
Assignee | |
Comment 10•6 years ago
|
||
|
|
Reporter | |
Comment 11•6 years ago
|
||
The try run is failing, but I'm not sure why. Are you able to trigger the speedometer job on try?
|
|
Assignee | |
Comment 12•6 years ago
|
||
I pushed a speedometer job on try, looks like the same results.
|
|
Reporter | |
Updated•6 years ago
|
|
||
Updated•6 years ago
|
|
||
Comment 13•6 years ago
|
||
|
|
||
Comment 14•6 years ago
|
||
| bugherder | ||
|
|
Assignee | |
Comment 15•6 years ago
|
||
Try build faied:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=aaff0a005dc6e47e88748d4e1e78985f28c48c9f&selectedJob=239014164
|
|
Reporter | |
Comment 16•6 years ago
|
||
If you look at the log [0] you'll see the error "raptor-manifest abort: specified test name doesn't exist". This should really be the error picked up by Treeherder, but I think bug 1522604 is preventing this. The error suggests that the test cannot be found. I would expect that this would be reproducable locally. Can you update mozilla-central to the latest revision and push to try again, requesting these jobs. If it still fails please open a new bug as this one have been resolved.
[0] https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=239025580&repo=try&lineNumber=911
Description
•