Investigate the significant amount of noise in the shopify_applink_startup test
Categories
(Core :: Performance: General, defect)
Tracking
()
People
(Reporter: denispal, Unassigned)
References
(Blocks 1 open bug)
Details
The noise in the shopify-applink-startup test is incredibly high: https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&series=autoland,5139291,1,15&timerange=2592000
There are values anywhere between 2s -> 5s which makes seeing any change in the signal very difficult.
|
Reporter | |
Comment 1•1 year ago
|
||
There are some indications that the problem may be related to the WiFi signal at bitbar. I've opened bug 1951431 to implement a locally hosted version of the applink startup test to see if stability improves.
|
|
Reporter | |
Comment 2•1 year ago
|
||
We've also noticed that the startup cache is not being properly utilized during this test. The startup cache flushes to disk at 1min, but we force-stop the app before that point during the test. Ted has opened a bug 1949978 to help investigate how to improve this.
|
||
Comment 3•1 year ago
|
||
The severity field is not set for this bug.
:bas.schouten, could you have a look please?
For more information, please visit BugBot documentation.
|
||
Comment 4•1 year ago
|
||
Resolving this, I believe we've solidly proven this is largely due to network effects.
Description
•