Permanentn Fenix browsertime youtube test failures due to changed output format
Categories
(Testing :: Raptor, defect)
Tracking
(Not tracked)
People
(Reporter: aryx, Unassigned)
References
(Regression)
Details
https://treeherder.mozilla.org/jobs?repo=fenix&group_state=expanded&selectedTaskRun=Inhuy3n-R3Ce2cXMCpbcrw.0&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&searchStr=ytp&revision=01ec5588118f089e9f30e10da93fc67940833ddf
has the Android Fenix youtube playback tests failing because the output format changed:
Before, the measurements
key had content like this:
'measurements': {
u 'youtube-playbackperf-sfr-av1-test': [
[{
u 'PlaybackPerfAV1720p30fps@1X': {
u 'fail': 0, u 'droppedFrames': 356, u 'decodedFrames': 480
Now it's:
'measurements': {
'fcp': [16590],
'dcf': [294],
'fnbpaint': [294],
'loadtime': [16917]
},
This prevents https://searchfox.org/mozilla-central/rev/277ab3925eae21b419167a34624ec0ab518d0c94/testing/raptor/raptor/output.py#1537 from running which causes the failure a few lines below: https://treeherder.mozilla.org/logviewer?job_id=322143668&repo=fenix
Pushlog for central should be https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=efceae9186cd456bb70240aa851855efb5afd316&tochange=31d67eef91da183d26334f42e78ae41d9b37ff90
Updated•4 years ago
|
Comment 2•4 years ago
•
|
||
wrong bug
Description
•