Closed Bug 1677982 Opened 4 years ago Closed 4 years ago

Permanentn Fenix browsertime youtube test failures due to changed output format

Categories

(Testing :: Raptor, defect)

Firefox 85
defect

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 1677896

People

(Reporter: aryx, Unassigned)

References

(Regression)

Details

https://treeherder.mozilla.org/jobs?repo=fenix&group_state=expanded&selectedTaskRun=Inhuy3n-R3Ce2cXMCpbcrw.0&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&searchStr=ytp&revision=01ec5588118f089e9f30e10da93fc67940833ddf
has the Android Fenix youtube playback tests failing because the output format changed:

Before, the measurements key had content like this:

  'measurements': {
    u 'youtube-playbackperf-sfr-av1-test': [
      [{
        u 'PlaybackPerfAV1720p30fps@1X': {
          u 'fail': 0, u 'droppedFrames': 356, u 'decodedFrames': 480

Now it's:

  'measurements': {
    'fcp': [16590],
    'dcf': [294],
    'fnbpaint': [294],
    'loadtime': [16917]
  },

This prevents https://searchfox.org/mozilla-central/rev/277ab3925eae21b419167a34624ec0ab518d0c94/testing/raptor/raptor/output.py#1537 from running which causes the failure a few lines below: https://treeherder.mozilla.org/logviewer?job_id=322143668&repo=fenix

Pushlog for central should be https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=efceae9186cd456bb70240aa851855efb5afd316&tochange=31d67eef91da183d26334f42e78ae41d9b37ff90

See Also: → 1677896
Regressed by: 1562642
Status: NEW → RESOLVED
Closed: 4 years ago
Component: Performance → Raptor
Resolution: --- → DUPLICATE

wrong bug

You need to log in before you can comment on or make changes to this bug.