Closed Bug 1618566 Opened 1 year ago Closed 5 months ago

[raptor][YTP] Change the development server URL with the production server URL for Youtube playback tests once 2020 tests have been stabilized

Categories

(Testing :: Raptor, task, P2)

task

Tracking

(firefox82 fixed)

RESOLVED FIXED
82 Branch
Tracking Status
firefox82 --- fixed

People

(Reporter: marauder, Assigned: sparky)

References

(Blocks 1 open bug, )

Details

Attachments

(1 file)

I am working on https://phabricator.services.mozilla.com/D62546
and for the moment i am using a development server URL to be able to run the tests.
This has to be changed to production server once we have all in place.

Status: NEW → ASSIGNED
Depends on: 1609373
Priority: -- → P1

INI files test_url values:


I added a new domain "://.amazonaws.com/*" , after the line below:
https://searchfox.org/mozilla-central/rev/b2ccce862ef38d0d150fcac2b597f7f20091a0c7/testing/raptor/webext/raptor/manifest.json#70
that should be removed once we have all we need on the production server

The dot has been removed from the test names on branch 2020 and is harder to read.
I opened this issue on youtube's github repo, maybe they will add it back:
https://github.com/youtube/js_mse_eme/issues/48

Another solution is to create a new patch where the dot can be added in output.py when we do the parsing for youtube tests results, by changing the _sub variable using some regexes :
https://searchfox.org/mozilla-central/rev/b2ccce862ef38d0d150fcac2b597f7f20091a0c7/testing/raptor/raptor/output.py#1218

Or we can do that in mozilla's github repo for YTP - on raptor branch:
https://github.com/mozilla/perf-youtube-playback/tree/raptor
after the changes for 2020 will be merged.

This bug is currently blocked and cannot be worked on. So lets get it out of the P1's for now.

Assignee: marian.raiciof → nobody
Status: ASSIGNED → NEW
Priority: P1 → P2
Summary: [raptor][YTP] Change the development server URL with the production server URL for Youtube playback tests → [raptor][YTP] Change the development server URL with the production server URL for Youtube playback tests once 2020 tests have been stabilized

Greg and Dave, I want to remind that someone has to continue the work here. Right now we operate on a dev server that is not maintained by IT. If something breaks it will cause test bustage across all the trees.

So what needs to be done:

a) Figuring out if we want a 2019/2020 subfolder in the Youtube playback repository

  1. File a bug so that IT can update the media files
  2. Update the raptor branch on the Youtube playback repo with the 2020 branch
  3. The production server will pick it up - manually check that all is working
  4. Switch the Raptor tests over to the production server

I'm happy to assist / help out with the process but someone has to do the actual work.

Flags: needinfo?(gmierz2)
Flags: needinfo?(dave.hunt)

This was discussed yesterday. Greg's planning to pick this up in July.

Severity: normal → S3
Flags: needinfo?(dave.hunt)
Flags: needinfo?(gmierz2)

The jira issue is solved, we are now able to use the 2020 prod URL. There's an issue in the prod server though: https://github.com/mozilla/perf-youtube-playback/issues/22

Once that's resolved, we can migrate the widevine tests. For now, all the non-widevine tests can be migrated.

Assignee: nobody → gmierz2
Status: NEW → ASSIGNED
Pushed by gmierz2@outlook.com:
https://hg.mozilla.org/integration/autoland/rev/20240998bb95
Use prod server instead of dev for youtube-playback tests. r=perftest-reviewers,Bebe
Status: ASSIGNED → RESOLVED
Closed: 5 months ago
Resolution: --- → FIXED
Target Milestone: --- → 82 Branch
You need to log in before you can comment on or make changes to this bug.