Closed Bug 1523973 Opened 11 months ago Closed 10 months ago

Review and update the raptor-tp6m-1 recordings

Categories

(Testing :: Raptor, enhancement, P1)

Version 3
enhancement

Tracking

(firefox67 fixed)

RESOLVED FIXED
mozilla67
Tracking Status
firefox67 --- fixed

People

(Reporter: Bebe, Assigned: Bebe)

References

Details

Attachments

(2 files)

I ran all the tests from raptor-tp6m-1 today and saw that the websites are not displaying correctly

Here is a link to the screenshot report:

https://screenshots.firefox.com/ArU9X91TVwcWc8mO/null

And here is a link with some screenshots made to the same websites with the ghecko view app

https://photos.app.goo.gl/15dDPBGACjgh1qdY9

As you can see there are big differences between the two.

Do we have issues with the recordings?

Tested on Pixel 2 and gecko_example 20190129134346

When I run Raptor tp6m-1 on my Google Pixel 2 locally (OSX) it looks fine - see attached screenshots from the local test run - however note I am running quite an old geckoview_example app (20181205191909).

Maybe something has changed in the app that makes the recordings not render properly - I'll try upgrading my geckoview_example app and see if that makes a difference.

here are new recordings

https://drive.google.com/drive/folders/1GgbvSiXDC3F3INwQg5RWyUoEdSNkFSO8?usp=sharing

:rwood davehunt can you download and test these on your devices?

Flags: needinfo?(rwood)
Flags: needinfo?(dave.hunt)

(In reply to Florin Strugariu [:Bebe] from comment #2)

here are new recordings

https://drive.google.com/drive/folders/1GgbvSiXDC3F3INwQg5RWyUoEdSNkFSO8?usp=sharing

:rwood davehunt can you download and test these on your devices?

I see issues with these recordings. I think we should block on bug 1525280.

Flags: needinfo?(rwood)
Flags: needinfo?(dave.hunt)
Priority: -- → P1
Depends on: 1517195
Assignee: nobody → fstrugariu

Updated the recordings for amazon google and YouTube

See the recodings in the gdrive https://drive.google.com/drive/folders/1GgbvSiXDC3F3INwQg5RWyUoEdSNkFSO8?usp=sharing

For Facebook we have a empty test account. Do we want data in it?

Flags: needinfo?(dave.hunt)

Updated and ready for review/upload to tooltool

Status: NEW → ASSIGNED

These all look great to me. I downloaded them and tested locally. I had to stop the files downloaded from tooltool overriding the new recordings, but I just renamed the files so the downloaded ones were ignored.

So all we need to do is upload the new recordings to tooltool? Could you take care of that Rob?

Flags: needinfo?(dave.hunt) → needinfo?(rwood)

Uploaded to tooltool, emailed the manifests.

Flags: needinfo?(rwood)
Pushed by dhunt@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/3924d1ec16af
Review and update the raptor-tp6m-1 recordings r=davehunt
Status: ASSIGNED → RESOLVED
Closed: 10 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla67
Blocks: 1513847
You need to log in before you can comment on or make changes to this bug.