760574 - add replay tests to Talos

Status: RESOLVED FIXED

(Testing :: Talos, defect)

Description

[Jeff Hammel]

https://bugs.webkit.org/show_bug.cgi?id=84008 gives some browser
independent record-replay tests that we should start using at
bugzilla.  I'm recording this as a Talos bug, though I'm not 100% sure
if that is the best framework for it ... it is just where we have done
most of the performance work in this area.

Comment 1

[cmtalbert]

I think this needs a better description.

Our "real page" loading test suite is Tp5 and cannot be distributed due to the same issues that Google and Apple face with regard to copyright. So, this will give us the ability to create a page set on the fly from archive.org and run it in talos thus creating a purely public page set that can be used for page-load performance tests. This will be done in addition to (not as a replacement of) our existing Tp tests.

Did I get that mostly right?

Comment 2

[Jeff Hammel]

Yep; and also to have a(nother) suite that we can compare to webkit and any other engine that wishes to use this pageset.

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

I don't know about real time page set creation, but that would be cool.

I suspect we could use this and reduce the number of pages in tp5/6 since we would be duplicating efforts.  I am thinking tp6 would be the top25 pages if we had this archive.org cross browser suite for core page loading.

Comment 4

[Joel Maher ( :jmaher ) (UTC -8)]

we implemented this recently