Closed Bug 1374333 Opened 4 years ago Closed 4 years ago

Ensure all Talos Pageloader tests can return Gecko Profiles for all processes when run with --geckoProfiler

Categories

(Testing :: Talos, enhancement, P1)

Product:
Testing
Component:
Talos
Type:
enhancement

Tracking

(firefox56 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla56
Iteration:
56.3 - Jul 24
Tracking Flags:
Tracking Status
firefox56 --- fixed

People

(Reporter: mconley, Assigned: mconley)

References

Details

(Whiteboard: [photon-performance][qa-])

Attachments

(19 files, 2 obsolete files)

Bug 1374333 - Make Pageloader use TalosParentProfiler.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler for profiling in tsvgx tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in tscroll tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - TalosParentProfiler should be initted if the Gecko Profiler is already active when loaded.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Allow TalosContentProfiler.js to pause and resume without initializing if the profiler should already be running in the parent.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Allow TalosContentProfiler.js to be loaded as both a frame script and as a normal DOM script.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Make pageloader start and capture profiles at better times.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosParentProfiler to fix profiling in damp tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in glterrain tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in glvideo tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in tpaint tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in tcanvasmark tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in basic_compositor_video tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in a11yr tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in bloom_basic tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Ensure we get profiles for all content processes for tps by waiting until the profiles are gathered before closing the tabs.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in kraken tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Use TalosContentProfiler to fix profiling in dromaeo tests.
59 bytes, text/x-review-board-request
rwood
: review+
Details
Bug 1374333 - Bump and sign new versions of TalosPowers, Pageloader, damp and tps.
59 bytes, text/x-review-board-request
rwood
: review+
Details 
At least for tsvgx, we only return samples for the content process that the test runs in, which isn't always useful.

At the very least, we want the main thread in the parent process and compositor thread as well.
I need this for bug 1357093.
Blocks: 1357093
Whiteboard: [photon-performance]
Assignee: nobody → mconley
Whiteboard: [photon-performance] → [photon-performance] [triage]
Status: NEW → ASSIGNED
Iteration: --- → 56.1 - Jun 26
Priority: -- → P1
Whiteboard: [photon-performance] [triage] → [photon-performance]
Iteration: 56.1 - Jun 26 → 56.2 - Jul 10
Attachment #8880585 - Attachment is obsolete: true
Attachment #8880586 - Attachment is obsolete: true
There's still more work to do here, but I think these patches in my stack are pretty stable and can be reviewed now.
Comment on attachment 8884447 [details]
Bug 1374333 - Allow TalosContentProfiler.js to pause and resume without initializing if the profiler should already be running in the parent.

https://reviewboard.mozilla.org/r/155358/#review160752
Attachment #8884447 - Flags: review?(rwood) → review+
Comment on attachment 8884448 [details]
Bug 1374333 - Allow TalosContentProfiler.js to be loaded as both a frame script and as a normal DOM script.

https://reviewboard.mozilla.org/r/155360/#review160774
Attachment #8884448 - Flags: review?(rwood) → review+
Comment on attachment 8880584 [details]
Bug 1374333 - TalosParentProfiler should be initted if the Gecko Profiler is already active when loaded.

https://reviewboard.mozilla.org/r/151912/#review160780
Attachment #8880584 - Flags: review?(rwood) → review+
Comment on attachment 8880581 [details]
Bug 1374333 - Make Pageloader use TalosParentProfiler.

https://reviewboard.mozilla.org/r/151906/#review160786

Looks great
Attachment #8880581 - Flags: review?(rwood) → review+
Comment on attachment 8880582 [details]
Bug 1374333 - Use TalosContentProfiler for profiling in tsvgx tests.

https://reviewboard.mozilla.org/r/151908/#review160846

LGTM
Attachment #8880582 - Flags: review?(rwood) → review+
Comment on attachment 8880583 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in tscroll tests.

https://reviewboard.mozilla.org/r/151910/#review160862

Looks great!
Attachment #8880583 - Flags: review?(rwood) → review+
Iteration: 56.2 - Jul 10 → 56.3 - Jul 24
Whiteboard: [photon-performance] → [photon-performance][qa-]
That last push was just a rebase.
Comment on attachment 8886400 [details]
Bug 1374333 - Make pageloader start and capture profiles at better times.

https://reviewboard.mozilla.org/r/157180/#review163554
Attachment #8886400 - Flags: review?(rwood) → review+
Comment on attachment 8886401 [details]
Bug 1374333 - Use TalosParentProfiler to fix profiling in damp tests.

https://reviewboard.mozilla.org/r/157182/#review163564
Attachment #8886401 - Flags: review?(rwood) → review+
Comment on attachment 8886402 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in glterrain tests.

https://reviewboard.mozilla.org/r/157184/#review163566
Attachment #8886402 - Flags: review?(rwood) → review+
Comment on attachment 8886403 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in glvideo tests.

https://reviewboard.mozilla.org/r/157186/#review163570
Attachment #8886403 - Flags: review?(rwood) → review+
Comment on attachment 8886404 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in tpaint tests.

https://reviewboard.mozilla.org/r/157188/#review163572
Attachment #8886404 - Flags: review?(rwood) → review+
Comment on attachment 8886405 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in tcanvasmark tests.

https://reviewboard.mozilla.org/r/157190/#review163574
Attachment #8886405 - Flags: review?(rwood) → review+
Comment on attachment 8886406 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in basic_compositor_video tests.

https://reviewboard.mozilla.org/r/157192/#review163578
Attachment #8886406 - Flags: review?(rwood) → review+
Comment on attachment 8886407 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in a11yr tests.

https://reviewboard.mozilla.org/r/157194/#review163580
Attachment #8886407 - Flags: review?(rwood) → review+
Comment on attachment 8886408 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in bloom_basic tests.

https://reviewboard.mozilla.org/r/157196/#review163582
Attachment #8886408 - Flags: review?(rwood) → review+
Comment on attachment 8886409 [details]
Bug 1374333 - Ensure we get profiles for all content processes for tps by waiting until the profiles are gathered before closing the tabs.

https://reviewboard.mozilla.org/r/157198/#review163600
Attachment #8886409 - Flags: review?(rwood) → review+
Comment on attachment 8886410 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in kraken tests.

https://reviewboard.mozilla.org/r/157200/#review163608
Attachment #8886410 - Flags: review?(rwood) → review+
Comment on attachment 8886411 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in dromaeo tests.

https://reviewboard.mozilla.org/r/157202/#review163610

::: testing/talos/talos/tests/dromaeo/webrunner.js:128
(Diff revision 2)
> -				}
> +					}
>  
> -				if ( pos < numTests ) {
> +					TalosContentProfiler.pause(name, true).then(() => {
> +					  // For making Median and Variance
> +					  if (runStyle === "runs/s") {
> +					  	times.push((runs * 1000) / (cur - start));

nit whitespace

::: testing/talos/talos/tests/dromaeo/webrunner.js:130
(Diff revision 2)
> -				if ( pos < numTests ) {
> +					TalosContentProfiler.pause(name, true).then(() => {
> +					  // For making Median and Variance
> +					  if (runStyle === "runs/s") {
> +					  	times.push((runs * 1000) / (cur - start));
> +					  } else {
> +					  	times.push(cur - start);

nit whitespace

::: testing/talos/talos/tests/dromaeo/webrunner.js:153
(Diff revision 2)
> -								
> +
>  				    	logTest(data);
> -			
> +
>  				    	dequeue();
> -				}
> +					}
> +          });

I'm a bit confused about the alignment here but probably just how it's displayed in mozreview perhaps
Attachment #8886411 - Flags: review?(rwood) → review+
Comment on attachment 8886412 [details]
Bug 1374333 - Bump and sign new versions of TalosPowers, Pageloader, damp and tps.

https://reviewboard.mozilla.org/r/157204/#review163628
Attachment #8886412 - Flags: review?(rwood) → review+
Comment on attachment 8886411 [details]
Bug 1374333 - Use TalosContentProfiler to fix profiling in dromaeo tests.

https://reviewboard.mozilla.org/r/157202/#review163610

> I'm a bit confused about the alignment here but probably just how it's displayed in mozreview perhaps

Ah - this file used tabs for spacing, and my editor was hiding that for some reason. Thanks! Will fix before landing.
Pushed by mconley@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/98897becd786
TalosParentProfiler should be initted if the Gecko Profiler is already active when loaded. r=rwood
https://hg.mozilla.org/integration/autoland/rev/6f6b8285c422
Make Pageloader use TalosParentProfiler. r=rwood
https://hg.mozilla.org/integration/autoland/rev/b06a06ed4dc7
Allow TalosContentProfiler.js to pause and resume without initializing if the profiler should already be running in the parent. r=rwood
https://hg.mozilla.org/integration/autoland/rev/e0c5dbd138a3
Allow TalosContentProfiler.js to be loaded as both a frame script and as a normal DOM script. r=rwood
https://hg.mozilla.org/integration/autoland/rev/aae4e051c61e
Use TalosContentProfiler for profiling in tsvgx tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/72e2133c617f
Use TalosContentProfiler to fix profiling in tscroll tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/311f05e3ff83
Make pageloader start and capture profiles at better times. r=rwood
https://hg.mozilla.org/integration/autoland/rev/a9613f4f4be8
Use TalosParentProfiler to fix profiling in damp tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/1de718bbd836
Use TalosContentProfiler to fix profiling in glterrain tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/3e1b3238f26e
Use TalosContentProfiler to fix profiling in glvideo tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/312f82111594
Use TalosContentProfiler to fix profiling in tpaint tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/6a3f9d54a1af
Use TalosContentProfiler to fix profiling in tcanvasmark tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/5e37209d792a
Use TalosContentProfiler to fix profiling in basic_compositor_video tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/fc35f3255fdd
Use TalosContentProfiler to fix profiling in a11yr tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/1b9006ceb449
Use TalosContentProfiler to fix profiling in bloom_basic tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/835edc46b6c5
Ensure we get profiles for all content processes for tps by waiting until the profiles are gathered before closing the tabs. r=rwood
https://hg.mozilla.org/integration/autoland/rev/ba3597e894b0
Use TalosContentProfiler to fix profiling in kraken tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/02dac72b6dd0
Use TalosContentProfiler to fix profiling in dromaeo tests. r=rwood
https://hg.mozilla.org/integration/autoland/rev/c9fc3cee2393
Bump and sign new versions of TalosPowers, Pageloader, damp and tps. r=rwood
Depends on: 1382638
You need to log in before you can comment on or make changes to this bug.