Bug 1892367 Comment 0 Edit History

Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.

Original comment by

Mayank Bansal

on 2024-04-18 19:36:20 PDT

See these:
[4.5% on Flight-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912886,1875293250&series=autoland,3912886,1,13&timerange=5184000&zoom=1713029747143,1713521955846,23.58175106062141,27.74770735419264)
[4% on AngularJS-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912836,1875293184&series=autoland,3912836,1,13&timerange=5184000&zoom=1712586974055,1713532062257,63.903644185365415,74.52132404389101)
[4.5% on Elm-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912856,1875293206&series=autoland,3912856,1,13&timerange=5184000&zoom=1712557493513,1713576429567,41.86828949172824,48.67660842554008)
[4.6% on inferno-todomvc](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912896,1875293269&series=autoland,3912896,1,13&timerange=5184000&zoom=1713153197305,1713448546814,59.88246467380898,70.45432669964958)
[3%-4% on React-Redux-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&series=autoland,3912916,1,13&timerange=5184000&zoom=1712995726429,1713517516008,53.481640840013824,60.80947973851362)
[5% on React-todomvc](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912926,1875293299&series=autoland,3912926,1,13&timerange=5184000&zoom=1712994180858,1713492621545,21.797733931207187,25.01402521244919)

In all these cases, after the sudden spike of regression, the numbers do improve a bit. But maybe they are still a bit worse than the previous baseline.

REgression range: https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=7900ea0538965c6aba695fd896a6e2833d781007&tochange=acabdf625d68e5d96c49e0eebb5c71f4286e5ffd
Alert: https://treeherder.mozilla.org/perfherder/alerts?id=42297

Suspect: bug 1888748

Revision 1 by

Mayank Bansal

on 2024-04-18 19:37:47 PDT

See these:
[4.5% on Flight-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912886,1875293250&series=autoland,3912886,1,13&timerange=5184000&zoom=1713029747143,1713521955846,23.58175106062141,27.74770735419264)
[4% on AngularJS-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912836,1875293184&series=autoland,3912836,1,13&timerange=5184000&zoom=1712586974055,1713532062257,63.903644185365415,74.52132404389101)
[4.5% on Elm-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912856,1875293206&series=autoland,3912856,1,13&timerange=5184000&zoom=1712557493513,1713576429567,41.86828949172824,48.67660842554008)
[4.6% on inferno-todomvc](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912896,1875293269&series=autoland,3912896,1,13&timerange=5184000&zoom=1713153197305,1713448546814,59.88246467380898,70.45432669964958)
[3%-4% on React-Redux-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&series=autoland,3912916,1,13&timerange=5184000&zoom=1712995726429,1713517516008,53.481640840013824,60.80947973851362)
[5% on React-todomvc](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912926,1875293299&series=autoland,3912926,1,13&timerange=5184000&zoom=1712994180858,1713492621545,21.797733931207187,25.01402521244919)

In all these cases, after the sudden spike of regression, the numbers do improve a bit. But maybe they are still a bit worse than the previous baseline.

REgression range: https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=7900ea0538965c6aba695fd896a6e2833d781007&tochange=acabdf625d68e5d96c49e0eebb5c71f4286e5ffd
Alert: https://treeherder.mozilla.org/perfherder/alerts?id=42297 (though these are  all improvements)

Suspect: bug 1888748

Revision 2 by

Mayank Bansal

on 2024-04-18 20:05:30 PDT

See these:
[4.5% on Flight-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912886,1875293250&series=autoland,3912886,1,13&timerange=5184000&zoom=1713029747143,1713521955846,23.58175106062141,27.74770735419264)
[4% on AngularJS-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912836,1875293184&series=autoland,3912836,1,13&timerange=5184000&zoom=1712586974055,1713532062257,63.903644185365415,74.52132404389101)
[4.5% on Elm-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912856,1875293206&series=autoland,3912856,1,13&timerange=5184000&zoom=1712557493513,1713576429567,41.86828949172824,48.67660842554008)
[4.6% on inferno-todomvc](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912896,1875293269&series=autoland,3912896,1,13&timerange=5184000&zoom=1713153197305,1713448546814,59.88246467380898,70.45432669964958)
[3%-4% on React-Redux-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&series=autoland,3912916,1,13&timerange=5184000&zoom=1712995726429,1713517516008,53.481640840013824,60.80947973851362)
[5% on React-todomvc](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912926,1875293299&series=autoland,3912926,1,13&timerange=5184000&zoom=1712994180858,1713492621545,21.797733931207187,25.01402521244919)

In all these cases, after the sudden spike of regression, the numbers do improve a bit. But maybe they are still a bit worse than the previous baseline.

REgression range: https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=7900ea0538965c6aba695fd896a6e2833d781007&tochange=acabdf625d68e5d96c49e0eebb5c71f4286e5ffd
Alert: https://treeherder.mozilla.org/perfherder/alerts?id=42297 (though these are  all improvements)

Semi-random Suspect: bug 1888748

Revision 3 by

Mayank Bansal

on 2024-04-25 19:33:21 PDT

See these:
[4.5% on Flight-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912886,1875293250&series=autoland,3912886,1,13&timerange=5184000&zoom=1713029747143,1713521955846,23.58175106062141,27.74770735419264)
[4% on AngularJS-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912836,1875293184&series=autoland,3912836,1,13&timerange=5184000&zoom=1712586974055,1713532062257,63.903644185365415,74.52132404389101)
[4.5% on Elm-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912856,1875293206&series=autoland,3912856,1,13&timerange=5184000&zoom=1712557493513,1713576429567,41.86828949172824,48.67660842554008)
[4.6% on inferno-todomvc](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912896,1875293269&series=autoland,3912896,1,13&timerange=5184000&zoom=1713153197305,1713448546814,59.88246467380898,70.45432669964958)
[3%-4% on React-Redux-TodoMVC](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&series=autoland,3912916,1,13&timerange=5184000&zoom=1712995726429,1713517516008,53.481640840013824,60.80947973851362)
[5% on React-todomvc](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=3912926,1875293299&series=autoland,3912926,1,13&timerange=5184000&zoom=1712994180858,1713492621545,21.797733931207187,25.01402521244919)

In all these cases, after the sudden spike of regression, the numbers do improve a bit. But maybe they are still a bit worse than the previous baseline.

REgression range: https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=7900ea0538965c6aba695fd896a6e2833d781007&tochange=acabdf625d68e5d96c49e0eebb5c71f4286e5ffd
Alert: https://treeherder.mozilla.org/perfherder/alerts?id=42365

Semi-random Suspect: bug 1888748

Back to Bug 1892367 Comment 0