1926014 - Alert not generated for regression on 9oct2024

Status: RESOLVED FIXED

(Testing :: Performance, defect, P2)

Description

[Mayank Bansal]

See this : https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=4767279,112655719&series=autoland,4767279,1,1&timerange=2592000&zoom=1728388746889,1728475350633,862.5205051379721,1354.9502654192895

AR: The regression is large, but no alert was generated.
ER: An alert should be generated

Comment 1

[Mayank Bansal]

The corresponding change on sw-wr did generate an alert : https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&selected=4767423,114349792&series=autoland,4767423,1,1&timerange=1209600&zoom=1728428503021,1728428785143,854.43535509099,1146.6013054109314

It feels like some of the jobs just didnt run on Linux with hw-wr??

Comment 2

[Mayank Bansal]

For ref:

https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=1&replicates=0&series=autoland,4767279,1,1&timerange=2592000&zoom=1727011805622,1729618288412,560.2222222222222,1615.7777777777778

https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=1&replicates=0&selected=4767279,121724639&series=autoland,4767279,1,1&timerange=1209600&zoom=1728407071278,1728799338096,565.1869322832893,1586.291591627925

Comment 3

[Greg Mierzwinski [:sparky]]

Hi Mayank, it looks like the second graph link is broken now. Would you be able to recreate it? I recall that that one was the one that showed an alert for the non-swr test.

Comment 4

[Mayank Bansal]

Link for Comment #1

Link for comment #2

Comment3 : Link1 and Link2

Though I have somewhat forgotten the conversation we had. All I do remember now is that the Link in comment #1 did not generate an Alert for the clear regression on "Wed Oct 09 05:37:44 2024 +0000"

Comment 5

[Greg Mierzwinski [:sparky]]

Thanks Mayank! It doesn't look like we can reproduce what we were seeing, and it might have been a bug in the graphs view. That said, I did find an issue related to performance alert ingestion/creation in the Treeherder DB so that might be related to this bug.

Comment 6

[Mayank Bansal]

Should this bug be closed then?

Comment 7

[BugBot [:suhaib / :marco]]

The severity field is not set for this bug.
:sparky, could you have a look please?

For more information, please visit BugBot documentation.

Comment 8

[Greg Mierzwinski [:sparky]]

Yes, lets close it as WONTFIX. I'm pretty sure it was caused by the DB issues we had which are now fixed. Thanks again for catching this!