1980743 - intermittent test_identify_retriggerables_selects_even_single_data_point - assert {4} == {92}

Status: NEW

(Tree Management :: Perfherder, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Observed this twice in CI last week.

Log: https://app.circleci.com/pipelines/github/mozilla/treeherder/8919/workflows/0c1561f5-64ca-4ebb-8baf-0e91aa9c5e99/jobs/38210

=================================== FAILURES ===================================
_________ test_identify_retriggerables_selects_even_single_data_point __________

single_performance_datum = <QuerySet [<PerformanceDatum: 10.0 2024-11-02 16:29:00>, <PerformanceDatum: 10.0 2024-11-02 16:29:00>, <PerformanceDat...10.0 2024-11-02 16:29:00>, <PerformanceDatum: 10.0 2024-11-02 16:29:00>, <PerformanceDatum: 10.0 2024-11-02 16:29:00>]>
test_perf_alert = <PerformanceAlert: test_talos mozilla-central development 9c6e4c31ad26efdad0b9af47a2b530bc414ce2c3-9994bf4500967f92c9a...bf142978c7bd88f4b tttttttttttttttttttttttttttttttttttttttt mysuite mytest win win7 x86 2025-08-01 15:39:45.438225 0.5%>

    def test_identify_retriggerables_selects_even_single_data_point(
        single_performance_datum, test_perf_alert
    ):
        identify_retriggerables = IdentifyAlertRetriggerables(
            max_data_points=5, time_interval=ONE_DAY_INTERVAL
        )
        data_points_to_retrigger = identify_retriggerables(test_perf_alert)
    
        assert len(data_points_to_retrigger) == 1
>       assert {4} == set(map(get_key("job_id"), data_points_to_retrigger))
E       assert {4} == {92}
E         
E         Extra items in the left set:
E         4
E         Extra items in the right set:
E         92
E         Use -v to get more diff

tests/perf/auto_perf_sheriffing/test_backfill_reports/test_identify_retriggerables.py:84: AssertionError