1860800 - Intermittent test_identify_retriggerables.py test_identify_retriggerables_selects_all_data_points assert {1, 2, 4, 7, 9} == {2, 4, 7, 9, 11}

Status: NEW

(Tree Management :: Perfherder, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Log: https://app.circleci.com/pipelines/github/mozilla/treeherder/5516/workflows/af879f29-b942-47b7-b097-5076b40ce581/jobs/22811

=================================== FAILURES ===================================
_____________ test_identify_retriggerables_selects_all_data_points _____________

gapped_performance_data = <QuerySet [<PerformanceDatum: 10.0 2013-11-13 13:00:43>, <PerformanceDatum: 10.0 2013-11-13 13:00:43>, <PerformanceDat...10.0 2013-11-13 16:05:42>, <PerformanceDatum: 10.0 2013-11-13 18:05:42>, <PerformanceDatum: 10.0 2013-11-13 18:31:38>]>
test_perf_alert = <PerformanceAlert: test_talos mozilla-central development 45f8637cb9f78f19cb8463ff174e81756805d8cf-9d54ce168c996edaf21...edb20462675ad6ea1 tttttttttttttttttttttttttttttttttttttttt mysuite mytest win win7 x86 2023-10-24 13:32:54.791591 0.5%>

    def test_identify_retriggerables_selects_all_data_points(gapped_performance_data, test_perf_alert):
        identify_retriggerables = IdentifyAlertRetriggerables(
            max_data_points=5, time_interval=ONE_DAY_INTERVAL
        )
        data_points_to_retrigger = identify_retriggerables(test_perf_alert)
    
        assert len(data_points_to_retrigger) == 5
>       assert {1, 2, 4, 7, 9} == set(map(get_key("job_id"), data_points_to_retrigger))
E       assert {1, 2, 4, 7, 9} == {2, 4, 7, 9, 11}
E         Extra items in the left set:
E         1
E         Extra items in the right set:
E         11
E         Use -v to get more diff

tests/perf/auto_perf_sheriffing/test_backfill_reports/test_identify_retriggerables.py:59: AssertionError