Closed Bug 1059400 (treeherder-dev-transition) Opened 6 years ago Closed 5 years ago

Treeherder Milestone 4: Make TBPL redundant for all users

Categories

(Tree Management :: Treeherder, defect, P2)

defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: jgriffin, Assigned: emorley)

References

Details

(Keywords: meta)

This bug tracks issues that sheriffs need to have fixed, but which can wait until after the transition...i.e., they don't block sheriffing transition itself.
Alias: treeherder-need
Depends on: 1059279
Depends on: 1033269
Depends on: 1042613
Depends on: 1042605
Depends on: 1042706
Depends on: 1042751
Depends on: 1042590
Depends on: 1053279
Blocks: 1050133
Depends on: 1057341
Depends on: 1045609
Depends on: 1046759
Depends on: 1045602
Depends on: 1042077
Depends on: 1059322
Depends on: 1059317
Depends on: 1059286
Depends on: 1042737
Depends on: 1032499
Depends on: 1057260
No longer blocks: 1050133
Depends on: 1050133
Depends on: 1059300
Depends on: 1033264
Depends on: 1059847
Depends on: 1057347
Depends on: 1060265
Depends on: 1060302
Depends on: 1060448
Depends on: 1060456
Depends on: 1043474
Depends on: 1060328
Depends on: 1045846
Depends on: 1060477
Depends on: 1060482
Depends on: 1059368
Depends on: 1057364
Depends on: 1057420
Depends on: 1060761
Depends on: 1060769
Depends on: 1061758
Depends on: 1059325
Blocks: tbpl-eol
Depends on: 1057381, 1059909, 1061681
Summary: Treeherder bugs that sheriffs need fixed ASAP post-transition → Treeherder regressions compared to TBPL that need fixing ASAP post-transition
Depends on: 1035220
Summary: Treeherder regressions compared to TBPL that need fixing ASAP post-transition → Non-blocking Treeherder regressions that will be fixed ASAP post-transition
Depends on: 1035222
Depends on: 1053228
Depends on: 1046226
No longer depends on: 1060769
No longer depends on: 1060482
Depends on: 1061669
Depends on: 1062398
No longer depends on: 1057341
Depends on: 1063411
Depends on: 1064616
Depends on: 1065051
Depends on: 1065541
Depends on: 1065650
Depends on: 1066314
Depends on: 1066398
Depends on: 1066402
Depends on: 1066149
Depends on: 1066989
Depends on: 1066997
Depends on: 1067262
Depends on: 1067273
Depends on: 1067481
Depends on: 1067485
Depends on: 1067486
Depends on: 1067844
Depends on: 1067846
No longer depends on: 1059286
Depends on: 1067854
Depends on: 1067892
Depends on: 1065775
Depends on: 1068529
Depends on: 1068532
Depends on: 1043741
Depends on: 1068685
Depends on: 1068810
Depends on: 1069267
Depends on: 1069283
Depends on: 1069293
Depends on: 1069370
Depends on: 1069385
Depends on: 1069389
Depends on: 1069467
Depends on: 1070200
Depends on: 1063923
Depends on: 1067482
Depends on: 1068765
Depends on: 1070964
Depends on: 1071002
Depends on: 1067579
Depends on: 971467
Depends on: 1066324
Depends on: 1071092
Depends on: 1071240
Depends on: 1071334
Depends on: 1071541
Depends on: 1071681
Depends on: 1071876
Depends on: 1072159
Depends on: 1072161
Depends on: 1072189
Depends on: 1072346
Depends on: 1072422
Depends on: 1072437
Depends on: 1072447
No longer depends on: 1069293
No longer depends on: 1067262
No longer depends on: 1072437
No longer depends on: 1071092
No longer depends on: 1071541
Alias: treeherder-need → treeherder-regress
No longer depends on: 1042605, 1066377, 1066398
Summary: Non-blocking Treeherder regressions that will be fixed ASAP post-transition → Non-blocking Treeherder regressions compared to TBPL
Depends on: 1073050
Depends on: 1073409
Depends on: 1072377
Depends on: 1073130
Depends on: 1073151
Depends on: 1073170
Depends on: 1071306
Depends on: 1074657
Depends on: 1074539
Depends on: 1074385
Depends on: 1074851
Depends on: 1074858
Depends on: 1074837
Depends on: 1074905
Depends on: 1074927
Depends on: 1074939
Depends on: 1074953
Depends on: 1074958
Depends on: 1074964
Depends on: 1074972
Depends on: 1075176
Depends on: 1075237
Depends on: 1075222
Depends on: 1075301
Depends on: 1075272
Depends on: 1075463
Depends on: 1075473
No longer depends on: 1068532
Depends on: 1068532
Depends on: 1075584
Depends on: 1076720
Depends on: 1076040
Depends on: 1076750
Depends on: 1076752
No longer depends on: 1072422
Depends on: 1076761
Depends on: 1076769
No longer depends on: 1059325
Depends on: 1076774
Depends on: 1076776
Depends on: 1075799
Depends on: 1076812
Depends on: 1076826
Depends on: 1076824
Depends on: 1076840
Depends on: 1076960
No longer depends on: 1076812
Depends on: 1076963
Depends on: 1076980
Depends on: 1077337
Depends on: 1077338
Depends on: 1077341
Depends on: 1077382
Depends on: 1078209
Depends on: 1078239
Depends on: 1077635
Depends on: 1078081
No longer depends on: 1076960
Depends on: 1077136
Depends on: 1078332
Depends on: 1078415
No longer depends on: 1075580
Depends on: 1078700
Depends on: 1075639
Depends on: 1078265
Depends on: 1075527
Depends on: 1078670
Depends on: 1079270
Depends on: 1079737
Depends on: 1079765
No longer depends on: 1079765
Depends on: 1079867
Depends on: 1079900
Depends on: 1079991
Depends on: 1079984
Depends on: 1080161
Depends on: 1080408
Depends on: 1080511
Depends on: 1081041
Depends on: 1081191
Depends on: 1081198
Depends on: 1081557
Depends on: 1081600
No longer depends on: 1081557
Depends on: 1081587
Depends on: 1081554
Depends on: 1082232
Depends on: 1082240
Depends on: 1069474
Depends on: 1082693
Depends on: 1082966
Depends on: 1083206
Tweaking summary, since "not blocking" was referring to the "not blocking the sheriff transition", whereas this does block the transition of non-sherifs / TBPL EOL (bug 1054977) etc.
Summary: Non-blocking Treeherder regressions compared to TBPL → Treeherder regressions compared to TBPL
Removing the sheriffs alias to avoid spamming it; please re-CC if you aren't following this component and wish to track changes here.
Depends on: 1083305
Depends on: 1082707
No longer depends on: 1079737
Depends on: 1084086
Depends on: 1084493
Depends on: 1083736
Depends on: 1085100
Depends on: 1085030
Depends on: 1084657
Depends on: 1085548
Depends on: 1085649
Depends on: 1085682
Depends on: 1085725
Depends on: 1085531
No longer depends on: 1085548
Depends on: 1086601
No longer depends on: 1086601
Depends on: 1086663
Depends on: 1087341
Depends on: 1087349
Depends on: 1087386
Depends on: 1087915
Depends on: 1086702
Depends on: 1087650
Depends on: 1087997
Depends on: 1082771
No longer depends on: 1087997
No longer depends on: 1042751
No longer depends on: 1076750
No longer depends on: 1076826
No longer depends on: 1085682
No longer depends on: 1079270
No longer depends on: 1069467
No longer depends on: 1076761
No longer depends on: 1074927
Depends on: 1088970
Depends on: 1088822
No longer depends on: 1081198
Depends on: 1089020
No longer depends on: 1075473
Depends on: 1090301
Depends on: 1090317
Depends on: 1077554
Depends on: 1090531
Depends on: 1091643
Depends on: 1092339
Depends on: 1093743
After discussions at the Treeherder work week, we came to the conclusion that some of the meta bugs we've been using were really poor substitutes for other Bugzilla features & should be replaced by a combination of new Bugzilla {components, keywords, ...}.

Also, I don't think it's realistic (or desirable) to block TBPL EOL on every single Treeherder regression compared to TBPL, since:
1) Even if Treeherder has some regressions, it currently does have advantages over TBPL (and over time the ratio will get even better), so people will likely switch over anyway. At which point if no-one if using TBPL, those remaining minor regressions are no longer blocking EOL.
2) We're going to reach a point where we care less about the remaining regressions than adding new features that we've wanted for ages in TBPL. At which point, bucketing bugs by whether they are a regression or not adds little value from a triaging POV, since we'll be judging by the bug's priority field instead (which will take into account all factors). 

As such, I believe we should:
a) Morph this bug to be about only _blockers_ for all remaining devs/users of TBPL transitioning to Treeherder (as well as use-cases for which people have to fall back to TBPL), rather than all possible regressions.
b) Instead use the keyword "regression" to denote regressions from TBPL, rather than having a meta bug. This will allow us to surface the same list of bugs that this meta bug did.

Bugs for tools switching from consuming TBPL's API to Treeherder's will continue to block bug 1054977 instead of this one.

Adjusting summary based on:
https://wiki.mozilla.org/Auto-tools/Projects/Treeherder#Roadmap

Over the coming days I'll start removing bugs from the dependency list here - if anyone is still using TBPL and I remove a bug which is blocking their transition (or the cause for them to have to occasionally go back to TBPL for a particular workflow), please re-add it and let me know :-)
Alias: treeherder-regress → treeherder-all-transition
Keywords: meta
Summary: Treeherder regressions compared to TBPL → Treeherder Milestone 4: Make TBPL redundant for all users
Alias: treeherder-all-transition → treeherder-user-transition
No longer depends on: 1067485
No longer depends on: 1061681, 1078415, 1076840
No longer depends on: 1081554, 1074958
No longer depends on: 1059300, 1074939
No longer depends on: 1077338
No longer depends on: 1087915, 1045609
No longer depends on: 1033269, 1077382
No longer depends on: 1074866
No longer depends on: 1074953, 1076963
No longer depends on: 1076824, 1079867
No longer depends on: 1087341
No longer depends on: 1060456, 1069474
No longer depends on: 1078700, 1087349
No longer depends on: 1042737
No longer depends on: 1085100
No longer depends on: 1081600, 1042077
No longer depends on: 1073409
No longer depends on: 1077337, 1069385
No longer depends on: 1081191
No longer depends on: 1068810
No longer depends on: 1057260, 1042706
No longer depends on: 1078332, 1062398
No longer depends on: 1059909
No longer depends on: 1065617, 1074385
No longer depends on: 1060761
No longer depends on: 1059368, 1057420
No longer depends on: 1079900, 1084086
No longer depends on: 1079991
No longer depends on: 1069370
No longer depends on: 1075237
No longer depends on: 1085649
No longer depends on: 1087650
No longer depends on: 1075222
No longer depends on: 1067844
No longer depends on: 1053228
No longer depends on: 1042613
No longer depends on: 1084493
Alias: treeherder-user-transition → treeherder-dev-transition
Depends on: 1100328
Depends on: 1095141
No longer depends on: 1050133
Depends on: 1113142
No longer depends on: 1080161
Priority: -- → P2
Depends on: 1117183
No longer depends on: 1071081
No longer depends on: 1085725
Bug 1117183 has a Google form survey for asking devs what remaining issues are blocking any of them from moving to Treeherder. The aim is to send it out roughly at the end of this week (hoping to catch a few more low-hanging-fruit fixes to Treeherder first) and then use the results to prune/add to the deps of this bug, so the scope of the task is better known.

I'll update this bug when we know more :-)
No longer depends on: 1086702
Depends on: 1122680
No longer depends on: 1093743
No longer depends on: 1113142
No longer depends on: 1082240
No longer depends on: 1081587
Whilst we still have a number of papercuts/regressions in Treeherder compared to TBPL (and in an ideal world we'd like to fix them all as soon as possible), the current situation is:
* the jobs in TBPL are no longer sheriffed
* TBPL no longer has an accurate view of the current state of the trees, since we now have job data coming from sources other than buildbot (eg taskcluster) - and these jobs don't show up on TBPL at all
* The visibility profiles are now quite out of sync on TBPL, so it's not clear what's expected to be green or not
* New job/platform types aren't recognised by TBPL
* There is pressure from above to turn off TBPL to free up resources
* The survey results in bug 1117183 didn't mention many of the issues that are deps of this bug, nor anything major blocker wise that we didn't already know
* Most users have already moved to Treeherder - so our fixing of the TBPL->Treeherder regressions is actually orthogonal when it comes to determining TBPL EOL.

Given the above, I'm trimming down the list of deps of this bug quite substantially. 

Per the Treeherder meeting on Thursday 5th March, we also wish to try and EOL TBPL by the end of the quarter (ie: 31st March).
Assignee: nobody → emorley
No longer depends on: 1053279
All dependant bugs are fixed. 
There are a few more non-treeherder tasks remaining, as deps of the parent of this bug, bug 1054977.
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.