All users were logged out of Bugzilla on October 13th, 2018

Move job classifications to a Django model

RESOLVED FIXED

Status

RESOLVED FIXED
3 years ago
2 years ago

People

(Reporter: wlach, Assigned: wlach)

Tracking

Details

Attachments

(1 attachment)

The job note tables need to be migrated away from datasource and moved into the central database for us to fix bug . I'm hoping this will also make the classification code easier to extend and maintain.
We should add this after bug 1265037 is fixed, so we have a fixed reference point to the per-project jobs table (until we migrate that into the master db as well).
Depends on: 1265037
Created attachment 8760502 [details] [review]
[treeherder] wlach:1266062 > mozilla:master
Comment on attachment 8760502 [details] [review]
[treeherder] wlach:1266062 > mozilla:master

Hey James, do you want to take a look at this and let me know what you think? One potentially controversial change is that I removed the "type" field from bug job map. We identify the "type" of a classification/bug job map based on whether the user is set (if it isn't => it is autoclassified).

I don't think it makes sense to land this change until after Q2 is over, so no rush.
Attachment #8760502 - Flags: feedback?(james)
Comment on attachment 8760502 [details] [review]
[treeherder] wlach:1266062 > mozilla:master

I didn't look in huge amounts of detail, but what I saw looks great.
Attachment #8760502 - Flags: feedback?(james) → feedback+
Comment on attachment 8760502 [details] [review]
[treeherder] wlach:1266062 > mozilla:master

Addressed comments and split out ORM additions into a seperate commit.
Attachment #8760502 - Flags: review?(james)

Updated

2 years ago
Assignee: nobody → wlachance
Blocks: 1281820
Attachment #8760502 - Flags: review?(james) → review+

Comment 6

2 years ago
Commits pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/db2ccb44f4a41c34ad18dae5f384b59a782c1225
Bug 1266062 - Add bug job map, job note ORM models + migrations

https://github.com/mozilla/treeherder/commit/c44c2582950b57104f9de6bc9050cca1bc9d870e
Bug 1266062 - Move bug job map ingestion / queries to Django ORM

https://github.com/mozilla/treeherder/commit/5335bf41631aa7c7e2480be245b08f947d69c73a
Bug 1266062 - Move job note ingestion / queries to Django ORM

https://github.com/mozilla/treeherder/commit/e4797b92ea17559f7f280e2a174a36583216ada2
Merge pull request #1568 from wlach/1266062

Bug 1266062 - Move bug job map and job notes to ORM from datasource

Comment 7

2 years ago
Commit pushed to master at https://github.com/mozilla/treeherder

https://github.com/mozilla/treeherder/commit/9a710210cf850305172baaa746ee0158c9b14c99
Bug 1266062 - Handle non-ascii note text when migrating legacy job notes
This is now in production!
Status: NEW → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → FIXED
I don't suppose you could also run the management command against the Heroku stage instance? (Plus the prototype, though you'll need to wait for James to rebase the custom branch onto master, since it's not on auto-deploy of master)

If it helps, these aliases speed up running Heroku commands against each app:

alias thh="HEROKU_APP=treeherder-heroku heroku"
alias ths="HEROKU_APP=treeherder-stage heroku"
alias thp="HEROKU_APP=treeherder-prod heroku"

Then eg:

ths run ./manage.py ...

(Heroku prod doesn't have a DB yet, so no need to run against that).

Thanks :-)
Flags: needinfo?(wlachance)
(In reply to Ed Morley [:emorley] from comment #10)
> I don't suppose you could also run the management command against the Heroku
> stage instance? (Plus the prototype, though you'll need to wait for James to
> rebase the custom branch onto master, since it's not on auto-deploy of
> master)
> 
> If it helps, these aliases speed up running Heroku commands against each app:
> 
> alias thh="HEROKU_APP=treeherder-heroku heroku"
> alias ths="HEROKU_APP=treeherder-stage heroku"
> alias thp="HEROKU_APP=treeherder-prod heroku"
> 
> Then eg:
> 
> ths run ./manage.py ...
> 
> (Heroku prod doesn't have a DB yet, so no need to run against that).
> 
> Thanks :-)

Done on stage. Not sure if it's important on the prototype, unless we have manually classified data there that we want to preserve?
Flags: needinfo?(wlachance)
Thank you. Agreed, let's skip the prototype.

Updated

2 years ago
Blocks: 1284444

Updated

2 years ago
Depends on: 1287930

Updated

2 years ago
Depends on: 1289354
You need to log in before you can comment on or make changes to this bug.