Improve speed of import_perf_data script using bulk_create



3 years ago
3 years ago


(Reporter: wlach, Assigned: vakila, Mentored)



(Whiteboard: perfherder-starter-bug)

User Story

Thank you for helping out with Treeherder!

You can find us on IRC at irc://

Here's some links to help get you started.

Project page:

Interacting with us, repo locations and links to set up a development version of the software:

A-Team general reference, coding style guides:


(1 attachment)

We have a command in perfherder for importing performance data from an existing instance of treeherder/perfherder. The import_perf_data script in perfherder's speed could be improved if we inserted the performance datum objects in bulk.

You can see an example of where we used to do this here in a deprecated migration script:

The file you want to modify is `treeherder/perf/management/commands/`. Specifically around here:

To test your change, set up a development instance of treeherder per the user story, then from vagrant ssh, run:

./ import_reference_data  # required to view performance data
./ import_perf_data --interval 2592000 --filter-props suite:tcheck2 mozilla-central
I'd like to mentor this bug. If you're not new to treeherder/perfherder, please don't take this. :) It's meant to be a simple launching off point to doing further treeherder development.
Mentor: wlachance
Whiteboard: perfherder-starter-bug
Created attachment 8731799 [details] [review]
[treeherder] vakila:perf-data-bulk > mozilla:master
Assignee: nobody → anjanavakil


3 years ago
Attachment #8731799 - Flags: review?(wlachance)
Keywords: autoland
Comment on attachment 8731799 [details] [review]
[treeherder] vakila:perf-data-bulk > mozilla:master

Looks great now, thanks!
Attachment #8731799 - Flags: review?(wlachance) → review+
Keywords: autoland
Last Resolved: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.