1936866 - Scrape symbols for ARM 64-bit Debian and Ubuntu packages times out because of slow mirror holding the MozillaTeam PPA packages

Status: NEW

(Toolkit :: Crash Reporting, task)

Description

[Gabriele Svelto [:gsvelto]]

As per title, we just need to check that they apply to the crashes we have on file.

Comment 1

[Jed Davis [:jld] ⟨⏰|UTC-7⟩ ⟦he/him⟧]

I was looking at this and got as far as editing the script for Debian and confirming that it generates symbols for arm64. I don't know if I have the API permissions to reprocess crashes, but I can try running minidump-stackwalk locally. On the other hand, it's a pretty simple change so if you're already working on it then that's fine.

Edit: Never mind; I see there's already a branch in symbol-scrapers about this.

Comment 2

[Gabriele Svelto [:gsvelto]]

Yeah, the change is trivial but I also added a change that affects how we generate the archives to speed up the process, otherwise the task will time out because of the sheer amount of stuff it needs to zip up before submission.

Comment 3

[Gabriele Svelto [:gsvelto]]

After some testing I came to the conclusion that keeping the scraping tasks as-is is unfeasible. The Ubuntu tasks in particular are very slow because of one particularly slow mirror holding the MozillaTeam PPA packages. Scraping packages for three architectures takes several hours forcing unacceptable durations for the tasks. Fedora can also be problematic in terms of size, though not as much as Ubuntu. What we can do is split the tasks on a per-architecture basis, this would make them manageable. This way instead of a single "distro" task we'd have three separate ones like "distro/x86", "distro/amd64" and "distro/arm64", each with a more reasonable runtime.

Comment 4

[Gabriele Svelto [:gsvelto]]

FYI since running these tasks as they are would time out the jobs on TaskCluster, I've been running them locally every day. I'll get around to do this as soon as I have some spare cycle, but in the meantime we'll still have the symbols.

Comment 5

[Wayne Mery (:wsmwk)]

Thanks !

Comment 6

[Wayne Mery (:wsmwk)]

(In reply to Gabriele Svelto [:gsvelto] from comment #4)

FYI since running these tasks as they are would time out the jobs on TaskCluster, I've been running them locally every day. I'll get around to do this as soon as I have some spare cycle, but in the meantime we'll still have the symbols.

Is this still the case, i.e. current symbols are still available?

Comment 7

[Gabriele Svelto [:gsvelto]]

Yes, I've kept scraping symbols manually every day for those platforms. I believe that in the meantime Ubuntu's PPA server got better so I might add them to automation soon.