1272925 - Only broken slaves hit bootstrapSvc.js | shouldRunServiceTest - [shouldRunServiceTest : 1745] the updater.exe binary should be signed (if not, build system configuration bug?) - false == true

Status: RESOLVED WORKSFORME

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Phil Ringnalda (:philor)]

These have been happening (quite infrequently), and being ignored, for at least several days now.

https://treeherder.mozilla.org/logviewer.html#?job_id=9345886&repo=fx-team

Comment 1

[Robert Strong (they/them - no direct email)]

bhearsum, nthomas: any idea why the test binary stopped getting signed?

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

The example job was rerun at https://treeherder.mozilla.org/logviewer.html#?job_id=9347705&repo=fx-team and was green. Since the only difference should be a different test machine I'll move this over to our product/component.

rstrong, does this test rely on having the maintenance service registry keys being set ?

Buildduty, could you please check if t-xp32-ix-002 has a history of failing xpcshell jobs. It could be a machine that has lost some registry entries, or is otherwise borken. It doesn't appear to have been re-imaged recently. Please also scan treeherder for other xpcshell failures to see if other slaves are affected.

Comment 4

[Phil Ringnalda (:philor)]

I was a tiny bit off in comment 0: this slave has failed every xpcshell test run it has taken since December 17th.

Comment 5

[Andrei Obreja [:aobreja NOT AVAILABLE][:buildduty]]

After monitoring  xpcshell job in the last few days it seems there is no issue with bootstrapSvc.js. Below can be seen the latest tests that run and most of them were successfully:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&filter-searchStr=windows%20xp%20debug%20xpcshell&fromchange=efb43f34c4f59851f4b5416769c423b504b11b24&selectedJob=28346491

While doing some investigations on t-xp32-ix-002, I was wondering if you could share how you found out that this slave failed every xpcshell job since December 17th. The thing is that I am only able to see the statistics for this job for a limited amount of days. :-)

Comment 6

[Phil Ringnalda (:philor)]

https://secure.pub.build.mozilla.org/buildapi/recent/t-xp32-ix-002 gives you 25 jobs, but adding ?numbuilds=100 gives you 100 which you can then filter down to just xpcshell with the search box, and numbuilds will take a high enough number that you will often kill buildapi by doing so (which makes doing it a Very Bad Thing), but eventually can load enough to see that it hasn't had a passing run since last December.

Comment 7

[Andrei Obreja [:aobreja NOT AVAILABLE][:buildduty]]

Thank you Phil for the hint.

Comment 8

[Andrei Obreja [:aobreja NOT AVAILABLE][:buildduty]]

Seems that lately most of xpcshell jobs runned without problem.

Comment 9

[Intermittent Failures Robot]

1 failures in 1008 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* windows7-32-vm: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1272925&startday=2017-07-24&endday=2017-07-30&tree=all