1207548 - Mochitest xulrunner-sdk-40.zip doesn't contain ssltunnel

Status: RESOLVED FIXED

(Testing :: Mochitest, defect, P1)

Description

[John Dai[:jdai]]

I saw ssltunnel came from xulrunner-sdk-40.zip[1], but in TC this zip file doesn't contain ssltunnel.[2] 

[1] https://dxr.mozilla.org/mozilla-central/source/testing/taskcluster/tasks/tests/b2g_emulator_mochitest.yml#24
[2] https://s3-us-west-2.amazonaws.com/taskcluster-public-artifacts/Kxq1GmB1R0WyS9hfaRCVWA/0/public/logs/live_backing.log

Comment 1

[John Dai[:jdai]]

How to update a newer xulrunner-sdk-40.zip which contains ssltunnel file? Since I don't know how to update a new xulrunner-sdk-40.zip file to testcluster, I revert back to ICS Emulator xulrunner.zip file which is not working.

Try link:
https://treeherder.allizom.org/#/jobs?repo=try&revision=01002f47b0d2

Comment 2

[Jonathan Griffin (:jgriffin)]

There are instructions on how to do this, here:

https://wiki.mozilla.org/ReleaseEngineering/Buildduty/Other_Duties#How_to_upload_new_xre.zip_files_for_B2G_tests

The script will need some updates to work with current paths to build artifacts, but it should be relatively straightforward, I hope.  Let me know if you run into problems.

Comment 3

[John Dai[:jdai]]

After I add ssltunnel into xulrunner-sdk-40.zip[1], TC will not get the same error[2], but it comes out with a new error.

[1] https://treeherder.allizom.org/#/jobs?repo=try&revision=1b712b3f5ee2
[2] ERROR INFO | runtests.py | expected to find ssltunnel at /home/worker/build/xre/bin/ssltunnel

=====
11:43:08     INFO -  MochitestServer : launching [u'/home/worker/build/xre/bin/xpcshell', '-g', '/home/worker/build/xre/bin', '-v', '170', '-f', '/home/worker/build/xre/bin/components/httpd.js', '-e', "const _PROFILE_PATH = '/tmp/tmpLI7D69'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '10.0.2.2'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', '/home/worker/build/tests/mochitest/server.js']
11:43:08     INFO -  runtests.py | Server pid: 442
11:43:08     INFO -  runtests.py | Websocket server pid: 445
11:43:08     INFO -  0 ERROR INFO | runtests.py | expected to find ssltunnel at /home/worker/build/xre/bin/ssltunnel
11:43:08     INFO -  Traceback (most recent call last):
11:43:08     INFO -    File "runtestsb2g.py", line 198, in run_tests
11:43:08     INFO -      self.startServers(options, None)
11:43:08     INFO -    File "runtestsb2g.py", line 374, in startServers
11:43:08     INFO -      MochitestUtilsMixin.startServers(self, options, debuggerInfo)
11:43:08     INFO -    File "/home/worker/build/tests/mochitest/runtests.py", line 817, in startServers
11:43:08     INFO -      self.sslTunnel.start()
11:43:08     INFO -    File "/home/worker/build/tests/mochitest/runtests.py", line 1059, in start
11:43:08     INFO -      exit(1)
11:43:08     INFO -    File "/home/worker/build/venv/lib/python2.7/site.py", line 403, in __call__
11:43:08     INFO -      raise SystemExit(code)
11:43:08     INFO -  SystemExit: 1
11:43:08     INFO -  1 ERROR Automation Error: Received unexpected exception while running application
11:43:09     INFO -  Stopping web server
11:45:16     INFO -  Stopping web socket server
11:45:16     INFO -  Stopping ssltunnel
11:45:16     INFO -  runtestsb2g.py | Running tests: end.
=====

Comment 4

[John Dai[:jdai]]

After I add ssltunnel into xulrunner-sdk-40.zip[1], TC will not get the same error[2], but it comes out with a new error.

Hi :ahal,
Could you give me some help on this?

[1] https://treeherder.allizom.org/#/jobs?repo=try&revision=1b712b3f5ee2
[2] ERROR INFO | runtests.py | expected to find ssltunnel at /home/worker/build/xre/bin/ssltunnel

=====
06:31:55     INFO -  MochitestServer : launching [u'/home/worker/build/xre/bin/xpcshell', '-g', '/home/worker/build/xre/bin', '-v', '170', '-f', '/home/worker/build/xre/bin/components/httpd.js', '-e', "const _PROFILE_PATH = '/tmp/tmpnOlzv8'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '10.0.2.2'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', '/home/worker/build/tests/mochitest/server.js']
06:31:55     INFO -  runtests.py | Server pid: 433
06:31:55     INFO -  runtests.py | Websocket server pid: 436
06:31:55     INFO -  runtests.py | SSL tunnel pid: 441
06:33:25  WARNING -  TEST-UNEXPECTED-FAIL | runtests.py | Timed out while waiting for server startup.
06:35:32     INFO -  Traceback (most recent call last):
06:35:32     INFO -    File "runtestsb2g.py", line 198, in run_tests
06:35:32     INFO -      self.startServers(options, None)
06:35:32     INFO -    File "runtestsb2g.py", line 374, in startServers
06:35:32     INFO -      MochitestUtilsMixin.startServers(self, options, debuggerInfo)
06:35:32     INFO -    File "/home/worker/build/tests/mochitest/runtests.py", line 824, in startServers
06:35:32     INFO -      self.server.ensureReady(self.SERVER_STARTUP_TIMEOUT)
06:35:32     INFO -    File "/home/worker/build/tests/mochitest/runtests.py", line 427, in ensureReady
06:35:32     INFO -      sys.exit(1)
06:35:32     INFO -  SystemExit: 1
06:35:32     INFO -  0 ERROR Automation Error: Received unexpected exception while running application
06:35:33     INFO -  Stopping web server
06:37:40     INFO -  Stopping web socket server
06:37:40     INFO -  Stopping ssltunnel
06:37:40     INFO -  runtestsb2g.py | Running tests: end.
06:37:43     INFO -  SUITE-END | took 515s
06:37:43    ERROR - Return code: 1
=====

Comment 5

[John Dai[:jdai]]

I find out the solution which is xulrunner-sdk-40.zip miss server.js to start server.

Try link:
https://treeherder.allizom.org/#/jobs?repo=try&revision=867703ec3278

Comment 6

[John Dai[:jdai]]

Attachment: WIP, patch, v1

Here is the WIP patch:
1.Update a new xulrunner-sdk-40.zip[1] which I don't have permission to push file to taskcluster artifact.
2.Use no-read-buildbot-config to get rid of read-buildbot-config step.

Try link:
https://treeherder.allizom.org/#/jobs?repo=try&revision=867703ec3278

[1] http://people.mozilla.org/~jdai/xulrunner-sdk-40.zip

Comment 7

[Greg Arndt [:garndt]]

(In reply to John Dai[:johnz][:jdai] from comment #1)
> How to update a newer xulrunner-sdk-40.zip which contains ssltunnel file?
> Since I don't know how to update a new xulrunner-sdk-40.zip file to
> testcluster, I revert back to ICS Emulator xulrunner.zip file which is not
> working.
> 
> Try link:
> https://treeherder.allizom.org/#/jobs?repo=try&revision=01002f47b0d2

Hrm, it looks like James took care of this before.  Basically he just created a taskcluster artifact for that file that we then reference the task definition linked to above.

That URL could be replaced with:
https://queue.taskcluster.net/v1/task/YNNF94qRSyCXiSU_AQgFOQ/runs/0/artifacts/public/cache/xulrunner-sdk-40.zip

I just created a task that uploaded the file on people.mozilla.org as a taskcluster artifact.

Comment 8

[Wander Lairson Costa]

Comment on attachment 8665429 [details] [diff] [review]
WIP, patch, v1

Review of attachment 8665429 [details] [diff] [review]:
-----------------------------------------------------------------

I will give f+, but I don't much experience on emulator tests.

Comment 9

[John Dai[:jdai]]

Attachment: MozReview Request: Bug 1207548 - Update new xulrunner-sdk-40.zip with ssltunnel file. r?garndt, wcosta

Bug 1207548 - Update new xulrunner-sdk-40.zip with ssltunnel file. r?garndt, wcosta

Comment 10

[Greg Arndt [:garndt]]

Comment on attachment 8665768 [details]
MozReview Request: Bug 1207548 - Update new xulrunner-sdk-40.zip with ssltunnel file. r?garndt, wcosta

https://reviewboard.mozilla.org/r/20325/#review18311

Looks good as long as we can get this pushed to try and make sure everything is green before landing this.

::: testing/taskcluster/tasks/tests/b2g_emulator_mochitest.yml:16
(Diff revision 1)
> +        --no-read-buildbot-config

I'm not entirely sure what this line does (I thought that it stopped mozharness from trying to read the build properties file and complaining when it's not found, but maybe I'm mistaken.

Comment 11

[Wander Lairson Costa]

Comment on attachment 8665768 [details]
MozReview Request: Bug 1207548 - Update new xulrunner-sdk-40.zip with ssltunnel file. r?garndt, wcosta

https://reviewboard.mozilla.org/r/20325/#review18323

+1 Greg comment

Comment 12

[John Dai[:jdai]]

Try result:
https://treeherder.allizom.org/#/jobs?repo=try&revision=9553f69893b3

Comment 13

[Carsten Book [:Tomcat]]

 B2G KK Emulator x86 opt  seems very broken in this try run. is this expected ?

Comment 14

[John Dai[:jdai]]

(In reply to Carsten Book [:Tomcat] from comment #13)
>  B2G KK Emulator x86 opt  seems very broken in this try run. is this
> expected ?

Yes, B2G KK Emulator x86 opt has other issues, it will fix in other bug, this bug provides correct xulrunner.zip for TC.

Comment 15

[Hsin-Yi Tsai (she/her) [:hsinyi]]

(In reply to John Dai[:johnz][:jdai] from comment #14)
> (In reply to Carsten Book [:Tomcat] from comment #13)
> >  B2G KK Emulator x86 opt  seems very broken in this try run. is this
> > expected ?
> 
> Yes, B2G KK Emulator x86 opt has other issues, it will fix in other bug,
> this bug provides correct xulrunner.zip for TC.

Just to second John - This bug aims at fixing the missing ssltunnel issue so that mochitest could be *launched* successfully. From the latest try link, the error ||INFO - 0 ERROR INFO | runtests.py | expected to find ssltunnel at /home/worker/build/xre/bin/ssltunnel"|| is gone. That is, ssltunnel is detected as expected.

Comment 16

[John Dai[:jdai]]

After I apply bug 1210370, emulator-x86 mochitest can pass most of tests.

Try link:
https://treeherder.allizom.org/#/jobs?repo=try&revision=e6dd43dda7cc&filter-searchStr=x86

Comment 17

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/10aca6716dc3

Comment 18

[Carsten Book [:Tomcat]]

done!

Comment 19

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Backed out alongside bug 1204800 for Flame-KK build failures:
https://hg.mozilla.org/integration/mozilla-inbound/rev/55b434372d68

https://treeherder.mozilla.org/logviewer.html#?job_id=15255656&repo=mozilla-inbound

Comment 20

[John Dai[:jdai]]

This bug is nothing relative with bug 1204800, please help to land it.

Comment 21

[Pulsebot]

https://hg.mozilla.org/integration/mozilla-inbound/rev/7ba3263d5483

Comment 22

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

Relanded: https://hg.mozilla.org/integration/mozilla-inbound/rev/7ba3263d5483

Comment 23

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/7ba3263d5483