[marionette-js-runner] js marionette tests are failing on tbpl

RESOLVED FIXED

Status

Testing Graveyard
JSMarionette
RESOLVED FIXED
5 years ago
5 months ago

People

(Reporter: gaye, Assigned: gaye)

Tracking

Details

(Whiteboard: [ucid:productivity8, 1.4:p3, ft:productivity])

Attachments

(3 attachments, 1 obsolete attachment)

(Assignee)

Description

5 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=30210224&tree=Cedar

At a glance, it seems like this might have to do with sockit-to-me building... will flag aus and lightsofapollo.
(Assignee)

Updated

5 years ago
Flags: needinfo?(jlal)
Flags: needinfo?(aus)
(Assignee)

Updated

5 years ago
QA Contact: gaye

Updated

5 years ago
Depends on: 931382
Flags: needinfo?(aus)
Aus is working on it
Flags: needinfo?(jlal)
(Assignee)

Comment 2

5 years ago
Hey Aus - Apparently we don't allow compilers on buildbot. I don't know why this is the case, but it's definitely what's going wrong. I'd like to dig into why we don't allow compilers on test machines, but in the meantime would it be possible to pre-build sockit-to-me?
Flags: needinfo?(aus)
(Assignee)

Updated

5 years ago
Depends on: 935986
(Assignee)

Updated

5 years ago
Flags: needinfo?(aus)
(Assignee)

Updated

5 years ago
Assignee: nobody → gaye

Comment 5

5 years ago
Nice hack, Gareth! :D
(Assignee)

Updated

5 years ago
QA Contact: gaye
(Assignee)

Comment 6

5 years ago
Created attachment 830912 [details] [diff] [review]
bug_935576.patch

Hi Aki,

The gaia integration tests look in $GAIA/b2g and if there's nothing there they download the latest nightly b2g desktop. As part of the b2g desktop build, we compile a fresh b2g desktop. We should definitely make sure to use the freshly compiled one instead of downloading a nightly. This patch copies the newly built b2g into $GAIA so that the gaia integration tests will pick it up.
Attachment #830912 - Flags: review?(aki)

Comment 7

5 years ago
Comment on attachment 830912 [details] [diff] [review]
bug_935576.patch

>+        # Copy the b2g desktop we built to the gaia directory so that it
>+        # gets used by the marionette-js-runner.
>+        copy = ' '.join([
>+            'cp',
>+            '-r',
>+            os.path.join(dirs['abs_work_dir'], 'b2g'),
>+            os.path.join(dirs['abs_gaia_dir'], 'b2g')
>+        ])
>+        self.run_command(copy, cwd=dirs['abs_work_dir'])

1) Running a run_command() with a string works.  I usually reserve it for when I want the shell to interpret something (e.g. a shell $ENV var, or a wildcard).
Otherwise, I tend to prefer using a list (basically get rid of the |' '.join()| ) since then I know any special characters won't get munged by the shell.  When the command is in the form of a list, it's like each argument is wrapped in single quotes on the command line.

2) I think this could be self.copytree().
http://hg.mozilla.org/build/mozharness/file/3edc26b689b0/mozharness/base/script.py#l292
Attachment #830912 - Flags: review?(aki) → review+
(Assignee)

Comment 8

5 years ago
Created attachment 830931 [details] [diff] [review]
bug_935576.patch

Thanks for the review Aki! Here's an updated one... would you mind making sure the inheritance from the mixin looks okay?
Attachment #830912 - Attachment is obsolete: true
Attachment #830931 - Flags: review?(aki)

Comment 9

5 years ago
Comment on attachment 830931 [details] [diff] [review]
bug_935576.patch

I'll land the gaia_integration.py part.  MercurialScript already inherits BaseScript, which inherits ScriptMixin, so the gaia_test.py change isn't needed.
Attachment #830931 - Flags: review?(aki) → review+
in production
(Assignee)

Comment 12

5 years ago
18:46:28     INFO - Copy/paste: make test-integration
18:46:28     INFO - Using env: {'NPM_REGISTRY': 'http://npm-mirror.pub.build.mozilla.org',
18:46:28     INFO -  'REPORTER': 'mocha-tbpl-reporter'}
18:46:28     INFO -  /bin/bash: adb: command not found
18:46:28     INFO -  npm install --registry http://npm-mirror.pub.build.mozilla.org
18:46:45     INFO -  > sockit-to-me@0.1.8 install /builds/slave/test/gaia/node_modules/marionette-client/node_modules/sockit-to-me
18:46:45     INFO -  > ./tools/copy.js || node-gyp configure build
18:46:45     INFO -  execvp(): No such file or directory
18:46:45     INFO -  npm ERR! Error: spawn ENOENT
18:46:45     INFO -  npm ERR!     at errnoException (child_process.js:980:11)
18:46:45     INFO -  npm ERR!     at Process.ChildProcess._handle.onexit (child_process.js:771:34)
18:46:45     INFO -  npm ERR! If you need help, you may report this log at:
18:46:45     INFO -  npm ERR!     <http://github.com/isaacs/npm/issues>
18:46:45     INFO -  npm ERR! or email it to:
18:46:45     INFO -  npm ERR!     <npm-@googlegroups.com>
18:46:45     INFO -  npm ERR! System Linux 3.2.0-23-generic-pae
18:46:45     INFO -  npm ERR! command "/usr/bin/node" "/usr/bin/npm" "install" "--registry" "http://npm-mirror.pub.build.mozilla.org"
18:46:45     INFO -  npm ERR! cwd /builds/slave/test/gaia
18:46:45     INFO -  npm ERR! node -v v0.10.21
18:46:45     INFO -  npm ERR! npm -v 1.3.11
18:46:45     INFO -  npm ERR! syscall spawn
18:46:45     INFO -  npm ERR! code ENOENT
18:46:45     INFO -  npm ERR! errno ENOENT
18:46:59     INFO -  npm ERR!
18:46:59     INFO -  npm ERR! Additional logging details can be found in:
18:46:59     INFO -  npm ERR!     /builds/slave/test/gaia/npm-debug.log
18:46:59     INFO -  npm ERR! not ok code 0
18:46:59     INFO -  make: *** [node_modules/.bin/mozilla-download] Error 1
18:46:59    ERROR - Return code: 2
18:46:59     INFO - TinderboxPrint: gaia-integration-tests: <em class="testfail">T-FAIL</em>
18:46:59    ERROR - Tests exited with return code 2: harness failures
18:46:59    ERROR - # TBPL FAILURE #

^ Latest issues. Adding some more debug logs to the mozharness script.
(Assignee)

Comment 13

5 years ago
Created attachment 8348856 [details] [diff] [review]
gaia-integration-environment-logging.patch
Attachment #8348856 - Flags: review?(aki)
(Assignee)

Comment 14

5 years ago
Hey Aki,

I'd like to add some logging to give me more visibility into what's happening in the gaia integration tests. Please take a look and push my commit if it looks good to you. If you could also cherry-pick/merge/encourage my patch into production so I can reap all of the debugging benefits later today, I would appreciate it!
(Assignee)

Updated

5 years ago
Whiteboard: [ucid:productivity8, 1.4:p3, ft:productivity]

Comment 15

5 years ago
Comment on attachment 8348856 [details] [diff] [review]
gaia-integration-environment-logging.patch

http://hg.mozilla.org/build/mozharness/rev/11198ff7b73c
transplanted to production
Attachment #8348856 - Flags: review?(aki) → review+
(Assignee)

Comment 16

5 years ago
Created attachment 8349656 [details] [diff] [review]
fix-make-test-integration.patch

I just ran the script with these modifications on a loaned test slave and it fixes the issues we were having. Aki - will you push this for me? This patch fixes the script.
Attachment #8349656 - Flags: review?(aki)

Comment 17

5 years ago
Comment on attachment 8349656 [details] [diff] [review]
fix-make-test-integration.patch

http://hg.mozilla.org/build/mozharness/rev/d61cda6c25c2
Attachment #8349656 - Flags: review?(aki) → review+
(Assignee)

Updated

4 years ago
Status: NEW → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → FIXED

Updated

5 months ago
Product: Testing → Testing Graveyard
You need to log in before you can comment on or make changes to this bug.