The gecko B2G builds that get used in emulator testing do not have build symbols made or uploaded, which means when we see B2G process crashes in emulator tests (which happens frequently), there is very little to go on for debugging. jrmuizel is running into this problem right now in bug 843296. Can we get build symbols built and uploaded for these builds?
This is blocking currently some my work too.
CC'ing Armen too. Who would be the best person to look into this? I'd like to work on bug 843296 now that tests are running in AWS. Is there anything I can do to help out on this bug?
Created attachment 719144 [details] [diff] [review] (configs) [needs testing] enable symbols for b2g emulator builds This could be as simple as this patch. Since things are rarely that simple, -> staging.
I've put aki's patch on staging. I will review the build tomorrow and see what got uploaded.
Symbols built, died later due to bug 840724 =\
We can either review, land, and make sure a nightly works, or land symbol upload staging fixes in a user repo to verify.
Oh, duh, I was building the wrong thing. Multitasking-- Re-testing.
Created attachment 719279 [details] [diff] [review] (configs) add symbol env vars SYMBOL_SERVER_HOST: parameter null or not set
Comment on attachment 719279 [details] [diff] [review] (configs) add symbol env vars Trying ~/.ssh/... since it's no longer /home/cltbld in mock, it's /home/mock_mozilla . If that doesn't work, I may just hardcode /home/mock_mozilla/... .
Warning: Identity file ~/.ssh/ffxbld_dsa not accessible: No such file or directory. Hardcoding...
Created attachment 719343 [details] [diff] [review] /home/mock_mozilla/.ssh/...
Went green in staging. After this lands we can probably revert http://hg.mozilla.org/build/buildbot-configs/rev/8349163e6eaa .
Comment on attachment 719343 [details] [diff] [review] /home/mock_mozilla/.ssh/... http://hg.mozilla.org/build/buildbot-configs/rev/30a4bfd48761
Are we uploading symbols for non-nightly builds to the symbol server here? We definitely shouldn't be doing that.
Looks like b2g_build.py does an is_nightly() check first; we *can't* upload non-nightly symbols. http://hg.mozilla.org/build/mozharness/file/c0ecdcbbfec5/scripts/b2g_build.py#l685
(In reply to Aki Sasaki [:aki] from comment #16) > http://hg.mozilla.org/build/buildbot-configs/rev/68a0d0c46824 > > (reverted http://hg.mozilla.org/build/buildbot-configs/rev/8349163e6eaa ) I think this is breaking Gaia UI tests. https://tbpl.mozilla.org/?tree=Mozilla-Inbound&jobname=b2g_panda&noignore=1 07:06:22 FATAL - Can't figure out symbols_url from installer_url http://pvtbuilds.pvt.build.mozilla.org//pub/mozilla.org/b2g/tinderbox-builds/mozilla-inbound-panda/20130301061123!
Happening because the installer_url in this case has no suffix: https://hg.mozilla.org/build/mozharness/file/58951288d868/mozharness/mozilla/testing/testbase.py#l75
(In reply to Armen Zambrano G. [:armenzg] from comment #17) > (In reply to Aki Sasaki [:aki] from comment #16) > > http://hg.mozilla.org/build/buildbot-configs/rev/68a0d0c46824 > > > > (reverted http://hg.mozilla.org/build/buildbot-configs/rev/8349163e6eaa ) > > I think this is breaking Gaia UI tests. > https://tbpl.mozilla.org/?tree=Mozilla-Inbound&jobname=b2g_panda&noignore=1 > 07:06:22 FATAL - Can't figure out symbols_url from installer_url > http://pvtbuilds.pvt.build.mozilla.org//pub/mozilla.org/b2g/tinderbox-builds/ > mozilla-inbound-panda/20130301061123! Do you guys need me to revert this, or is this getting fixed in mozharness ?
I'm not looking into it right now. Whatever you prefer. I can take care of it on Monday.
=\ looks like we expect the build and the crash symbols to have the same format name, and that's not true for b2g. Not sure what we should do here; try scraping the page? =\
I think this bug is fixed, but leaving open til we resolve the gaia smoketest issue.
Armen's got the gaia smoketest fix in bug 847927. Resolving this bug.