Closed
Bug 1004610
Opened 11 years ago
Closed 11 years ago
Unhide debug Gaia UI tests when they meet visibility standards
Categories
(Tree Management Graveyard :: Visibility Requests, defect)
Tracking
(Not tracked)
RESOLVED
DUPLICATE
of bug 916111
People
(Reporter: RyanVM, Unassigned)
Details
Since being enabled today, there hasn't been a single green run. Hidden on all trunk trees and b2g30_v1_4 until they can pass reliably. Also, I thought Cedar was where we greened up new test suites prior to enabling them in production?
https://tbpl.mozilla.org/php/getParsedLog.php?id=38881026&tree=Fx-Team
https://tbpl.mozilla.org/php/getParsedLog.php?id=38879200&tree=Fx-Team
https://tbpl.mozilla.org/php/getParsedLog.php?id=38879298&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=38880714&tree=B2g-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=38882210&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=38880756&tree=Mozilla-Inbound
https://tbpl.mozilla.org/php/getParsedLog.php?id=38878972&tree=Mozilla-Inbound
Reporter | ||
Comment 1•11 years ago
|
||
Ditto for Linux64.
Summary: Unhide OSX debug Gaia UI tests when they meet visibility standards → Unhide debug Gaia UI tests when they meet visibility standards
Reporter | ||
Comment 2•11 years ago
|
||
b2g30 is actually green on the only run it's had so far. I'm going to hold off on skipping it there for now.
OS: Mac OS X → All
Comment 3•11 years ago
|
||
I dunno what a debug build is but nobody told us about this; we've no plan to fix these tests. It will need to be for the debug build itself to fall into line with the tests.
Comment 4•11 years ago
|
||
(In reply to Zac C (:zac) from comment #3)
> I dunno what a debug build is but nobody told us about this; we've no plan
> to fix these tests. It will need to be for the debug build itself to fall
> into line with the tests.
Debug builds are non-optimized and have full symbols enabled to allow developers to track down code issue more easily. This is something that b2g devs *should* care about, and something that their managers have been asking for from releng for 6 months.
There are different ways to help here:
* pressure devs to fix failing tests
* disable tests in the manifest that aren't pertinent or can't be run in a debug context
* create a new debug-only test manifest
Simone: can you please sync up with Armen about this? He knows better than anyone the process for getting to green. Driving this process often falls to releng.
Flags: needinfo?(sbruno)
Comment 5•11 years ago
|
||
Thanks coop,
to be honest the pattern of failures here looks like something is not actually working properly and thus it's probably not the test. but yes, hard to find someone to get interested in it.
Comment 6•11 years ago
|
||
Simone, I will be away tomorrow. Please ping me as soon as you see me online as I will be traveling to the office and soon after my 1x1. I want to make sure that we meet before it's too late on your day and I'm off on Friday.
Comment 7•11 years ago
|
||
Tests on b2g debug builds are now enabled on cedar only (see https://bugzilla.mozilla.org/show_bug.cgi?id=916111#c25) and they will be re-enabled on trunk trees only when green there.
Jonathan: can you have a look to the failing tests on cedar? Do we need to disable some of the tests (an option you mentioned in https://bugzilla.mozilla.org/show_bug.cgi?id=916111#c16)? Are you aware of any other required changes to green them?
You can see the tests here:
https://tbpl.mozilla.org/?tree=Cedar&showall=1&jobname=b2g_.*debug
Flags: needinfo?(sbruno) → needinfo?(jgriffin)
Comment 8•11 years ago
|
||
These tests now are running green on cedar on Linux64; I think we can unhide them. OSX looks like it needs a little more love.
Flags: needinfo?(jgriffin)
Comment 9•11 years ago
|
||
These are already unhidden on Cedar:
https://tbpl.mozilla.org/?tree=Cedar&jobname=b2g_.*debug.*gaia-ui-test
Next steps would be to enable Linux64 (only) debug gaia-ui-test on all trunk trees.
Comment 10•11 years ago
|
||
Duping to bug 916111, since comment 0 of this bug was 'fixed' by us disabling the jobs on !cedar a while ago.
Updated•10 years ago
|
Component: Gaia::UI Tests → Visibility Requests
Product: Firefox OS → Tree Management
Version: unspecified → ---
Updated•6 years ago
|
Product: Tree Management → Tree Management Graveyard
You need to log in
before you can comment on or make changes to this bug.
Description
•