Closed Bug 1600112 Opened 6 years ago Closed 6 years ago

Either stop checking for mochitest timeouts in ccov tests, or find a sufficiently high threshold for them to make it possible for tests to actually pass in the ccov suite

Categories

(Testing :: Mochitest, task, P3)

Product:
Testing
Component:
Mochitest
Version:
Version 3
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: ehsan.akhgari, Unassigned)

Details

We're being asked to spend an unjustifiable amount of time increasing test timeouts just to accommodate the ccov suite. Recent examples in memory include (but are not limited to) bug 1599418, bug 1598809, bug 1580606 and bug 1577105.

This situation is unsustainable and we need to make it stop somehow. I have two possibilities in mind, others could be thought of as well:

  • Stop checking for mochitest timeouts in ccov tests.
  • Find a sufficiently high threshold for them to ensure they will pass if they pass in non-ccov mode (e.g. 10x the non-ccov threshold).

Marco, do you mind taking this please? Thanks!

Flags: needinfo?
Flags: needinfo? → needinfo?(mcastelluccio)
Priority: -- → P3

I think the situation should be much better now that we switched coverage builds from debug to opt. If not, we can increase the base timeout for all tests like we do for asan builds.

Status: NEW → RESOLVED
Closed: 6 years ago
Flags: needinfo?(mcastelluccio)
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.