Closed Bug 1609799 Opened 5 years ago Closed 5 years ago

Do not run tier 2 test-verify on mozilla-central

Categories

(Testing :: General, task)

Product:
Testing
Component:
General
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(firefox74 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla74
Tracking Flags:
Tracking Status
firefox74 --- fixed

People

(Reporter: bc, Assigned: bc)

References

Details

(Whiteboard: [ci-costs-2020:done])

Attachments

(1 file, 1 obsolete file)

Bug 1609799 - do not run test verify on web platform tests on mozilla-central unless resource constrained, r=gbrown.
47 bytes, text/x-phabricator-request
Details | Review

As part of bug 1598744, we are looking into reducing CI costs by eliminating tier 2,3 jobs on autoland and possibly making them require --full when submitting to try.

Bug 1598744 comment 10 shows the break down for the Firefox 72 (Dec 2 - Jan 6) time period.

provisionerId workerType project tier suite groupSymbol symbol collection cost label
releng-hardware gecko-t-osx-1014 autoland 2 test-verify nil TV1 opt 2.85 test-macosx1014-64-devedition/opt-test-verify-e10s-1, test-macosx1014-64-shippable/opt-test-verify-e10s-1
releng-hardware gecko-t-osx-1014 autoland 2 test-verify nil TV2 opt 2.14 test-macosx1014-64-devedition/opt-test-verify-e10s-2, test-macosx1014-64-shippable/opt-test-verify-e10s-2
releng-hardware gecko-t-osx-1014 autoland 2 test-verify nil TV3 opt 0.85 test-macosx1014-64-devedition/opt-test-verify-e10s-3, test-macosx1014-64-shippable/opt-test-verify-e10s-3
releng-hardware gecko-t-osx-1014 autoland 2 test-verify nil TV1 debug 4.96 test-macosx1014-64/debug-test-verify-e10s-1
releng-hardware gecko-t-osx-1014 autoland 2 test-verify nil TV2 debug 4.15 test-macosx1014-64/debug-test-verify-e10s-2
releng-hardware gecko-t-osx-1014 autoland 2 test-verify nil TV3 debug 1.77 test-macosx1014-64/debug-test-verify-e10s-3
releng-hardware gecko-t-osx-1014 autoland 2 test-verify-gpu nil TVg opt 1.27 test-macosx1014-64-devedition/opt-test-verify-gpu-e10s, test-macosx1014-64-shippable/opt-test-verify-gpu-e10s
releng-hardware gecko-t-osx-1014 autoland 2 test-verify-gpu nil TVg debug 1.38 test-macosx1014-64/debug-test-verify-gpu-e10s
releng-hardware gecko-t-osx-1014 autoland 2 test-verify-wpt nil TVw1 opt 0.55 test-macosx1014-64-devedition/opt-test-verify-wpt-e10s-1, test-macosx1014-64-shippable/opt-test-verify-wpt-e10s-1
releng-hardware gecko-t-osx-1014 autoland 2 test-verify-wpt nil TVw2 opt 0.62 test-macosx1014-64-devedition/opt-test-verify-wpt-e10s-2, test-macosx1014-64-shippable/opt-test-verify-wpt-e10s-2
releng-hardware gecko-t-osx-1014 autoland 2 test-verify-wpt nil TVw3 opt 0.62 test-macosx1014-64-devedition/opt-test-verify-wpt-e10s-3, test-macosx1014-64-shippable/opt-test-verify-wpt-e10s-3
releng-hardware gecko-t-osx-1014 autoland 2 test-verify-wpt nil TVw1 debug 1.03 test-macosx1014-64/debug-test-verify-wpt-e10s-1
releng-hardware gecko-t-osx-1014 autoland 2 test-verify-wpt nil TVw2 debug 1.15 test-macosx1014-64/debug-test-verify-wpt-e10s-2
releng-hardware gecko-t-osx-1014 autoland 2 test-verify-wpt nil TVw3 debug 1.18 test-macosx1014-64/debug-test-verify-wpt-e10s-3
autoland Sum 24.52
releng-hardware gecko-t-osx-1014 try 2 test-verify nil TV1 debug 2.45 test-macosx1014-64-ccov/debug-test-verify-e10s-1, test-macosx1014-64/debug-test-verify-e10s-1
releng-hardware gecko-t-osx-1014 try 2 test-verify nil TV2 debug 1.99 test-macosx1014-64-ccov/debug-test-verify-e10s-2, test-macosx1014-64/debug-test-verify-e10s-2
releng-hardware gecko-t-osx-1014 try 2 test-verify nil TV3 debug 1.47 test-macosx1014-64-ccov/debug-test-verify-e10s-3, test-macosx1014-64/debug-test-verify-e10s-3
releng-hardware gecko-t-osx-1014 try 2 test-verify nil TV1 opt 1.18 test-macosx1014-64-devedition/opt-test-verify-e10s-1, test-macosx1014-64-shippable/opt-test-verify-e10s-1
releng-hardware gecko-t-osx-1014 try 2 test-verify nil TV2 opt 0.93 test-macosx1014-64-devedition/opt-test-verify-e10s-2, test-macosx1014-64-shippable/opt-test-verify-e10s-2
releng-hardware gecko-t-osx-1014 try 2 test-verify nil TV3 opt 0.35 test-macosx1014-64-devedition/opt-test-verify-e10s-3, test-macosx1014-64-shippable/opt-test-verify-e10s-3
releng-hardware gecko-t-osx-1014 try 2 test-verify-gpu nil TVg debug 0.67 test-macosx1014-64-ccov/debug-test-verify-gpu-e10s, test-macosx1014-64/debug-test-verify-gpu-e10s
releng-hardware gecko-t-osx-1014 try 2 test-verify-gpu nil TVg opt 0.93 test-macosx1014-64-devedition/opt-test-verify-gpu-e10s, test-macosx1014-64-shippable/opt-test-verify-gpu-e10s
releng-hardware gecko-t-osx-1014 try 2 test-verify-wpt nil TVw1 debug 0.16 test-macosx1014-64-ccov/debug-test-verify-wpt-e10s-1, test-macosx1014-64/debug-test-verify-wpt-e10s-1
releng-hardware gecko-t-osx-1014 try 2 test-verify-wpt nil TVw2 debug 0.16 test-macosx1014-64-ccov/debug-test-verify-wpt-e10s-2, test-macosx1014-64/debug-test-verify-wpt-e10s-2
releng-hardware gecko-t-osx-1014 try 2 test-verify-wpt nil TVw3 debug 0.09 test-macosx1014-64-ccov/debug-test-verify-wpt-e10s-3, test-macosx1014-64/debug-test-verify-wpt-e10s-3
releng-hardware gecko-t-osx-1014 try 2 test-verify-wpt nil TVw1 opt 0.09 test-macosx1014-64-devedition/opt-test-verify-wpt-e10s-1, test-macosx1014-64-shippable/opt-test-verify-wpt-e10s-1
releng-hardware gecko-t-osx-1014 try 2 test-verify-wpt nil TVw2 opt 0.09 test-macosx1014-64-devedition/opt-test-verify-wpt-e10s-2, test-macosx1014-64-shippable/opt-test-verify-wpt-e10s-2
releng-hardware gecko-t-osx-1014 try 2 test-verify-wpt nil TVw3 opt 0.06 test-macosx1014-64-devedition/opt-test-verify-wpt-e10s-3, test-macosx1014-64-shippable/opt-test-verify-wpt-e10s-3
try Sum 10.64
gecko-t-osx-1014 Sum 35.16
gecko-t t-linux-large autoland 2 test-verify nil TV1 opt 0.61 test-linux1804-64-devedition/opt-test-verify-e10s-1, test-linux1804-64-shippable/opt-test-verify-e10s-1
gecko-t t-linux-large autoland 2 test-verify nil TV2 opt 0.48 test-linux1804-64-devedition/opt-test-verify-e10s-2, test-linux1804-64-shippable/opt-test-verify-e10s-2
gecko-t t-linux-large autoland 2 test-verify nil TV3 opt 0.20 test-linux1804-64-devedition/opt-test-verify-e10s-3, test-linux1804-64-shippable/opt-test-verify-e10s-3
gecko-t t-linux-large autoland 2 test-verify nil TV1 debug 1.22 test-linux1804-64/debug-test-verify-e10s-1
gecko-t t-linux-large autoland 2 test-verify nil TV2 debug 1.02 test-linux1804-64/debug-test-verify-e10s-2
gecko-t t-linux-large autoland 2 test-verify nil TV3 debug 0.44 test-linux1804-64/debug-test-verify-e10s-3
gecko-t t-linux-large autoland 2 test-verify-gpu nil TVg opt 0.44 test-linux1804-64-devedition/opt-test-verify-gpu-e10s, test-linux1804-64-shippable/opt-test-verify-gpu-e10s
gecko-t t-linux-large autoland 2 test-verify-gpu nil TVg debug 0.57 test-linux1804-64/debug-test-verify-gpu-e10s
autoland Sum 4.99
gecko-t t-linux-large try 2 test-verify nil TV1 opt 0.79 test-linux1804-64-devedition/opt-test-verify-e10s-1, test-linux1804-64-shippable/opt-test-verify-e10s-1, test-linux1804-64/opt-test-verify-e10s-1
gecko-t t-linux-large try 2 test-verify nil TV2 opt 0.55 test-linux1804-64-devedition/opt-test-verify-e10s-2, test-linux1804-64-shippable/opt-test-verify-e10s-2, test-linux1804-64/opt-test-verify-e10s-2
gecko-t t-linux-large try 2 test-verify nil TV3 opt 0.36 test-linux1804-64-devedition/opt-test-verify-e10s-3, test-linux1804-64-shippable/opt-test-verify-e10s-3, test-linux1804-64/opt-test-verify-e10s-3
gecko-t t-linux-large try 2 test-verify nil TV1 debug 1.07 test-linux1804-64/debug-test-verify-e10s-1
gecko-t t-linux-large try 2 test-verify nil TV2 debug 0.88 test-linux1804-64/debug-test-verify-e10s-2
gecko-t t-linux-large try 2 test-verify nil TV3 debug 0.60 test-linux1804-64/debug-test-verify-e10s-3
gecko-t t-linux-large try 2 test-verify-gpu nil TVg opt 1.03 test-linux1804-64-devedition/opt-test-verify-gpu-e10s, test-linux1804-64-shippable/opt-test-verify-gpu-e10s, test-linux1804-64/opt-test-verify-gpu-e10s
gecko-t t-linux-large try 2 test-verify-gpu nil TVg debug 1.12 test-linux1804-64/debug-test-verify-gpu-e10s
try Sum 6.40
t-linux-large Sum 11.39
gecko-t t-linux-xlarge autoland 2 test-verify-wpt nil TVw1 opt 0.31 test-linux1804-64-devedition/opt-test-verify-wpt-e10s-1, test-linux1804-64-shippable/opt-test-verify-wpt-e10s-1
gecko-t t-linux-xlarge autoland 2 test-verify-wpt nil TVw2 opt 0.37 test-linux1804-64-devedition/opt-test-verify-wpt-e10s-2, test-linux1804-64-shippable/opt-test-verify-wpt-e10s-2
gecko-t t-linux-xlarge autoland 2 test-verify-wpt nil TVw3 opt 0.31 test-linux1804-64-devedition/opt-test-verify-wpt-e10s-3, test-linux1804-64-shippable/opt-test-verify-wpt-e10s-3
gecko-t t-linux-xlarge autoland 2 test-verify-wpt nil TVw1 debug 0.70 test-linux1804-64/debug-test-verify-wpt-e10s-1
gecko-t t-linux-xlarge autoland 2 test-verify-wpt nil TVw2 debug 0.71 test-linux1804-64/debug-test-verify-wpt-e10s-2
gecko-t t-linux-xlarge autoland 2 test-verify-wpt nil TVw3 debug 0.72 test-linux1804-64/debug-test-verify-wpt-e10s-3
autoland Sum 3.12
gecko-t t-linux-xlarge try 2 test-verify-wpt nil TVw1 opt 0.41 test-linux1804-64-devedition/opt-test-verify-wpt-e10s-1, test-linux1804-64-shippable/opt-test-verify-wpt-e10s-1, test-linux1804-64/opt-test-verify-wpt-e10s-1
gecko-t t-linux-xlarge try 2 test-verify-wpt nil TVw2 opt 0.39 test-linux1804-64-devedition/opt-test-verify-wpt-e10s-2, test-linux1804-64-shippable/opt-test-verify-wpt-e10s-2, test-linux1804-64/opt-test-verify-wpt-e10s-2
gecko-t t-linux-xlarge try 2 test-verify-wpt nil TVw3 opt 0.09 test-linux1804-64-devedition/opt-test-verify-wpt-e10s-3, test-linux1804-64-shippable/opt-test-verify-wpt-e10s-3, test-linux1804-64/opt-test-verify-wpt-e10s-3
gecko-t t-linux-xlarge try 2 test-verify-wpt nil TVw1 debug 0.74 test-linux1804-64/debug-test-verify-wpt-e10s-1
gecko-t t-linux-xlarge try 2 test-verify-wpt nil TVw2 debug 0.71 test-linux1804-64/debug-test-verify-wpt-e10s-2
gecko-t t-linux-xlarge try 2 test-verify-wpt nil TVw3 debug 0.19 test-linux1804-64/debug-test-verify-wpt-e10s-3
try Sum 2.53
t-linux-xlarge Sum 5.65
gecko-t t-win10-64 autoland 2 test-verify nil TV1 opt 2.78 test-windows10-64-devedition/opt-test-verify-e10s-1, test-windows10-64-shippable/opt-test-verify-e10s-1
gecko-t t-win10-64 autoland 2 test-verify nil TV2 opt 2.17 test-windows10-64-devedition/opt-test-verify-e10s-2, test-windows10-64-shippable/opt-test-verify-e10s-2
gecko-t t-win10-64 autoland 2 test-verify nil TV3 opt 0.93 test-windows10-64-devedition/opt-test-verify-e10s-3, test-windows10-64-shippable/opt-test-verify-e10s-3
gecko-t t-win10-64 autoland 2 test-verify nil TV1 debug 4.71 test-windows10-64/debug-test-verify-e10s-1
gecko-t t-win10-64 autoland 2 test-verify nil TV2 debug 3.80 test-windows10-64/debug-test-verify-e10s-2
gecko-t t-win10-64 autoland 2 test-verify nil TV3 debug 1.60 test-windows10-64/debug-test-verify-e10s-3
gecko-t t-win10-64 autoland 2 test-verify-wpt nil TVw1 opt 0.60 test-windows10-64-devedition/opt-test-verify-wpt-e10s-1, test-windows10-64-shippable/opt-test-verify-wpt-e10s-1
gecko-t t-win10-64 autoland 2 test-verify-wpt nil TVw2 opt 0.66 test-windows10-64-devedition/opt-test-verify-wpt-e10s-2, test-windows10-64-shippable/opt-test-verify-wpt-e10s-2
gecko-t t-win10-64 autoland 2 test-verify-wpt nil TVw3 opt 0.65 test-windows10-64-devedition/opt-test-verify-wpt-e10s-3, test-windows10-64-shippable/opt-test-verify-wpt-e10s-3
gecko-t t-win10-64 autoland 2 test-verify-wpt nil TVw1 debug 1.00 test-windows10-64/debug-test-verify-wpt-e10s-1
gecko-t t-win10-64 autoland 2 test-verify-wpt nil TVw2 debug 1.11 test-windows10-64/debug-test-verify-wpt-e10s-2
gecko-t t-win10-64 autoland 2 test-verify-wpt nil TVw3 debug 1.11 test-windows10-64/debug-test-verify-wpt-e10s-3
autoland Sum 21.12
gecko-t t-win10-64 try 2 test-verify nil TV1 opt 1.95 test-windows10-64-devedition/opt-test-verify-e10s-1, test-windows10-64-shippable/opt-test-verify-e10s-1, test-windows10-64/opt-test-verify-e10s-1
gecko-t t-win10-64 try 2 test-verify nil TV2 opt 1.45 test-windows10-64-devedition/opt-test-verify-e10s-2, test-windows10-64-shippable/opt-test-verify-e10s-2, test-windows10-64/opt-test-verify-e10s-2
gecko-t t-win10-64 try 2 test-verify nil TV3 opt 0.77 test-windows10-64-devedition/opt-test-verify-e10s-3, test-windows10-64-shippable/opt-test-verify-e10s-3, test-windows10-64/opt-test-verify-e10s-3
gecko-t t-win10-64 try 2 test-verify nil TV1 debug 2.08 test-windows10-64/debug-test-verify-e10s-1
gecko-t t-win10-64 try 2 test-verify nil TV2 debug 1.48 test-windows10-64/debug-test-verify-e10s-2
gecko-t t-win10-64 try 2 test-verify nil TV3 debug 1.20 test-windows10-64/debug-test-verify-e10s-3
gecko-t t-win10-64 try 2 test-verify-wpt nil TVw1 opt 0.20 test-windows10-64-devedition/opt-test-verify-wpt-e10s-1, test-windows10-64-shippable/opt-test-verify-wpt-e10s-1, test-windows10-64/opt-test-verify-wpt-e10s-1
gecko-t t-win10-64 try 2 test-verify-wpt nil TVw2 opt 0.20 test-windows10-64-devedition/opt-test-verify-wpt-e10s-2, test-windows10-64-shippable/opt-test-verify-wpt-e10s-2, test-windows10-64/opt-test-verify-wpt-e10s-2
gecko-t t-win10-64 try 2 test-verify-wpt nil TVw3 opt 0.13 test-windows10-64-devedition/opt-test-verify-wpt-e10s-3, test-windows10-64-shippable/opt-test-verify-wpt-e10s-3, test-windows10-64/opt-test-verify-wpt-e10s-3
gecko-t t-win10-64 try 2 test-verify-wpt nil TVw1 debug 0.18 test-windows10-64/debug-test-verify-wpt-e10s-1
gecko-t t-win10-64 try 2 test-verify-wpt nil TVw2 debug 0.18 test-windows10-64/debug-test-verify-wpt-e10s-2
gecko-t t-win10-64 try 2 test-verify-wpt nil TVw3 debug 0.11 test-windows10-64/debug-test-verify-wpt-e10s-3
try Sum 9.93
t-win10-64 Sum 31.04
gecko-t t-win10-64-gpu-s autoland 2 test-verify-gpu nil TVg opt 3.65 test-windows10-64-devedition/opt-test-verify-gpu-e10s, test-windows10-64-shippable/opt-test-verify-gpu-e10s
gecko-t t-win10-64-gpu-s autoland 2 test-verify-gpu nil TVg debug 4.06 test-windows10-64/debug-test-verify-gpu-e10s
autoland Sum 7.71
gecko-t t-win10-64-gpu-s try 2 test-verify-gpu nil TVg opt 4.29 test-windows10-64-devedition/opt-test-verify-gpu-e10s, test-windows10-64-shippable/opt-test-verify-gpu-e10s, test-windows10-64/opt-test-verify-gpu-e10s
gecko-t t-win10-64-gpu-s try 2 test-verify-gpu nil TVg debug 2.45 test-windows10-64/debug-test-verify-gpu-e10s
try Sum 6.74
t-win10-64-gpu-s Sum 14.45
gecko-t t-win7-32 autoland 2 test-verify nil TV1 opt 3.80 test-windows7-32-devedition/opt-test-verify-e10s-1, test-windows7-32-shippable/opt-test-verify-e10s-1
gecko-t t-win7-32 autoland 2 test-verify nil TV2 opt 3.47 test-windows7-32-devedition/opt-test-verify-e10s-2, test-windows7-32-shippable/opt-test-verify-e10s-2
gecko-t t-win7-32 autoland 2 test-verify nil TV3 opt 1.40 test-windows7-32-devedition/opt-test-verify-e10s-3, test-windows7-32-shippable/opt-test-verify-e10s-3
gecko-t t-win7-32 autoland 2 test-verify nil TV1 debug 5.87 test-windows7-32/debug-test-verify-e10s-1
gecko-t t-win7-32 autoland 2 test-verify nil TV2 debug 4.94 test-windows7-32/debug-test-verify-e10s-2
gecko-t t-win7-32 autoland 2 test-verify nil TV3 debug 2.05 test-windows7-32/debug-test-verify-e10s-3
gecko-t t-win7-32 autoland 2 test-verify-wpt nil TVw1 opt 0.88 test-windows7-32-devedition/opt-test-verify-wpt-e10s-1, test-windows7-32-shippable/opt-test-verify-wpt-e10s-1
gecko-t t-win7-32 autoland 2 test-verify-wpt nil TVw2 opt 0.95 test-windows7-32-devedition/opt-test-verify-wpt-e10s-2, test-windows7-32-shippable/opt-test-verify-wpt-e10s-2
gecko-t t-win7-32 autoland 2 test-verify-wpt nil TVw3 opt 0.89 test-windows7-32-devedition/opt-test-verify-wpt-e10s-3, test-windows7-32-shippable/opt-test-verify-wpt-e10s-3
gecko-t t-win7-32 autoland 2 test-verify-wpt nil TVw1 debug 1.28 test-windows7-32/debug-test-verify-wpt-e10s-1
gecko-t t-win7-32 autoland 2 test-verify-wpt nil TVw2 debug 1.39 test-windows7-32/debug-test-verify-wpt-e10s-2
gecko-t t-win7-32 autoland 2 test-verify-wpt nil TVw3 debug 1.34 test-windows7-32/debug-test-verify-wpt-e10s-3
autoland Sum 28.26
gecko-t t-win7-32 try 2 test-verify nil TV1 opt 1.77 test-windows7-32-devedition/opt-test-verify-e10s-1, test-windows7-32-shippable/opt-test-verify-e10s-1, test-windows7-32/opt-test-verify-e10s-1
gecko-t t-win7-32 try 2 test-verify nil TV2 opt 1.35 test-windows7-32-devedition/opt-test-verify-e10s-2, test-windows7-32-shippable/opt-test-verify-e10s-2, test-windows7-32/opt-test-verify-e10s-2
gecko-t t-win7-32 try 2 test-verify nil TV3 opt 0.87 test-windows7-32-devedition/opt-test-verify-e10s-3, test-windows7-32-shippable/opt-test-verify-e10s-3, test-windows7-32/opt-test-verify-e10s-3
gecko-t t-win7-32 try 2 test-verify nil TV1 debug 1.39 test-windows7-32/debug-test-verify-e10s-1
gecko-t t-win7-32 try 2 test-verify nil TV2 debug 1.10 test-windows7-32/debug-test-verify-e10s-2
gecko-t t-win7-32 try 2 test-verify nil TV3 debug 0.84 test-windows7-32/debug-test-verify-e10s-3
gecko-t t-win7-32 try 2 test-verify-wpt nil TVw1 opt 0.48 test-windows7-32-devedition/opt-test-verify-wpt-e10s-1, test-windows7-32-shippable/opt-test-verify-wpt-e10s-1, test-windows7-32/opt-test-verify-wpt-e10s-1
gecko-t t-win7-32 try 2 test-verify-wpt nil TVw2 opt 0.43 test-windows7-32-devedition/opt-test-verify-wpt-e10s-2, test-windows7-32-shippable/opt-test-verify-wpt-e10s-2, test-windows7-32/opt-test-verify-wpt-e10s-2
gecko-t t-win7-32 try 2 test-verify-wpt nil TVw3 opt 0.29 test-windows7-32-devedition/opt-test-verify-wpt-e10s-3, test-windows7-32-shippable/opt-test-verify-wpt-e10s-3, test-windows7-32/opt-test-verify-wpt-e10s-3
gecko-t t-win7-32 try 2 test-verify-wpt nil TVw1 debug 0.37 test-windows7-32/debug-test-verify-wpt-e10s-1
gecko-t t-win7-32 try 2 test-verify-wpt nil TVw2 debug 0.36 test-windows7-32/debug-test-verify-wpt-e10s-2
gecko-t t-win7-32 try 2 test-verify-wpt nil TVw3 debug 0.23 test-windows7-32/debug-test-verify-wpt-e10s-3
try Sum 9.46
t-win7-32 Sum 37.72
gecko-t t-win7-32-gpu autoland 2 test-verify-gpu nil TVg opt 17.32 test-windows7-32-devedition/opt-test-verify-gpu-e10s, test-windows7-32-shippable/opt-test-verify-gpu-e10s
gecko-t t-win7-32-gpu autoland 2 test-verify-gpu nil TVg debug 17.82 test-windows7-32/debug-test-verify-gpu-e10s
autoland Sum 35.14
gecko-t t-win7-32-gpu try 2 test-verify-gpu nil TVg opt 15.90 test-windows7-32-devedition/opt-test-verify-gpu-e10s, test-windows7-32-shippable/opt-test-verify-gpu-e10s, test-windows7-32/opt-test-verify-gpu-e10s
gecko-t t-win7-32-gpu try 2 test-verify-gpu nil TVg debug 8.14 test-windows7-32/debug-test-verify-gpu-e10s
try Sum 24.04
t-win7-32-gpu Sum 59.18
Grand Sum 194.59
Grand Sum 194.59

The total cost is $194.59. I believe we can wontfix this as well.

Product: Firefox Build System → Testing

I wonder if we can go to tier-1 or not, for the short term there is probably nothing actionable here, but this data helps quantify what we have.

I don't think tier 1 is, or will be, appropriate for TV.

TV provides most value on try and autoland: A quick verification of test changes as early as possible. I would like to keep running all test-verify tasks on autoland.

However, this reminds me that TV has less value on mozilla-central and release branches:

  • If the failure was ignored on autoland, it seems likely to be ignored on mozilla-central.
  • Most pushes on mozilla-central are merges, with many changesets, which can over-whelm TV in terms of run-time, and make its logging harder to interpret.

I would not mind seeing test-verify tasks reduced to run-on-projects: [try, autoland].

gbrown: I could change trunk to autoland in stanzas like

    run-on-projects:
        by-test-platform:
            # do not run on ccov
            .*-ccov/.*: []
            .*-asan/.*: []
            (?:windows10-64|windows7-32|linux1804-64)(?:-qr)?/opt: ['mozilla-central', 'try']
            macosx.*64(?:-qr)?/opt: ['mozilla-central', 'try']
            # do not run on beta or release: usually just confirms earlier results
            default: ['trunk', 'try']

but due to resource constraints should leave the mozilla-central alone, right?

Flags: needinfo?(gbrown)

Yes, that seems best.

Flags: needinfo?(gbrown)
Assignee: nobody → bob
Status: NEW → ASSIGNED
Pushed by bclary@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/b6199c60bb46 do not run test verify on web platform tests on mozilla-central unless resource constrained, r=gbrown.
Summary: Do not run tier 2 test-verify on autoland → Do not run tier 2 test-verify on mozilla-central

https://hg.mozilla.org/mozilla-central/rev/b6199c60bb46

Status: ASSIGNED → RESOLVED
Closed: 5 years ago
status-firefox74: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla74

DO NOT LAND, hacky and not production-ready

Ricky, wrong bug number?

Flags: needinfo?(rstewart)

Comment on attachment 9126270 [details]
Bug 1609799 - Investigate feasability/impact of Cargo build plan usage in recursivemake.py

Yep, no idea what happened here, sorry :)

Attachment #9126270 - Attachment is obsolete: true
Flags: needinfo?(rstewart)
Whiteboard: [ci-costs-2020:done]
See Also: → 1621705
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: