Closed Bug 541705 Opened 15 years ago Closed 15 years ago

Talos orange: Intermittent "timeout exceeded" in ts_cold, ts_cold_generated_max, ts_cold_generated_med, ts_cold_generated_min

Categories

(Release Engineering :: General, defect, P2)

Product:
Release Engineering
Component:
General
Platform:
x86
macOS
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: philor, Assigned: anodelman)

References

Details

(Keywords: intermittent-failure, Whiteboard: [talos])

Attachments

(1 file)

remove restrictive timeouts on dirty ts tests
2.63 KB, patch
catlee
: review+
bhearsum
: checked-in+
Details | Diff | Splinter Review
May just be a different message saying the same thing as the bug 537147 "failed to initialize browser" - it's opaque enough that I don't really know. These are from the last 48 hours (and all of them from that period, I think): http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264250929.1264251934.11668.gz MacOSX Darwin 9.0.0 mozilla-central talos cold on 2010/01/23 04:48:49 FAIL: Busted: ts_cold FAIL: timeout exceeded http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264127208.1264132607.2735.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/01/21 18:26:48 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264152853.1264157695.1198.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/01/22 01:34:13 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264445277.1264450108.28788.gz FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264457578.1264463296.17497.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/01/25 14:12:58 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
Since I'm looking at the related bug, I'll take on this as well.
Assignee: nobody → anodelman
Just because everyone loves another branch, http://tinderbox.mozilla.org/showlog.cgi?log=Firefox3.5/1264532830.1264542338.6433.gz MacOSX Darwin 9.0.0 mozilla-1.9.1 talos dirty on 2010/01/26 11:07:10 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264559891.1264565285.13222.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/01/26 18:38:11 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264793150.1264800443.30720.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/01/29 11:25:50 FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264828199.1264836033.31672.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/01/29 21:09:59 FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1264989546.1264997013.26896.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/01/31 17:59:06 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox3.6/1265140159.1265147295.7409.gz MacOSX Darwin 9.0.0 mozilla-1.9.2 talos dirty on 2010/02/02 11:49:19 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265184004.1265184878.11772.gz MacOSX Darwin 9.0.0 mozilla-central talos cold on 2010/02/03 00:00:04 FAIL: Busted: ts_cold FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265297135.1265297998.25033.gz MacOSX Darwin 9.0.0 mozilla-central talos cold on 2010/02/04 07:25:35 FAIL: Busted: ts_cold FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265297891.1265302537.15114.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/04 07:38:11 FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265309557.1265313909.17690.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/04 10:52:37 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265341026.1265347759.5055.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/04 19:37:06 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265415566.1265422780.9982.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/05 16:19:26 FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265479993.1265484267.18958.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/06 10:13:13 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265486102.1265493878.27729.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/06 11:55:02 FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265522225.1265527168.2131.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/06 21:57:05 FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265554283.1265558675.8851.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/07 06:51:23 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265562425.1265566994.7472.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/07 09:07:05 FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265636873.1265641758.21369.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/08 05:47:53 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265653318.1265660559.18796.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/08 10:21:58 FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265666459.1265672209.25358.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/08 14:00:59 FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265686087.1265690387.10026.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/08 19:28:07 s: talos-rev2-leopard04 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded And since I just (rather belatedly) figured out how to find the slave number in Talos logs, I looked at the frequency among the logs I'd pasted, and while I don't know anything about how Talos slave assignment works, it seems like it might be significant: talos-rev2-leopard04 ********************* talos-rev2-leopard06 *** talos-rev2-leopard12 **
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265717500.1265725229.863.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/09 04:11:40 s: talos-rev2-leopard04 FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265740276.1265744569.6688.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/09 10:31:16 s: talos-rev2-leopard06 FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265778014.1265785514.16351.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/09 21:00:14 s: talos-rev2-leopard04 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265814920.1265819533.21371.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/10 07:15:20 s: talos-rev2-leopard04 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265938201.1265941528.27549.gz WINNT 6.0 mozilla-central talos dirty on 2010/02/11 17:30:01 s: talos-rev2-vista03 FAIL: Busted: ts_cold_generated_max FAIL: timeout exceeded
s: talos-rev2-leopard04 FAIL: Busted: ts_cold_generated_min FAIL: timeout exceeded http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1265974569.1265981021.17214.gz MacOSX Darwin 9.0.0 mozilla-central talos dirty on 2010/02/12 03:36:09 s: talos-rev2-leopard04 FAIL: Busted: ts_cold_generated_med FAIL: timeout exceeded
Not currently working on this, putting back in the pool.
Assignee: anodelman → nobody
Priority: -- → P5
Whiteboard: [orange] → [orange][talos]
Summary: Intermittent "timeout exceeded" in ts_cold, ts_cold_generated_max, ts_cold_generated_med, ts_cold_generated_min → talos orange: Intermittent "timeout exceeded" in ts_cold, ts_cold_generated_max, ts_cold_generated_med, ts_cold_generated_min
Summary: talos orange: Intermittent "timeout exceeded" in ts_cold, ts_cold_generated_max, ts_cold_generated_med, ts_cold_generated_min → Talos orange: Intermittent "timeout exceeded" in ts_cold, ts_cold_generated_max, ts_cold_generated_med, ts_cold_generated_min
The dirty ts tests were based on the same timeout formula as the clean ts test - and are only allowed to take 150 seconds to complete. This simply isn't enough time for the dirty tests. Going to remove that restriction. We'll still catch super slow/frozen browsers in the bcontroller, so I'm not worried that this will leave us with tied up talos tests forever.
Assignee: nobody → anodelman
Attachment #444533 - Flags: review?(catlee)
Priority: P5 → P2
Attachment #444533 - Flags: review?(catlee) → review+
Blocks: 564914
Comment on attachment 444533 [details] [diff] [review] remove restrictive timeouts on dirty ts tests Checking in sample.config; /cvsroot/mozilla/testing/performance/talos/sample.config,v <-- sample.config new revision: 1.44; previous revision: 1.43 done
Attachment #444533 - Flags: checked-in+
I presume this bug is FIXED with the this patch checked in.
Status: NEW → RESOLVED
Closed: 15 years ago
Resolution: --- → FIXED
Whiteboard: [orange][talos] → [talos]
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: