Closed Bug 1464192 Opened 6 years ago Closed 6 years ago

Intermittent TEST-UNEXPECTED-TIMEOUT | automation.py | application timed out after 370 seconds with no output (mochitest shutdown)

Categories

(Testing :: Mochitest, defect, P5)

Version 3
defect

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 1414495

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell infra])

Filed by: archaeopteryx [at] coole-files.de

https://treeherder.mozilla.org/logviewer.html#?job_id=179522178&repo=autoland

https://queue.taskcluster.net/v1/task/Dk8zczoGS_KvE5YEpQ3YDw/runs/0/artifacts/public/logs/live_backing.log

16:03:47     INFO -  1273 INFO TEST-START | testing/mochitest/tests/MochiKit-1.4.2/tests/test_MochiKit-Visual.html
16:03:47     INFO -  GECKO(7344) | MEMORY STAT | vsize 2098593MB | vsizeMaxContiguous 130070674MB | residentFast 117MB | heapAllocated 29MB
16:03:47     INFO -  1274 INFO TEST-OK | testing/mochitest/tests/MochiKit-1.4.2/tests/test_MochiKit-Visual.html | took 210ms
16:03:47     INFO -  1275 INFO TEST-START | Shutdown
16:03:47     INFO -  1276 INFO Passed:  965
16:03:47     INFO -  1277 INFO Failed:  0
16:03:47     INFO -  1278 INFO Todo:    0
16:03:47     INFO -  1279 INFO Mode:    e10s
16:03:47     INFO -  1280 INFO Slowest: 1247ms - /tests/testing/mochitest/tests/MochiKit-1.4.2/tests/test_MochiKit-Async.html
16:03:47     INFO -  1281 INFO SimpleTest FINISHED
16:03:47     INFO -  1282 INFO TEST-INFO | Ran 1 Loops
16:03:47     INFO -  1283 INFO SimpleTest FINISHED
16:03:47     INFO -  GECKO(7344) | [Child 4168, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:03:47     INFO -  GECKO(7344) | [Parent 7344, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:03:47     INFO -  GECKO(7344) | [Child 4972, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:03:47     INFO -  GECKO(7344) | [Child 4972, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:03:47     INFO -  GECKO(7344) | [Parent 7344, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:03:47     INFO -  GECKO(7344) | [Child 7348, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:03:47     INFO -  GECKO(7344) | [Child 7348, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:03:47     INFO -  GECKO(7344) | [Parent 7344, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 188
16:03:47     INFO -  GECKO(7344) | *** UTM:SVC TimerManager:registerTimer called after profile-before-change notification. Ignoring timer registration for id: telemetry_modules_ping
16:03:47     INFO -  GECKO(7344) | 1526918627969	Marionette	DEBUG	Received observer notification xpcom-will-shutdown
16:03:47     INFO -  GECKO(7344) | 1526918627969	Marionette	INFO	Stopped listening on port 2828
16:03:47     INFO -  GECKO(7344) | 1526918627969	Marionette	DEBUG	Remote service is inactive
16:03:48     INFO -  TEST-INFO | Main app process: exit 0
16:03:48     INFO -  runtests.py | Application ran for: 0:00:07.370000
16:03:48     INFO -  zombiecheck | Reading PID log: c:\users\task_1526917675\appdata\local\temp\tmpdbfqwqpidlog
16:03:48     INFO -  ==> process 7344 launched child process 7348 ("Z:\task_1526917675\build\application\firefox\firefox.exe" -contentproc --channel="7344.0.538642827\2028648930" -childID 1 -isForBrowser -prefsHandle 2128 -prefsLen 16342 -schedulerPrefs 0001,2 -parentBuildID 20180521140644 -greomni "Z:\task_1526917675\build\application\firefox\omni.ja" -appomni "Z:\task_1526917675\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1526917675\build\application\firefox\browser" - 7344 "\\.\pipe\gecko-crash-server-pipe.7344" 1620 tab)
16:03:48     INFO -  ==> process 7344 launched child process 4972 ("Z:\task_1526917675\build\application\firefox\firefox.exe" -contentproc --channel="7344.6.429233043\2065591020" -childID 2 -isForBrowser -prefsHandle 2504 -prefsLen 16342 -schedulerPrefs 0001,2 -parentBuildID 20180521140644 -greomni "Z:\task_1526917675\build\application\firefox\omni.ja" -appomni "Z:\task_1526917675\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1526917675\build\application\firefox\browser" - 7344 "\\.\pipe\gecko-crash-server-pipe.7344" 2532 tab)
16:03:48     INFO -  ==> process 7344 launched child process 4168 ("Z:\task_1526917675\build\application\firefox\firefox.exe" -contentproc --channel="7344.12.1173213493\2138379638" -childID 3 -isForBrowser -prefsHandle 2884 -prefsLen 17652 -schedulerPrefs 0001,2 -parentBuildID 20180521140644 -greomni "Z:\task_1526917675\build\application\firefox\omni.ja" -appomni "Z:\task_1526917675\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1526917675\build\application\firefox\browser" - 7344 "\\.\pipe\gecko-crash-server-pipe.7344" 2896 tab)
16:03:48     INFO -  zombiecheck | Checking for orphan process with PID: 4168
16:03:48     INFO -  zombiecheck | Checking for orphan process with PID: 4972
16:03:48     INFO -  zombiecheck | Checking for orphan process with PID: 7348
16:03:48     INFO -  Stopping web server
16:03:48     INFO -  Stopping web socket server
16:03:48     INFO -  Stopping ssltunnel
16:03:48     INFO -  leakcheck | refcount logging is off, so leaks can't be detected!
16:03:48     INFO -  runtests.py | Running tests: end.
16:03:48     INFO -  Buffered messages finished
16:03:48     INFO -  Running manifest: toolkit\components\alerts\test\mochitest.ini
16:03:48     INFO -  Z:\task_1526917675\build\tests\bin\pk12util.exe: PKCS12 IMPORT SUCCESSFUL
16:03:48     INFO -  MochitestServer : launching [u'Z:\\task_1526917675\\build\\tests\\bin\\xpcshell.exe', '-g', 'Z:\\task_1526917675\\build\\application\\firefox', '-f', 'Z:\\task_1526917675\\build\\tests\\bin\\components\\httpd.js', '-e', "const _PROFILE_PATH = 'c:\\\\users\\\\task_1526917675\\\\appdata\\\\local\\\\temp\\\\tmpqm3ynl.mozrunner'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '127.0.0.1'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', 'Z:\\task_1526917675\\build\\tests\\mochitest\\server.js']
16:03:48     INFO -  runtests.py | Server pid: 776
16:03:48     INFO -  runtests.py | Websocket server pid: 7852
16:03:48     INFO -  runtests.py | SSL tunnel pid: 5180
16:03:48     INFO -  runtests.py | Running with e10s: True
16:03:48     INFO -  runtests.py | Running tests: start.
16:03:48     INFO -  Application command: Z:\task_1526917675\build\application\firefox\firefox.exe -marionette -foreground -profile c:\users\task_1526917675\appdata\local\temp\tmpqm3ynl.mozrunner
16:03:48     INFO -  runtests.py | Application pid: 3276
16:03:48     INFO -  TEST-INFO | started process GECKO(3276)
16:03:49     INFO -  GECKO(3276) | 1526918629150	addons.xpi-utils	WARN	Error: Synchronously loading the add-ons database (resource://gre/modules/addons/XPIDatabase.jsm:1386:17) JS Stack trace: syncLoadDB@XPIDatabase.jsm:1386:17
16:03:49     INFO -  GECKO(3276) | checkForChanges@XPIProvider.jsm:2775:9
16:03:49     INFO -  GECKO(3276) | startup@XPIProvider.jsm:2324:25
16:03:49     INFO -  GECKO(3276) | callProvider@AddonManager.jsm:205:12
16:03:49     INFO -  GECKO(3276) | _startProvider@AddonManager.jsm:653:5
16:03:49     INFO -  GECKO(3276) | startup@AddonManager.jsm:812:9
16:03:49     INFO -  GECKO(3276) | startup@AddonManager.jsm:2864:5
16:03:49     INFO -  GECKO(3276) | observe@addonManager.js:66:9
16:03:49     INFO -  GECKO(3276) | 1526918629247	addons.xpi-utils	WARN	Add-on workerbootstrap-test@mozilla.org is not compatible with application version.
16:03:49     INFO -  GECKO(3276) | 1526918629247	addons.xpi-utils	WARN	Add-on workerbootstrap-test@mozilla.org is not compatible with application version.
16:03:49     INFO -  GECKO(3276) | 1526918629247	addons.xpi-utils	WARN	Add-on workerbootstrap-test@mozilla.org is not compatible with application version.
16:03:49     INFO -  GECKO(3276) | 1526918629470	addons.xpi	WARN	Error loading bootstrap.js for workerbootstrap-test@mozilla.org: Error opening input stream (invalid filename?): jar:file:///C:/Users/task_1526917675/AppData/Local/Temp/tmpqm3ynl.mozrunner/extensions/workerbootstrap-test@mozilla.org.xpi!/bootstrap.js
16:03:49     INFO -  GECKO(3276) | 1526918629470	addons.xpi	WARN	Add-on workerbootstrap-test@mozilla.org is missing bootstrap method install
16:03:49     INFO -  GECKO(3276) | 1526918629531	Marionette	DEBUG	Received observer notification profile-after-change
16:06:49     INFO -  runtests.py | Waiting for browser...
16:09:59     INFO -  Buffered messages finished
16:09:59  WARNING -  TEST-UNEXPECTED-TIMEOUT | automation.py | application timed out after 370 seconds with no output
Over the last 7 days there are 34 failures on this bug. These happen only on windows10-64.
Here is the most recent log example: https://treeherder.mozilla.org/logviewer.html#?job_id=180689527&repo=mozilla-central&lineNumber=3579

11:31:43     INFO -  Buffered messages finished
11:31:43  WARNING -  TEST-UNEXPECTED-TIMEOUT | automation.py | application timed out after 370 seconds with no output
11:31:43     INFO -  1143 ERROR Force-terminating active process(es).
11:31:43     INFO -  Determining child pids from psutil...
11:31:43     INFO -  []
11:31:43     INFO -  Found child pids: set([])
11:31:43     INFO -  Killing process: 7108
11:31:43     INFO -  TEST-INFO | started process screenshot
11:31:43     INFO -  TEST-INFO | screenshot: exit 0
11:31:43     INFO -  mozcrash kill_pid(): wait failed (-1) terminating pid 7108: error 5
11:31:43     INFO -  psutil found pid 7108 dead
11:31:43     INFO -  TEST-INFO | Main app process: exit 1
11:31:43     INFO -  Buffered messages finished
11:31:43    ERROR -  1144 ERROR TEST-UNEXPECTED-FAIL | automation.py | application terminated with exit code 1
11:31:43     INFO -  runtests.py | Application ran for: 0:06:10.816000
11:31:43     INFO -  zombiecheck | Reading PID log: c:\users\task_1527592326\appdata\local\temp\tmpkvsom0pidlog
11:31:43     INFO -  mozcrash Downloading symbols from: https://queue.taskcluster.net/v1/task/AFgleqlcTTWC4BiZqTUchQ/artifacts/public/build/target.crashreporter-symbols.zip
11:31:47     INFO -  mozcrash Copy/paste: Z:\task_1527592326\build\win32-minidump_stackwalk.exe c:\users\task_1527592326\appdata\local\temp\tmpsweq_n.mozrunner\minidumps\d9013781-b7b8-456f-ab46-8b2f5dd5d2a5.dmp c:\users\task_1527592326\appdata\local\temp\tmpedwjva
11:31:54     INFO -  mozcrash Saved minidump as Z:\task_1527592326\build\blobber_upload_dir\d9013781-b7b8-456f-ab46-8b2f5dd5d2a5.dmp
11:31:54  WARNING -  PROCESS-CRASH | automation.py | application crashed [None]
Flags: needinfo?(ahal)
This bug has failed 66 times in the last 7 days. It has failed on Windows 10 affecting opt, assan and pgo build types.
Here is a recent log https://treeherder.mozilla.org/logviewer.html#?job_id=182007224&repo=autoland&lineNumber=4569

Part of that log:02:10:25     INFO -  2892 INFO TEST-START | Shutdown
02:10:25     INFO -  2893 INFO Passed:  17
02:10:25     INFO -  2894 INFO Failed:  0
02:10:25     INFO -  2895 INFO Todo:    0
02:10:25     INFO -  2896 INFO Mode:    e10s
02:10:25     INFO -  2897 INFO Slowest: 1323ms - /tests/dom/file/ipc/tests/test_ipcBlob_createImageBitmap.html
02:10:25     INFO -  2898 INFO SimpleTest FINISHED
02:10:25     INFO -  2899 INFO TEST-INFO | Ran 1 Loops
02:10:25     INFO -  2900 INFO SimpleTest FINISHED
02:10:25     INFO -  GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Child 100, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Child 100, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Child 776, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Child 776, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 188
02:10:25     INFO -  GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Child 1108, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Child 1108, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
02:10:25     INFO -  GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 188
02:10:25     INFO -  GECKO(1556) | 1528251025624	Marionette	DEBUG	Received observer notification xpcom-will-shutdown
02:10:25     INFO -  GECKO(1556) | 1528251025625	Marionette	INFO	Stopped listening on port 2828
02:10:25     INFO -  GECKO(1556) | 1528251025626	Marionette	DEBUG	Remote service is inactive
02:10:25     INFO -  TEST-INFO | Main app process: exit 0
02:10:25     INFO -  runtests.py | Application ran for: 0:00:05.169000
02:10:25     INFO -  zombiecheck | Reading PID log: c:\users\task_1528249777\appdata\local\temp\tmpntodvkpidlog
02:10:25     INFO -  ==> process 1556 launched child process 1108 ("Z:\task_1528249777\build\application\firefox\firefox.exe" -contentproc --channel="1556.0.17387780\534709819" -childID 1 -isForBrowser -prefsHandle 1996 -prefsLen 16262 -schedulerPrefs 0001,2 -parentBuildID 20180606004725 -greomni "Z:\task_1528249777\build\application\firefox\omni.ja" -appomni "Z:\task_1528249777\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1528249777\build\application\firefox\browser" - 1556 "\\.\pipe\gecko-crash-server-pipe.1556" 2124 tab)
02:10:25     INFO -  ==> process 1556 launched child process 776 ("Z:\task_1528249777\build\application\firefox\firefox.exe" -contentproc --channel="1556.6.315738243\944970821" -childID 2 -isForBrowser -prefsHandle 2400 -prefsLen 16262 -schedulerPrefs 0001,2 -parentBuildID 20180606004725 -greomni "Z:\task_1528249777\build\application\firefox\omni.ja" -appomni "Z:\task_1528249777\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1528249777\build\application\firefox\browser" - 1556 "\\.\pipe\gecko-crash-server-pipe.1556" 2492 tab)
02:10:25     INFO -  ==> process 1556 launched child process 100 ("Z:\task_1528249777\build\application\firefox\firefox.exe" -contentproc --channel="1556.12.1786728428\1204162066" -childID 3 -isForBrowser -prefsHandle 2864 -prefsLen 17572 -schedulerPrefs 0001,2 -parentBuildID 20180606004725 -greomni "Z:\task_1528249777\build\application\firefox\omni.ja" -appomni "Z:\task_1528249777\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1528249777\build\application\firefox\browser" - 1556 "\\.\pipe\gecko-crash-server-pipe.1556" 2768 tab)
02:10:25     INFO -  zombiecheck | Checking for orphan process with PID: 776
02:10:25     INFO -  zombiecheck | Checking for orphan process with PID: 100
02:10:25     INFO -  zombiecheck | Checking for orphan process with PID: 1108
02:10:25     INFO -  Stopping web server
02:10:25     INFO -  Stopping web socket server
02:10:25     INFO -  Stopping ssltunnel
02:10:25     INFO -  leakcheck | refcount logging is off, so leaks can't be detected!
02:10:25     INFO -  runtests.py | Running tests: end.
02:10:25     INFO -  Buffered messages finished
02:10:25     INFO -  Running manifest: dom\file\tests\mochitest.ini
02:10:26     INFO -  Z:\task_1528249777\build\tests\bin\pk12util.exe: PKCS12 IMPORT SUCCESSFUL
02:10:26     INFO -  MochitestServer : launching [u'Z:\\task_1528249777\\build\\tests\\bin\\xpcshell.exe', '-g', 'Z:\\task_1528249777\\build\\application\\firefox', '-f', 'Z:\\task_1528249777\\build\\tests\\bin\\components\\httpd.js', '-e', "const _PROFILE_PATH = 'c:\\\\users\\\\task_1528249777\\\\appdata\\\\local\\\\temp\\\\tmpvua_5h.mozrunner'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '127.0.0.1'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', 'Z:\\task_1528249777\\build\\tests\\mochitest\\server.js']
02:10:26     INFO -  runtests.py | Server pid: 624
02:10:26     INFO -  runtests.py | Websocket server pid: 1076
02:10:26     INFO -  runtests.py | SSL tunnel pid: 3984
02:10:26     INFO -  runtests.py | Running with e10s: True
02:10:26     INFO -  runtests.py | Running tests: start.
02:10:26     INFO -  Application command: Z:\task_1528249777\build\application\firefox\firefox.exe -marionette -foreground -profile c:\users\task_1528249777\appdata\local\temp\tmpvua_5h.mozrunner
02:10:26     INFO -  runtests.py | Application pid: 5876
02:10:26     INFO -  TEST-INFO | started process GECKO(5876)
02:10:27     INFO -  GECKO(5876) | 1528251027162	Marionette	DEBUG	Received observer notification profile-after-change
02:13:26     INFO -  runtests.py | Waiting for browser...
02:16:37     INFO -  Buffered messages finished
02:16:37  WARNING -  TEST-UNEXPECTED-TIMEOUT | automation.py | application timed out after 370 seconds with no output
02:16:37     INFO -  2901 ERROR Force-terminating active process(es).
02:16:37     INFO -  Determining child pids from psutil...
02:16:37     INFO -  []
02:16:37     INFO -  Found child pids: set([])
02:16:37     INFO -  Killing process: 5876
02:16:37     INFO -  TEST-INFO | started process screenshot
02:16:37     INFO -  TEST-INFO | screenshot: exit 0
02:16:37     INFO -  mozcrash kill_pid(): wait failed (-1) terminating pid 5876: error 5
02:16:37     INFO -  psutil found pid 5876 dead
02:16:37     INFO -  TEST-INFO | Main app process: exit 1
02:16:37     INFO -  Buffered messages finished
02:16:37    ERROR -  2902 ERROR TEST-UNEXPECTED-FAIL | automation.py | application terminated with exit code 1
02:16:37     INFO -  runtests.py | Application ran for: 0:06:10.863000
02:16:37     INFO -  zombiecheck | Reading PID log: c:\users\task_1528249777\appdata\local\temp\tmpbzgzqqpidlog
02:16:37     INFO -  mozcrash Downloading symbols from: https://queue.taskcluster.net/v1/task/HuNAr3G5TROGk8YquA-WRg/artifacts/public/build/target.crashreporter-symbols.zip
02:16:41     INFO -  mozcrash Copy/paste: Z:\task_1528249777\build\win32-minidump_stackwalk.exe c:\users\task_1528249777\appdata\local\temp\tmpvua_5h.mozrunner\minidumps\c75f67a5-4a4b-42cb-bb80-154671b79e68.dmp c:\users\task_1528249777\appdata\local\temp\tmpzjy9vm
02:16:50     INFO -  mozcrash Saved minidump as Z:\task_1528249777\build\blobber_upload_dir\c75f67a5-4a4b-42cb-bb80-154671b79e68.dmp
02:16:50  WARNING -  PROCESS-CRASH | automation.py | application crashed [None]
02:16:50     INFO -  Crash dump filename: c:\users\task_1528249777\appdata\local\temp\tmpvua_5h.mozrunner\minidumps\c75f67a5-4a4b-42cb-bb80-154671b79e68.dmp
02:16:50     INFO -  Operating system: Windows 

jmaher: could you please take a look at this bug.
Flags: needinfo?(jmaher)
Whiteboard: [stockwell needswork]
this bug is a dup of bug 1414495, I don't see anything which differentiates this as a hang on shutdown from a hang on startup.
Status: NEW → RESOLVED
Closed: 6 years ago
Flags: needinfo?(jmaher)
Flags: needinfo?(ahal)
Resolution: --- → DUPLICATE
Whiteboard: [stockwell needswork] → [stockwell infra]
Pushed by gabriel.luong@gmail.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/973fbb5bbadc
Part 18: Lazy load modules in the css-logic. r=pbro
Pushed by gabriel.luong@gmail.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/b114236a192e
Part 21: Lazy initialize KeyShortcuts on focus of the HTMLBreadcrumbs. r=pbro
Pushed by nerli@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/522b47a9ae93
Part 18: Lazy load modules in the css-logic. r=pbro
You need to log in before you can comment on or make changes to this bug.