Closed Bug 1464192 Opened 7 years ago Closed 7 years ago

Intermittent TEST-UNEXPECTED-TIMEOUT | automation.py | application timed out after 370 seconds with no output (mochitest shutdown)

Categories

(Testing :: Mochitest, defect, P5)

Version 3
defect

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 1414495

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell infra])

Filed by: archaeopteryx [at] coole-files.de https://treeherder.mozilla.org/logviewer.html#?job_id=179522178&repo=autoland https://queue.taskcluster.net/v1/task/Dk8zczoGS_KvE5YEpQ3YDw/runs/0/artifacts/public/logs/live_backing.log 16:03:47 INFO - 1273 INFO TEST-START | testing/mochitest/tests/MochiKit-1.4.2/tests/test_MochiKit-Visual.html 16:03:47 INFO - GECKO(7344) | MEMORY STAT | vsize 2098593MB | vsizeMaxContiguous 130070674MB | residentFast 117MB | heapAllocated 29MB 16:03:47 INFO - 1274 INFO TEST-OK | testing/mochitest/tests/MochiKit-1.4.2/tests/test_MochiKit-Visual.html | took 210ms 16:03:47 INFO - 1275 INFO TEST-START | Shutdown 16:03:47 INFO - 1276 INFO Passed: 965 16:03:47 INFO - 1277 INFO Failed: 0 16:03:47 INFO - 1278 INFO Todo: 0 16:03:47 INFO - 1279 INFO Mode: e10s 16:03:47 INFO - 1280 INFO Slowest: 1247ms - /tests/testing/mochitest/tests/MochiKit-1.4.2/tests/test_MochiKit-Async.html 16:03:47 INFO - 1281 INFO SimpleTest FINISHED 16:03:47 INFO - 1282 INFO TEST-INFO | Ran 1 Loops 16:03:47 INFO - 1283 INFO SimpleTest FINISHED 16:03:47 INFO - GECKO(7344) | [Child 4168, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 16:03:47 INFO - GECKO(7344) | [Parent 7344, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 16:03:47 INFO - GECKO(7344) | [Child 4972, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 16:03:47 INFO - GECKO(7344) | [Child 4972, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 16:03:47 INFO - GECKO(7344) | [Parent 7344, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 16:03:47 INFO - GECKO(7344) | [Child 7348, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 16:03:47 INFO - GECKO(7344) | [Child 7348, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 16:03:47 INFO - GECKO(7344) | [Parent 7344, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 188 16:03:47 INFO - GECKO(7344) | *** UTM:SVC TimerManager:registerTimer called after profile-before-change notification. Ignoring timer registration for id: telemetry_modules_ping 16:03:47 INFO - GECKO(7344) | 1526918627969 Marionette DEBUG Received observer notification xpcom-will-shutdown 16:03:47 INFO - GECKO(7344) | 1526918627969 Marionette INFO Stopped listening on port 2828 16:03:47 INFO - GECKO(7344) | 1526918627969 Marionette DEBUG Remote service is inactive 16:03:48 INFO - TEST-INFO | Main app process: exit 0 16:03:48 INFO - runtests.py | Application ran for: 0:00:07.370000 16:03:48 INFO - zombiecheck | Reading PID log: c:\users\task_1526917675\appdata\local\temp\tmpdbfqwqpidlog 16:03:48 INFO - ==> process 7344 launched child process 7348 ("Z:\task_1526917675\build\application\firefox\firefox.exe" -contentproc --channel="7344.0.538642827\2028648930" -childID 1 -isForBrowser -prefsHandle 2128 -prefsLen 16342 -schedulerPrefs 0001,2 -parentBuildID 20180521140644 -greomni "Z:\task_1526917675\build\application\firefox\omni.ja" -appomni "Z:\task_1526917675\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1526917675\build\application\firefox\browser" - 7344 "\\.\pipe\gecko-crash-server-pipe.7344" 1620 tab) 16:03:48 INFO - ==> process 7344 launched child process 4972 ("Z:\task_1526917675\build\application\firefox\firefox.exe" -contentproc --channel="7344.6.429233043\2065591020" -childID 2 -isForBrowser -prefsHandle 2504 -prefsLen 16342 -schedulerPrefs 0001,2 -parentBuildID 20180521140644 -greomni "Z:\task_1526917675\build\application\firefox\omni.ja" -appomni "Z:\task_1526917675\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1526917675\build\application\firefox\browser" - 7344 "\\.\pipe\gecko-crash-server-pipe.7344" 2532 tab) 16:03:48 INFO - ==> process 7344 launched child process 4168 ("Z:\task_1526917675\build\application\firefox\firefox.exe" -contentproc --channel="7344.12.1173213493\2138379638" -childID 3 -isForBrowser -prefsHandle 2884 -prefsLen 17652 -schedulerPrefs 0001,2 -parentBuildID 20180521140644 -greomni "Z:\task_1526917675\build\application\firefox\omni.ja" -appomni "Z:\task_1526917675\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1526917675\build\application\firefox\browser" - 7344 "\\.\pipe\gecko-crash-server-pipe.7344" 2896 tab) 16:03:48 INFO - zombiecheck | Checking for orphan process with PID: 4168 16:03:48 INFO - zombiecheck | Checking for orphan process with PID: 4972 16:03:48 INFO - zombiecheck | Checking for orphan process with PID: 7348 16:03:48 INFO - Stopping web server 16:03:48 INFO - Stopping web socket server 16:03:48 INFO - Stopping ssltunnel 16:03:48 INFO - leakcheck | refcount logging is off, so leaks can't be detected! 16:03:48 INFO - runtests.py | Running tests: end. 16:03:48 INFO - Buffered messages finished 16:03:48 INFO - Running manifest: toolkit\components\alerts\test\mochitest.ini 16:03:48 INFO - Z:\task_1526917675\build\tests\bin\pk12util.exe: PKCS12 IMPORT SUCCESSFUL 16:03:48 INFO - MochitestServer : launching [u'Z:\\task_1526917675\\build\\tests\\bin\\xpcshell.exe', '-g', 'Z:\\task_1526917675\\build\\application\\firefox', '-f', 'Z:\\task_1526917675\\build\\tests\\bin\\components\\httpd.js', '-e', "const _PROFILE_PATH = 'c:\\\\users\\\\task_1526917675\\\\appdata\\\\local\\\\temp\\\\tmpqm3ynl.mozrunner'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '127.0.0.1'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', 'Z:\\task_1526917675\\build\\tests\\mochitest\\server.js'] 16:03:48 INFO - runtests.py | Server pid: 776 16:03:48 INFO - runtests.py | Websocket server pid: 7852 16:03:48 INFO - runtests.py | SSL tunnel pid: 5180 16:03:48 INFO - runtests.py | Running with e10s: True 16:03:48 INFO - runtests.py | Running tests: start. 16:03:48 INFO - Application command: Z:\task_1526917675\build\application\firefox\firefox.exe -marionette -foreground -profile c:\users\task_1526917675\appdata\local\temp\tmpqm3ynl.mozrunner 16:03:48 INFO - runtests.py | Application pid: 3276 16:03:48 INFO - TEST-INFO | started process GECKO(3276) 16:03:49 INFO - GECKO(3276) | 1526918629150 addons.xpi-utils WARN Error: Synchronously loading the add-ons database (resource://gre/modules/addons/XPIDatabase.jsm:1386:17) JS Stack trace: syncLoadDB@XPIDatabase.jsm:1386:17 16:03:49 INFO - GECKO(3276) | checkForChanges@XPIProvider.jsm:2775:9 16:03:49 INFO - GECKO(3276) | startup@XPIProvider.jsm:2324:25 16:03:49 INFO - GECKO(3276) | callProvider@AddonManager.jsm:205:12 16:03:49 INFO - GECKO(3276) | _startProvider@AddonManager.jsm:653:5 16:03:49 INFO - GECKO(3276) | startup@AddonManager.jsm:812:9 16:03:49 INFO - GECKO(3276) | startup@AddonManager.jsm:2864:5 16:03:49 INFO - GECKO(3276) | observe@addonManager.js:66:9 16:03:49 INFO - GECKO(3276) | 1526918629247 addons.xpi-utils WARN Add-on workerbootstrap-test@mozilla.org is not compatible with application version. 16:03:49 INFO - GECKO(3276) | 1526918629247 addons.xpi-utils WARN Add-on workerbootstrap-test@mozilla.org is not compatible with application version. 16:03:49 INFO - GECKO(3276) | 1526918629247 addons.xpi-utils WARN Add-on workerbootstrap-test@mozilla.org is not compatible with application version. 16:03:49 INFO - GECKO(3276) | 1526918629470 addons.xpi WARN Error loading bootstrap.js for workerbootstrap-test@mozilla.org: Error opening input stream (invalid filename?): jar:file:///C:/Users/task_1526917675/AppData/Local/Temp/tmpqm3ynl.mozrunner/extensions/workerbootstrap-test@mozilla.org.xpi!/bootstrap.js 16:03:49 INFO - GECKO(3276) | 1526918629470 addons.xpi WARN Add-on workerbootstrap-test@mozilla.org is missing bootstrap method install 16:03:49 INFO - GECKO(3276) | 1526918629531 Marionette DEBUG Received observer notification profile-after-change 16:06:49 INFO - runtests.py | Waiting for browser... 16:09:59 INFO - Buffered messages finished 16:09:59 WARNING - TEST-UNEXPECTED-TIMEOUT | automation.py | application timed out after 370 seconds with no output
Over the last 7 days there are 34 failures on this bug. These happen only on windows10-64. Here is the most recent log example: https://treeherder.mozilla.org/logviewer.html#?job_id=180689527&repo=mozilla-central&lineNumber=3579 11:31:43 INFO - Buffered messages finished 11:31:43 WARNING - TEST-UNEXPECTED-TIMEOUT | automation.py | application timed out after 370 seconds with no output 11:31:43 INFO - 1143 ERROR Force-terminating active process(es). 11:31:43 INFO - Determining child pids from psutil... 11:31:43 INFO - [] 11:31:43 INFO - Found child pids: set([]) 11:31:43 INFO - Killing process: 7108 11:31:43 INFO - TEST-INFO | started process screenshot 11:31:43 INFO - TEST-INFO | screenshot: exit 0 11:31:43 INFO - mozcrash kill_pid(): wait failed (-1) terminating pid 7108: error 5 11:31:43 INFO - psutil found pid 7108 dead 11:31:43 INFO - TEST-INFO | Main app process: exit 1 11:31:43 INFO - Buffered messages finished 11:31:43 ERROR - 1144 ERROR TEST-UNEXPECTED-FAIL | automation.py | application terminated with exit code 1 11:31:43 INFO - runtests.py | Application ran for: 0:06:10.816000 11:31:43 INFO - zombiecheck | Reading PID log: c:\users\task_1527592326\appdata\local\temp\tmpkvsom0pidlog 11:31:43 INFO - mozcrash Downloading symbols from: https://queue.taskcluster.net/v1/task/AFgleqlcTTWC4BiZqTUchQ/artifacts/public/build/target.crashreporter-symbols.zip 11:31:47 INFO - mozcrash Copy/paste: Z:\task_1527592326\build\win32-minidump_stackwalk.exe c:\users\task_1527592326\appdata\local\temp\tmpsweq_n.mozrunner\minidumps\d9013781-b7b8-456f-ab46-8b2f5dd5d2a5.dmp c:\users\task_1527592326\appdata\local\temp\tmpedwjva 11:31:54 INFO - mozcrash Saved minidump as Z:\task_1527592326\build\blobber_upload_dir\d9013781-b7b8-456f-ab46-8b2f5dd5d2a5.dmp 11:31:54 WARNING - PROCESS-CRASH | automation.py | application crashed [None]
Flags: needinfo?(ahal)
This bug has failed 66 times in the last 7 days. It has failed on Windows 10 affecting opt, assan and pgo build types. Here is a recent log https://treeherder.mozilla.org/logviewer.html#?job_id=182007224&repo=autoland&lineNumber=4569 Part of that log:02:10:25 INFO - 2892 INFO TEST-START | Shutdown 02:10:25 INFO - 2893 INFO Passed: 17 02:10:25 INFO - 2894 INFO Failed: 0 02:10:25 INFO - 2895 INFO Todo: 0 02:10:25 INFO - 2896 INFO Mode: e10s 02:10:25 INFO - 2897 INFO Slowest: 1323ms - /tests/dom/file/ipc/tests/test_ipcBlob_createImageBitmap.html 02:10:25 INFO - 2898 INFO SimpleTest FINISHED 02:10:25 INFO - 2899 INFO TEST-INFO | Ran 1 Loops 02:10:25 INFO - 2900 INFO SimpleTest FINISHED 02:10:25 INFO - GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Child 100, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Child 100, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Child 776, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Child 776, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 188 02:10:25 INFO - GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Child 1108, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Child 1108, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346 02:10:25 INFO - GECKO(1556) | [Parent 1556, Gecko_IOThread] WARNING: file z:/build/build/src/ipc/chromium/src/base/process_util_win.cc, line 188 02:10:25 INFO - GECKO(1556) | 1528251025624 Marionette DEBUG Received observer notification xpcom-will-shutdown 02:10:25 INFO - GECKO(1556) | 1528251025625 Marionette INFO Stopped listening on port 2828 02:10:25 INFO - GECKO(1556) | 1528251025626 Marionette DEBUG Remote service is inactive 02:10:25 INFO - TEST-INFO | Main app process: exit 0 02:10:25 INFO - runtests.py | Application ran for: 0:00:05.169000 02:10:25 INFO - zombiecheck | Reading PID log: c:\users\task_1528249777\appdata\local\temp\tmpntodvkpidlog 02:10:25 INFO - ==> process 1556 launched child process 1108 ("Z:\task_1528249777\build\application\firefox\firefox.exe" -contentproc --channel="1556.0.17387780\534709819" -childID 1 -isForBrowser -prefsHandle 1996 -prefsLen 16262 -schedulerPrefs 0001,2 -parentBuildID 20180606004725 -greomni "Z:\task_1528249777\build\application\firefox\omni.ja" -appomni "Z:\task_1528249777\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1528249777\build\application\firefox\browser" - 1556 "\\.\pipe\gecko-crash-server-pipe.1556" 2124 tab) 02:10:25 INFO - ==> process 1556 launched child process 776 ("Z:\task_1528249777\build\application\firefox\firefox.exe" -contentproc --channel="1556.6.315738243\944970821" -childID 2 -isForBrowser -prefsHandle 2400 -prefsLen 16262 -schedulerPrefs 0001,2 -parentBuildID 20180606004725 -greomni "Z:\task_1528249777\build\application\firefox\omni.ja" -appomni "Z:\task_1528249777\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1528249777\build\application\firefox\browser" - 1556 "\\.\pipe\gecko-crash-server-pipe.1556" 2492 tab) 02:10:25 INFO - ==> process 1556 launched child process 100 ("Z:\task_1528249777\build\application\firefox\firefox.exe" -contentproc --channel="1556.12.1786728428\1204162066" -childID 3 -isForBrowser -prefsHandle 2864 -prefsLen 17572 -schedulerPrefs 0001,2 -parentBuildID 20180606004725 -greomni "Z:\task_1528249777\build\application\firefox\omni.ja" -appomni "Z:\task_1528249777\build\application\firefox\browser\omni.ja" -appdir "Z:\task_1528249777\build\application\firefox\browser" - 1556 "\\.\pipe\gecko-crash-server-pipe.1556" 2768 tab) 02:10:25 INFO - zombiecheck | Checking for orphan process with PID: 776 02:10:25 INFO - zombiecheck | Checking for orphan process with PID: 100 02:10:25 INFO - zombiecheck | Checking for orphan process with PID: 1108 02:10:25 INFO - Stopping web server 02:10:25 INFO - Stopping web socket server 02:10:25 INFO - Stopping ssltunnel 02:10:25 INFO - leakcheck | refcount logging is off, so leaks can't be detected! 02:10:25 INFO - runtests.py | Running tests: end. 02:10:25 INFO - Buffered messages finished 02:10:25 INFO - Running manifest: dom\file\tests\mochitest.ini 02:10:26 INFO - Z:\task_1528249777\build\tests\bin\pk12util.exe: PKCS12 IMPORT SUCCESSFUL 02:10:26 INFO - MochitestServer : launching [u'Z:\\task_1528249777\\build\\tests\\bin\\xpcshell.exe', '-g', 'Z:\\task_1528249777\\build\\application\\firefox', '-f', 'Z:\\task_1528249777\\build\\tests\\bin\\components\\httpd.js', '-e', "const _PROFILE_PATH = 'c:\\\\users\\\\task_1528249777\\\\appdata\\\\local\\\\temp\\\\tmpvua_5h.mozrunner'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '127.0.0.1'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', 'Z:\\task_1528249777\\build\\tests\\mochitest\\server.js'] 02:10:26 INFO - runtests.py | Server pid: 624 02:10:26 INFO - runtests.py | Websocket server pid: 1076 02:10:26 INFO - runtests.py | SSL tunnel pid: 3984 02:10:26 INFO - runtests.py | Running with e10s: True 02:10:26 INFO - runtests.py | Running tests: start. 02:10:26 INFO - Application command: Z:\task_1528249777\build\application\firefox\firefox.exe -marionette -foreground -profile c:\users\task_1528249777\appdata\local\temp\tmpvua_5h.mozrunner 02:10:26 INFO - runtests.py | Application pid: 5876 02:10:26 INFO - TEST-INFO | started process GECKO(5876) 02:10:27 INFO - GECKO(5876) | 1528251027162 Marionette DEBUG Received observer notification profile-after-change 02:13:26 INFO - runtests.py | Waiting for browser... 02:16:37 INFO - Buffered messages finished 02:16:37 WARNING - TEST-UNEXPECTED-TIMEOUT | automation.py | application timed out after 370 seconds with no output 02:16:37 INFO - 2901 ERROR Force-terminating active process(es). 02:16:37 INFO - Determining child pids from psutil... 02:16:37 INFO - [] 02:16:37 INFO - Found child pids: set([]) 02:16:37 INFO - Killing process: 5876 02:16:37 INFO - TEST-INFO | started process screenshot 02:16:37 INFO - TEST-INFO | screenshot: exit 0 02:16:37 INFO - mozcrash kill_pid(): wait failed (-1) terminating pid 5876: error 5 02:16:37 INFO - psutil found pid 5876 dead 02:16:37 INFO - TEST-INFO | Main app process: exit 1 02:16:37 INFO - Buffered messages finished 02:16:37 ERROR - 2902 ERROR TEST-UNEXPECTED-FAIL | automation.py | application terminated with exit code 1 02:16:37 INFO - runtests.py | Application ran for: 0:06:10.863000 02:16:37 INFO - zombiecheck | Reading PID log: c:\users\task_1528249777\appdata\local\temp\tmpbzgzqqpidlog 02:16:37 INFO - mozcrash Downloading symbols from: https://queue.taskcluster.net/v1/task/HuNAr3G5TROGk8YquA-WRg/artifacts/public/build/target.crashreporter-symbols.zip 02:16:41 INFO - mozcrash Copy/paste: Z:\task_1528249777\build\win32-minidump_stackwalk.exe c:\users\task_1528249777\appdata\local\temp\tmpvua_5h.mozrunner\minidumps\c75f67a5-4a4b-42cb-bb80-154671b79e68.dmp c:\users\task_1528249777\appdata\local\temp\tmpzjy9vm 02:16:50 INFO - mozcrash Saved minidump as Z:\task_1528249777\build\blobber_upload_dir\c75f67a5-4a4b-42cb-bb80-154671b79e68.dmp 02:16:50 WARNING - PROCESS-CRASH | automation.py | application crashed [None] 02:16:50 INFO - Crash dump filename: c:\users\task_1528249777\appdata\local\temp\tmpvua_5h.mozrunner\minidumps\c75f67a5-4a4b-42cb-bb80-154671b79e68.dmp 02:16:50 INFO - Operating system: Windows jmaher: could you please take a look at this bug.
Flags: needinfo?(jmaher)
Whiteboard: [stockwell needswork]
this bug is a dup of bug 1414495, I don't see anything which differentiates this as a hang on shutdown from a hang on startup.
Status: NEW → RESOLVED
Closed: 7 years ago
Flags: needinfo?(jmaher)
Flags: needinfo?(ahal)
Resolution: --- → DUPLICATE
Whiteboard: [stockwell needswork] → [stockwell infra]
Pushed by gabriel.luong@gmail.com: https://hg.mozilla.org/integration/mozilla-inbound/rev/973fbb5bbadc Part 18: Lazy load modules in the css-logic. r=pbro
Pushed by gabriel.luong@gmail.com: https://hg.mozilla.org/integration/mozilla-inbound/rev/b114236a192e Part 21: Lazy initialize KeyShortcuts on focus of the HTMLBreadcrumbs. r=pbro
Pushed by nerli@mozilla.com: https://hg.mozilla.org/integration/mozilla-inbound/rev/522b47a9ae93 Part 18: Lazy load modules in the css-logic. r=pbro
You need to log in before you can comment on or make changes to this bug.