1635327 - Intermittent LeakSanitizer | LeakSanitizer has encountered a fatal error.

Status: RESOLVED FIXED

(Firefox Build System :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: dluca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=300796729&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fZ1W1iQlSFi35i2bi1DXeA/runs/0/artifacts/public/logs/live_backing.log

---

 INFO - TEST-START | dom/canvas/test/webgl-conf/generated/test_deqp__data__gles2__shaders__swizzles.html
[task 2020-05-05T02:25:46.401Z] 02:25:46     INFO - GECKO(1239) | MEMORY STAT | vsize 20976294MB | residentFast 2730MB
[task 2020-05-05T02:25:46.418Z] 02:25:46     INFO - TEST-OK | dom/canvas/test/webgl-conf/generated/test_deqp__data__gles2__shaders__swizzles.html | took 57780ms
[task 2020-05-05T02:25:46.494Z] 02:25:46     INFO - TEST-START | Shutdown
[task 2020-05-05T02:25:46.495Z] 02:25:46     INFO - Passed:  23040
[task 2020-05-05T02:25:46.495Z] 02:25:46     INFO - Failed:  0
[task 2020-05-05T02:25:46.497Z] 02:25:46     INFO - Todo:    0
[task 2020-05-05T02:25:46.497Z] 02:25:46     INFO - Mode:    e10s
[task 2020-05-05T02:25:46.498Z] 02:25:46     INFO - Slowest: 57780ms - /tests/dom/canvas/test/webgl-conf/generated/test_deqp__data__gles2__shaders__swizzles.html
[task 2020-05-05T02:25:46.499Z] 02:25:46     INFO - SimpleTest FINISHED
[task 2020-05-05T02:25:46.499Z] 02:25:46     INFO - TEST-INFO | Ran 1 Loops
[task 2020-05-05T02:25:46.500Z] 02:25:46     INFO - SimpleTest FINISHED
[task 2020-05-05T02:25:47.335Z] 02:25:47     INFO - GECKO(1239) | ###!!! [Child][MessageChannel] Error: (msgtype=0x200037,name=PBrowser::Msg___delete__) Channel closing: too late to send/recv, messages will be lost
[task 2020-05-05T02:25:48.634Z] 02:25:48     INFO - GECKO(1239) | 1588645548632	Marionette	TRACE	Received observer notification xpcom-will-shutdown
[task 2020-05-05T02:25:48.635Z] 02:25:48     INFO - GECKO(1239) | 1588645548632	Marionette	INFO	Stopped listening on port 2828
[task 2020-05-05T02:25:48.637Z] 02:25:48     INFO - GECKO(1239) | 1588645548632	Marionette	DEBUG	Marionette stopped listening
[task 2020-05-05T02:25:48.699Z] 02:25:48     INFO - GECKO(1239) | -----------------------------------------------------
[task 2020-05-05T02:25:48.699Z] 02:25:48     INFO - GECKO(1239) | Suppressions used:
[task 2020-05-05T02:25:48.699Z] 02:25:48     INFO - GECKO(1239) |   count      bytes template
[task 2020-05-05T02:25:48.699Z] 02:25:48     INFO - GECKO(1239) |      24        744 nsComponentManagerImpl
[task 2020-05-05T02:25:48.699Z] 02:25:48     INFO - GECKO(1239) |     633      18287 libfontconfig.so
[task 2020-05-05T02:25:48.699Z] 02:25:48     INFO - GECKO(1239) |       1         11 libglib-2.0.so
[task 2020-05-05T02:25:48.702Z] 02:25:48     INFO - GECKO(1239) | -----------------------------------------------------
[task 2020-05-05T02:25:48.865Z] 02:25:48     INFO - GECKO(1239) | -----------------------------------------------------
[task 2020-05-05T02:25:48.865Z] 02:25:48     INFO - GECKO(1239) | Suppressions used:
[task 2020-05-05T02:25:48.865Z] 02:25:48     INFO - GECKO(1239) |   count      bytes template
[task 2020-05-05T02:25:48.865Z] 02:25:48     INFO - GECKO(1239) |      24        744 nsComponentManagerImpl
[task 2020-05-05T02:25:48.866Z] 02:25:48     INFO - GECKO(1239) |       2        288 libfontconfig.so
[task 2020-05-05T02:25:48.866Z] 02:25:48     INFO - GECKO(1239) | -----------------------------------------------------
[task 2020-05-05T02:25:49.110Z] 02:25:49     INFO - GECKO(1239) | Tracer caught signal 11: addr=0x0 pc=0x55c1755cb1d9 sp=0x7f533e119d30
[task 2020-05-05T02:25:49.131Z] 02:25:49     INFO - GECKO(1239) | ==1321==LeakSanitizer has encountered a fatal error.
[task 2020-05-05T02:25:49.132Z] 02:25:49     INFO - GECKO(1239) | ==1321==HINT: For debugging, try setting environment variable LSAN_OPTIONS=verbosity=1:log_threads=1
[task 2020-05-05T02:25:49.132Z] 02:25:49     INFO - GECKO(1239) | ==1321==HINT: LeakSanitizer does not work under ptrace (strace, gdb, etc)
[task 2020-05-05T02:25:49.680Z] 02:25:49     INFO - GECKO(1239) | -----------------------------------------------------
[task 2020-05-05T02:25:49.681Z] 02:25:49     INFO - GECKO(1239) | Suppressions used:
[task 2020-05-05T02:25:49.681Z] 02:25:49     INFO - GECKO(1239) |   count      bytes template
[task 2020-05-05T02:25:49.681Z] 02:25:49     INFO - GECKO(1239) |       1         32 nsComponentManagerImpl
[task 2020-05-05T02:25:49.681Z] 02:25:49     INFO - GECKO(1239) | -----------------------------------------------------
[task 2020-05-05T02:25:51.430Z] 02:25:51     INFO - GECKO(1239) | -----------------------------------------------------
[task 2020-05-05T02:25:51.430Z] 02:25:51     INFO - GECKO(1239) | Suppressions used:
[task 2020-05-05T02:25:51.430Z] 02:25:51     INFO - GECKO(1239) |   count      bytes template
[task 2020-05-05T02:25:51.430Z] 02:25:51     INFO - GECKO(1239) |      21        640 nsComponentManagerImpl
[task 2020-05-05T02:25:51.430Z] 02:25:51     INFO - GECKO(1239) |     633      18083 libfontconfig.so
[task 2020-05-05T02:25:51.430Z] 02:25:51     INFO - GECKO(1239) |       1         11 libglib-2.0.so
[task 2020-05-05T02:25:51.430Z] 02:25:51     INFO - GECKO(1239) |       4        832 mozJSComponentLoader
[task 2020-05-05T02:25:51.430Z] 02:25:51     INFO - GECKO(1239) | -----------------------------------------------------
[task 2020-05-05T02:25:51.572Z] 02:25:51     INFO - TEST-INFO | Main app process: exit 0
[task 2020-05-05T02:25:51.573Z] 02:25:51    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | LeakSanitizer has encountered a fatal error.
[task 2020-05-05T02:25:51.573Z] 02:25:51     INFO - runtests.py | Application ran for: 0:15:48.974543
[task 2020-05-05T02:25:51.573Z] 02:25:51     INFO - zombiecheck | Reading PID log: /tmp/tmpvSFCY2pidlog
[task 2020-05-05T02:25:51.574Z] 02:25:51     INFO - ==> process 1239 launched child process 1255
[task 2020-05-05T02:25:51.574Z] 02:25:51     INFO - ==> process 1239 launched child process 1321
[task 2020-05-05T02:25:51.575Z] 02:25:51     INFO - ==> process 1239 launched child process 1333
[task 2020-05-05T02:25:51.575Z] 02:25:51     INFO - ==> process 1239 launched child process 1401
[task 2020-05-05T02:25:51.577Z] 02:25:51     INFO - ==> process 1239 launched child process 1506
[task 2020-05-05T02:25:51.577Z] 02:25:51     INFO - zombiecheck | Checking for orphan process with PID: 1321
[task 2020-05-05T02:25:51.577Z] 02:25:51     INFO - zombiecheck | Checking for orphan process with PID: 1401
[task 2020-05-05T02:25:51.578Z] 02:25:51     INFO - zombiecheck | Checking for orphan process with PID: 1506
[task 2020-05-05T02:25:51.578Z] 02:25:51     INFO - zombiecheck | Checking for orphan process with PID: 1333
[task 2020-05-05T02:25:51.579Z] 02:25:51     INFO - zombiecheck | Checking for orphan process with PID: 1255
[task 2020-05-05T02:25:51.580Z] 02:25:51     INFO - Stopping web server
[task 2020-05-05T02:25:51.585Z] 02:25:51     INFO - Stopping web socket server
[task 2020-05-05T02:25:51.595Z] 02:25:51     INFO - Stopping ssltunnel
[task 2020-05-05T02:25:51.611Z] 02:25:51  WARNING - leakcheck | refcount logging is off, so leaks can't be detected!
[task 2020-05-05T02:25:51.611Z] 02:25:51     INFO - runtests.py | Running tests: end.
[task 2020-05-05T02:25:51.733Z] 02:25:51     INFO - Buffered messages finished
[task 2020-05-05T02:25:51.735Z] 02:25:51     INFO -  0 INFO TEST-START | Shutdown
[task 2020-05-05T02:25:51.736Z] 02:25:51     INFO -  1 INFO Passed:  23040
[task 2020-05-05T02:25:51.737Z] 02:25:51     INFO -  2 INFO Failed:  1
[task 2020-05-05T02:25:51.738Z] 02:25:51     INFO -  3 INFO Todo:    0
[task 2020-05-05T02:25:51.739Z] 02:25:51     INFO -  4 INFO Mode:    e10s
[task 2020-05-05T02:25:51.741Z] 02:25:51     INFO -  5 INFO SimpleTest FINISHED
[task 2020-05-05T02:25:51.742Z] 02:25:51     INFO - Buffered messages finished
[task 2020-05-05T02:25:51.743Z] 02:25:51     INFO - SUITE-END | took 950s
[task 2020-05-05T02:25:51.791Z] 02:25:51    ERROR - Return code: 1
[task 2020-05-05T02:25:51.792Z] 02:25:51     INFO - TinderboxPrint: mochitest-mochitest-webgl1-ext<br/>566/0/0
[task 2020-05-05T02:25:51.792Z] 02:25:51    ERROR - # TBPL FAILURE #
[task 2020-05-05T02:25:51.792Z] 02:25:51  WARNING - setting return code to 2
[task 2020-05-05T02:25:51.793Z] 02:25:51    ERROR - The mochitest suite: mochitest-webgl1-ext ran with return status: FAILURE
[task 2020-05-05T02:25:51.793Z] 02:25:51     INFO - Running post-action listener: _package_coverage_data
[task 2020-05-05T02:25:51.794Z] 02:25:51     INFO - Running post-action listener: _resource_record_post_action
[task 2020-05-05T02:25:51.794Z] 02:25:51     INFO - Running post-action listener: process_java_coverage_data
[task 2020-05-05T02:25:51.794Z] 02:25:51     INFO - [mozharness: 2020-05-05 02:25:51.794553Z] Finished run-tests step (success)
[task 2020-05-05T02:25:51.795Z] 02:25:51     INFO - Running post-run listener: _resource_record_post_run
[task 2020-05-05T02:25:51.878Z] 02:25:51     INFO - Validating Perfherder data against /builds/worker/workspace/mozharness/external_tools/performance-artifact-schema.json
[task 2020-05-05T02:25:51.883Z] 02:25:51     INFO - PERFHERDER_DATA: {"framework": {"name": "job_resource_usage"}, "suites": [{"subtests": [{"name": "cpu_percent", "value": 65.12550403225809}, {"name": "io_write_bytes", "value": 2690289664}, {"name": "io.read_bytes", "value": 187650048}, {"name": "io_write_time", "value": 326432}, {"name": "io_read_time", "value": 2848}], "extraOptions": ["e10s", "taskcluster-m5.large"], "name": "mochitest.mochitest-webgl1-ext.1.overall"}, {"subtests": [{"name": "time", "value": 0.02826213836669922}], "name": "mochitest.mochitest-webgl1-ext.1.start-pulseaudio"}, {"subtests": [{"name": "time", "value": 42.00752305984497}, {"name": "cpu_percent", "value": 50.10125}], "name": "mochitest.mochitest-webgl1-ext.1.install"}, {"subtests": [{"name": "time", "value": 0.000659942626953125}], "name": "mochitest.mochitest-webgl1-ext.1.stage-files"}, {"subtests": [{"name": "time", "value": 951.6037278175354}, {"name": "cpu_percent", "value": 65.78678947368424}], "name": "mochitest.mochitest-webgl1-ext.1.run-tests"}]}
[task 2020-05-05T02:25:51.883Z] 02:25:51     INFO - Total resource usage - Wall time: 993s; CPU: 66.0%; Read bytes: 187650048; Write bytes: 2690289664; Read time: 2848; Write time: 326432
[task 2020-05-05T02:25:51.884Z] 02:25:51     INFO - TinderboxPrint: CPU usage<br/>65.8%
[task 2020-05-05T02:25:51.884Z] 02:25:51     INFO - TinderboxPrint: I/O read bytes / time<br/>187,650,048 / 2,848
[task 2020-05-05T02:25:51.885Z] 02:25:51     INFO - TinderboxPrint: I/O write bytes / time<br/>2,690,289,664 / 326,432
[task 2020-05-05T02:25:51.885Z] 02:25:51     INFO - TinderboxPrint: CPU idle<br/>679.2 (34.4%)
[task 2020-05-05T02:25:51.886Z] 02:25:51     INFO - TinderboxPrint: CPU system<br/>94.9 (4.8%)
[task 2020-05-05T02:25:51.886Z] 02:25:51     INFO - TinderboxPrint: CPU user<br/>1,190.3 (60.3%)
[task 2020-05-05T02:25:51.886Z] 02:25:51     INFO - TinderboxPrint: Swap in / out<br/>0 / 0
[task 2020-05-05T02:25:51.887Z] 02:25:51     INFO - start-pulseaudio - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2020-05-05T02:25:51.887Z] 02:25:51     INFO - install - Wall time: 42s; CPU: 50.0%; Read bytes: 57344; Write bytes: 2162782208; Read time: 608; Write time: 240668
[task 2020-05-05T02:25:51.888Z] 02:25:51     INFO - stage-files - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2020-05-05T02:25:51.893Z] 02:25:51     INFO - run-tests - Wall time: 952s; CPU: 66.0%; Read bytes: 187592704; Write bytes: 527507456; Read time: 2240; Write time: 85764
[task 2020-05-05T02:25:52.032Z] 02:25:52  WARNING - returning nonzero exit status 2

Comment 1

[Intermittent Failures Robot]

9 failures in 5276 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 2

Platform breakdown:

• linux1804-64-asan: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 2

[Intermittent Failures Robot]

5 failures in 5488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-beta: 1
• autoland: 2

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 3

[Intermittent Failures Robot]

12 failures in 4727 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3
• autoland: 8
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-05-18&endday=2020-05-24&tree=all

Comment 4

[Intermittent Failures Robot]

1 failures in 5458 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-05-25&endday=2020-05-31&tree=all

Comment 5

[Intermittent Failures Robot]

8 failures in 4949 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-beta: 2
• try: 1

Platform breakdown:

• linux1804-64-asan: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-06-01&endday=2020-06-07&tree=all

Comment 6

[Intermittent Failures Robot]

8 failures in 5211 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-central: 2
• autoland: 5

Platform breakdown:

• linux1804-64-asan: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-06-08&endday=2020-06-14&tree=all

Comment 7

[Intermittent Failures Robot]

8 failures in 4035 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-esr78: 1
• try: 2
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-06-15&endday=2020-06-21&tree=all

Comment 8

[Intermittent Failures Robot]

12 failures in 5252 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 9
• mozilla-central: 1
• mozilla-esr78: 1
• try: 1

Platform breakdown:

• linux1804-64-asan: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-06-22&endday=2020-06-28&tree=all

Comment 9

[Intermittent Failures Robot]

7 failures in 4516 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1
• autoland: 5
• try: 1

Platform breakdown:

• linux1804-64-asan: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-06-29&endday=2020-07-05&tree=all

Comment 10

[Intermittent Failures Robot]

3 failures in 5265 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-07-06&endday=2020-07-12&tree=all

Comment 11

[Intermittent Failures Robot]

10 failures in 4014 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 2

Platform breakdown:

• linux1804-64-asan: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-07-13&endday=2020-07-19&tree=all

Comment 12

[Intermittent Failures Robot]

6 failures in 4310 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-central: 2

Platform breakdown:

• linux1804-64-asan: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-07-20&endday=2020-07-26&tree=all

Comment 13

[Intermittent Failures Robot]

5 failures in 4289 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1
• try: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-07-27&endday=2020-08-02&tree=all

Comment 14

[Intermittent Failures Robot]

8 failures in 4618 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 1
• mozilla-esr78: 1
• try: 1

Platform breakdown:

• linux1804-64-asan: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-08-03&endday=2020-08-09&tree=all

Comment 15

[Intermittent Failures Robot]

5 failures in 3601 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-central: 1
• autoland: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-08-10&endday=2020-08-16&tree=all

Comment 16

[Intermittent Failures Robot]

4 failures in 4100 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-08-17&endday=2020-08-23&tree=all

Comment 17

[Intermittent Failures Robot]

3 failures in 4046 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• autoland: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-08-24&endday=2020-08-30&tree=all

Comment 18

[Intermittent Failures Robot]

3 failures in 2984 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• mozilla-beta: 2

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-08-31&endday=2020-09-06&tree=all

Comment 19

[Intermittent Failures Robot]

2 failures in 3410 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 20

[Intermittent Failures Robot]

4 failures in 3760 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• try: 1

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-09-14&endday=2020-09-20&tree=all

Comment 21

[Intermittent Failures Robot]

3 failures in 4019 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 22

[Intermittent Failures Robot]

3 failures in 4195 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-09-28&endday=2020-10-04&tree=all

Comment 23

[Intermittent Failures Robot]

5 failures in 4130 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-10-05&endday=2020-10-11&tree=all

Comment 24

[Intermittent Failures Robot]

2 failures in 3694 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-10-12&endday=2020-10-18&tree=all

Comment 25

[Intermittent Failures Robot]

5 failures in 4230 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 3
• try: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-10-19&endday=2020-10-25&tree=all

Comment 26

[Intermittent Failures Robot]

8 failures in 4275 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-beta: 1
• try: 2

Platform breakdown:

• linux1804-64-asan: 7
• linux1804-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 27

[Intermittent Failures Robot]

4 failures in 4128 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• try: 1
• mozilla-release: 1

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1635327&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 28

[Intermittent Failures Robot]

5 failures in 4040 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2
• mozilla-central: 3

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 29

[Intermittent Failures Robot]

5 failures in 4810 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1
• autoland: 2
• mozilla-central: 1
• mozilla-beta: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 30

[Intermittent Failures Robot]

2 failures in 1479 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform breakdown:

• linux1804-64-asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2020-11-23&endday=2020-11-29&tree=all

Comment 31

[Intermittent Failures Robot]

3 failures in 3712 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-beta: 1
• mozilla-esr78: 1

Platform breakdown:

• linux1804-64-asan: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 32

[Intermittent Failures Robot]

4 failures in 4060 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 3
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2020-12-07&endday=2020-12-13&tree=all

Comment 33

[Intermittent Failures Robot]

10 failures in 3421 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-central: 1
• mozilla-beta: 2
• try: 1

Platform breakdown:

• linux1804-64-asan: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 34

[Intermittent Failures Robot]

5 failures in 1450 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• autoland: 3
• mozilla-central: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2020-12-21&endday=2020-12-27&tree=all

Comment 35

[Intermittent Failures Robot]

5 failures in 525 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 1
• autoland: 2

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2020-12-28&endday=2021-01-03&tree=all

Comment 36

[Intermittent Failures Robot]

5 failures in 2956 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 2
• autoland: 2
• mozilla-esr78: 1

Platform breakdown:

• linux1804-64-asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 37

[Intermittent Failures Robot]

8 failures in 3810 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-beta: 2

Platform breakdown:

• linux1804-64-asan: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 38

[Intermittent Failures Robot]

9 failures in 3488 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-central: 3
• autoland: 4

Platform and build breakdown:

• linux1804-64-asan: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 39

[Intermittent Failures Robot]

9 failures in 3891 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-beta: 1
• mozilla-esr78: 1
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-asan: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 40

[Intermittent Failures Robot]

11 failures in 3966 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• try: 2
• mozilla-central: 3
• nss: 2

Platform and build breakdown:

• linux1804-64-asan: 9
  • opt: 9
• linux64: 2
  • asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-02-01&endday=2021-02-07&tree=all

Comment 41

[Intermittent Failures Robot]

7 failures in 4322 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 4
• try: 2
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-asan: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 42

[Intermittent Failures Robot]

10 failures in 3737 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 8
• mozilla-esr78: 1
• autoland: 1

Platform and build breakdown:

• linux1804-64-asan: 10
  • opt: 10

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 43

[Intermittent Failures Robot]

8 failures in 4327 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1
• autoland: 4
• mozilla-beta: 1
• try: 1
• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-asan: 8
  • opt: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-02-22&endday=2021-02-28&tree=all

Comment 44

[Intermittent Failures Robot]

9 failures in 3683 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 2
• mozilla-beta: 1
• try: 1

Platform and build breakdown:

• linux1804-64-asan: 9
  • opt: 9

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-03-01&endday=2021-03-07&tree=all

Comment 45

[Intermittent Failures Robot]

4 failures in 4622 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1
• autoland: 2
• mozilla-central: 1

Platform and build breakdown:

• linux1804-64-asan: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-03-08&endday=2021-03-14&tree=all

Comment 46

[Intermittent Failures Robot]

11 failures in 4257 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• mozilla-central: 4
• mozilla-release: 1
• try: 1

Platform and build breakdown:

• linux1804-64-asan: 11
  • opt: 11

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-03-15&endday=2021-03-21&tree=all

Comment 47

[Intermittent Failures Robot]

13 failures in 3967 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 5
• autoland: 4
• mozilla-central: 4

Platform and build breakdown:

• linux1804-64-asan: 13
  • opt: 13

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-03-22&endday=2021-03-28&tree=all

Comment 48

[Sandor Molnar[:smolnar]]

Andrew,can you take a look at these failures?
there seems to be a build bustage after "LeakSanitizer has encountered a fatal error"
https://treeherder.mozilla.org/logviewer?job_id=335260212&repo=autoland&lineNumber=31911

Comment 49

[Andrew McCreight [:mccr8]]

Here's an excerpt from a recent failure log:

[task 2021-04-02T07:34:47.004Z] 07:34:47 INFO - [style 0.0.1] cargo:rerun-if-changed=/builds/worker/workspace/obj-build/dist/include/js/ValueArray.h
[task 2021-04-02T07:34:47.004Z] 07:34:47 INFO - [style 0.0.1] Tracer caught signal 11: addr=0x0 pc=0x55f22afbc174 sp=0x7ff0511b8d40
[task 2021-04-02T07:34:47.004Z] 07:34:47 INFO - [style 0.0.1] ==16819==LeakSanitizer has encountered a fatal error.
[task 2021-04-02T07:34:47.004Z] 07:34:47 INFO - [style 0.0.1] ==16819==HINT: For debugging, try setting environment variable LSAN_OPTIONS=verbosity=1:log_threads=1
[task 2021-04-02T07:34:47.005Z] 07:34:47 INFO - [style 0.0.1] ==16819==HINT: LeakSanitizer does not work under ptrace (strace, gdb, etc)
[task 2021-04-02T07:34:47.005Z] 07:34:47 INFO - error: failed to run custom build command for style v0.0.1 (/builds/worker/checkouts/gecko/servo/components/style)
[task 2021-04-02T07:34:47.005Z] 07:34:47 INFO - Caused by:
[task 2021-04-02T07:34:47.005Z] 07:34:47 INFO - process didn't exit successfully: /builds/worker/workspace/obj-build/release/build/style-f94f88791b75e1fe/build-script-build (exit code: 1)
[task 2021-04-02T07:34:47.005Z] 07:34:47 INFO - --- stdout
[task 2021-04-02T07:34:47.005Z] 07:34:47 INFO - cargo:rerun-if-changed=build.rs
[task 2021-04-02T07:34:47.005Z] 07:34:47 INFO - cargo:out_dir=/builds/worker/workspace/obj-build/x86_64-unknown-linux-gnu/release/build/style-bb017b0cf824df33/out

There are only a few instances of this new type of failure. The first is on 2021-04-01 14:31:09 on Autoland. LSan is hitting some kind of error while building Stylo, maybe? Given the timing, this might be a regression from bug 1700475.

Comment 50

[Emilio Cobos Álvarez (:emilio)]

That's not a terribly helpful error message... I guess we could disable lsan as well in the stylo build script to work around this but probably we want to check if we find out the root cause of this, patch incoming.

Comment 51

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1635327 - Try to get more information from lsan crashes on automation. r=glandium,#build

Comment 52

[Mike Hommey [:glandium]]

Copy/paste from phabricator:
This is not going to help. In my experience running lsan on taskcluster on the git-cinnabar CI, the ptrace message happens sometimes, and it's a general problem that will affect any code running lsan, not just that one particular build script. Retrying the task always worked for me, which tells me it's a worker problem.

Comment 53

[Intermittent Failures Robot]

14 failures in 3125 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• try: 2
• mozilla-beta: 2
• autoland: 7

Platform and build breakdown:

• linux1804-64-asan: 10
  • opt: 10
• linux64: 4
  • asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-03-29&endday=2021-04-04&tree=all

Comment 54

[Intermittent Failures Robot]

15 failures in 3854 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 7
• mozilla-central: 6
• mozilla-beta: 1
• try: 1

Platform and build breakdown:

• linux1804-64-asan: 11
  • opt: 11
• linux64: 4
  • asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-04-05&endday=2021-04-11&tree=all

Comment 55

[Cosmin Sabou [:CosminS]]

Starting with this one there are linux64 asan builds that have this error line. Is this a different issue than this bug?
Failure log: https://treeherder.mozilla.org/logviewer?job_id=336370155&repo=autoland&lineNumber=50785
Mike, could you have a look over this one? Thank you.

Comment 56

[Intermittent Failures Robot]

16 failures in 648 pushes (0.025 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 16

Platform and build breakdown:

• linux64: 16
  • asan: 16

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-04-16&endday=2021-04-16&tree=all

Comment 57

[Intermittent Failures Robot]

29 failures in 4255 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• mozilla-beta: 1
• autoland: 25
• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-asan: 7
  • opt: 7
• linux64: 22
  • asan: 22

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-04-12&endday=2021-04-18&tree=all

Comment 58

[Mike Hommey [:glandium]]

(In reply to Cosmin Sabou [:CosminS] from comment #55)

Starting with this one there are linux64 asan builds that have this error line. Is this a different issue than this bug?
Failure log: https://treeherder.mozilla.org/logviewer?job_id=336370155&repo=autoland&lineNumber=50785
Mike, could you have a look over this one? Thank you.

Looks the same.

Comment 59

[Mike Hommey [:glandium]]

Maybe we /should/ land emilio's patch to try and see if it gets us something.

Comment 60

[Emilio Cobos Álvarez (:emilio)]

Reopened, though let me know if you want me to set the env var in the build task or something, since it seems this also happens on WR build scripts etc.

Comment 61

[Mike Hommey [:glandium]]

(In reply to Emilio Cobos Álvarez (:emilio) from comment #60)

Reopened, though let me know if you want me to set the env var in the build task or something, since it seems this also happens on WR build scripts etc.

Yeah, it might be preferable to just set the environment variable at the task level for now.

Comment 62

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2630bd1f0039
Try to get more information from lsan crashes on automation. r=glandium,firefox-build-system-reviewers

Comment 63

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/2630bd1f0039

Comment 64

[Alexandru Michis [:malexandru]]

Emilio, this is still happening: https://treeherder.mozilla.org/logviewer?job_id=337253922&repo=mozilla-central&lineNumber=3533
Should we reopen this bug or track the issue in a separate one?

Comment 65

[Emilio Cobos Álvarez (:emilio)]

Yeah it shouldn't have been closed, the patch was a diagnostic patch only. Though I expected that log to have a bit more information...

Comment 66

[Intermittent Failures Robot]

18 failures in 3224 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• mozilla-central: 3
• mozilla-esr78: 1
• mozilla-beta: 1

Platform and build breakdown:

• linux64: 11
  • asan: 11
• linux1804-64-asan: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-04-19&endday=2021-04-25&tree=all

Comment 67

[Intermittent Failures Robot]

10 failures in 3706 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 5
• try: 2
• mozilla-central: 2
• mozilla-beta: 1

Platform and build breakdown:

• linux1804-64-asan: 8
  • opt: 8
• linux64: 2
  • asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-04-26&endday=2021-05-02&tree=all

Comment 68

[Intermittent Failures Robot]

12 failures in 3279 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-beta: 3
• autoland: 7

Platform and build breakdown:

• linux1804-64-asan: 11
  • opt: 11
• linux64: 1
  • asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-05-03&endday=2021-05-09&tree=all

Comment 69

[Intermittent Failures Robot]

26 failures in 3061 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #48 most frequent failure this week.

Repository breakdown:

• autoland: 22
• mozilla-release: 1
• try: 1
• mozilla-central: 2

Platform and build breakdown:

• linux1804-64-asan: 14
  • opt: 14
• linux1804-64-asan-qr: 11
  • opt: 11
• linux64: 1
  • asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-05-17&endday=2021-05-23&tree=all

Comment 70

[Intermittent Failures Robot]

16 failures in 2908 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 13
• mozilla-central: 1
• try: 2

Platform and build breakdown:

• linux1804-64-asan-qr: 8
  • opt: 8
• linux1804-64-asan: 7
  • opt: 7
• linux64: 1
  • asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 71

[Intermittent Failures Robot]

28 failures in 3065 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 20
• mozilla-central: 6
• mozilla-beta: 2

Platform and build breakdown:

• linux1804-64-asan: 12
  • opt: 12
• linux1804-64-asan-qr: 11
  • opt: 11
• linux64: 5
  • asan: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-05-31&endday=2021-06-06&tree=all

Comment 72

[Intermittent Failures Robot]

17 failures in 3502 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 6
• mozilla-central: 4
• autoland: 6
• try: 1

Platform and build breakdown:

• linux1804-64-asan: 9
  • opt: 9
• linux1804-64-asan-qr: 6
  • opt: 6
• linux64: 2
  • asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-06-07&endday=2021-06-13&tree=all

Comment 73

[Intermittent Failures Robot]

25 failures in 2888 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 8
• autoland: 11
• try: 3
• mozilla-beta: 3

Platform and build breakdown:

• linux1804-64-asan: 13
  • opt: 13
• linux1804-64-asan-qr: 12
  • opt: 12

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-06-14&endday=2021-06-20&tree=all

Comment 74

[Intermittent Failures Robot]

32 failures in 3115 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-beta: 5
• autoland: 16
• mozilla-central: 7
• try: 4

Platform and build breakdown:

• linux1804-64-asan: 14
  • opt: 14
• linux1804-64-asan-qr: 14
  • opt: 14
• linux64: 4
  • asan: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-06-21&endday=2021-06-27&tree=all

Comment 75

[Andreea Pavel [:apavel]]

There are 22 total failures in the last 7 days on

• linux64 asan
• linux1804-64-asan-qr opt
  Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=344037523&repo=autoland&lineNumber=53958

task 2021-06-28T20:49:22.834Z] 20:49:22 INFO - [neqo-crypto 0.4.26] Failed to run rustfmt: No such file or directory (os error 2) (non-fatal, continuing)
[task 2021-06-28T20:49:22.834Z] 20:49:22 INFO - Running /builds/worker/workspace/obj-build/release/build/webrender-b277dc542518c6a9/build-script-build
[task 2021-06-28T20:49:22.834Z] 20:49:22 INFO - [neqo-crypto 0.4.26] ==22120==Processing thread 19949.
[task 2021-06-28T20:49:22.834Z] 20:49:22 INFO - [neqo-crypto 0.4.26] ==22120==Stack at 0x7fff2950b000-0x7fff29d0b000 (SP = 0x7fff29d05d48).
[task 2021-06-28T20:49:22.835Z] 20:49:22 INFO - [neqo-crypto 0.4.26] ==22120==TLS at 0x7f6f43f24dc0-0x7f6f43f25fc0.
[task 2021-06-28T20:49:22.835Z] 20:49:22 INFO - [neqo-crypto 0.4.26] ==22120==DTLS 4 at 0x000038800001-0x001838801103.
[task 2021-06-28T20:49:22.835Z] 20:49:22 INFO - [neqo-crypto 0.4.26] Tracer caught signal 11: addr=0x38800008 pc=0x56004323ba2a sp=0x7f6f36156d50
[task 2021-06-28T20:49:22.835Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__isoc99_printf'
[task 2021-06-28T20:49:22.835Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__isoc99_sprintf'
[task 2021-06-28T20:49:22.835Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__isoc99_snprintf'
[task 2021-06-28T20:49:22.836Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__isoc99_fprintf'
[task 2021-06-28T20:49:22.836Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__isoc99_vprintf'
[task 2021-06-28T20:49:22.836Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__isoc99_vsprintf'
[task 2021-06-28T20:49:22.836Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__isoc99_vsnprintf'
[task 2021-06-28T20:49:22.836Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__isoc99_vfprintf'
[task 2021-06-28T20:49:22.836Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept 'xdr_destroy'
[task 2021-06-28T20:49:22.837Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept 'crypt'
[task 2021-06-28T20:49:22.837Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept 'crypt_r'
[task 2021-06-28T20:49:22.837Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: failed to intercept '__cxa_rethrow_primary_exception'
[task 2021-06-28T20:49:22.837Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer: libc interceptors initialized
[task 2021-06-28T20:49:22.837Z] 20:49:22 INFO - [webrender 0.61.0] || [0x10007fff8000, 0x7fffffffffff] || HighMem ||
[task 2021-06-28T20:49:22.837Z] 20:49:22 INFO - [webrender 0.61.0] || [0x02008fff7000, 0x10007fff7fff] || HighShadow ||
[task 2021-06-28T20:49:22.838Z] 20:49:22 INFO - [webrender 0.61.0] || [0x00008fff7000, 0x02008fff6fff] || ShadowGap ||
[task 2021-06-28T20:49:22.838Z] 20:49:22 INFO - [webrender 0.61.0] || [0x00007fff8000, 0x00008fff6fff] || LowShadow ||
[task 2021-06-28T20:49:22.838Z] 20:49:22 INFO - [webrender 0.61.0] || [0x000000000000, 0x00007fff7fff] || LowMem ||
[task 2021-06-28T20:49:22.838Z] 20:49:22 INFO - [webrender 0.61.0] MemToShadow(shadow): 0x00008fff7000 0x000091ff6dff 0x004091ff6e00 0x02008fff6fff
[task 2021-06-28T20:49:22.838Z] 20:49:22 INFO - [webrender 0.61.0] redzone=16
[task 2021-06-28T20:49:22.838Z] 20:49:22 INFO - [webrender 0.61.0] max_redzone=2048
[task 2021-06-28T20:49:22.838Z] 20:49:22 INFO - [webrender 0.61.0] quarantine_size_mb=256M
[task 2021-06-28T20:49:22.839Z] 20:49:22 INFO - [webrender 0.61.0] thread_local_quarantine_size_kb=1024K
[task 2021-06-28T20:49:22.839Z] 20:49:22 INFO - [webrender 0.61.0] malloc_context_size=30
[task 2021-06-28T20:49:22.839Z] 20:49:22 INFO - [webrender 0.61.0] SHADOW_SCALE: 3
[task 2021-06-28T20:49:22.839Z] 20:49:22 INFO - [webrender 0.61.0] SHADOW_GRANULARITY: 8
[task 2021-06-28T20:49:22.839Z] 20:49:22 INFO - [webrender 0.61.0] SHADOW_OFFSET: 0x7fff8000
[task 2021-06-28T20:49:22.839Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==Installed the sigaction for signal 11
[task 2021-06-28T20:49:22.840Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==Installed the sigaction for signal 7
[task 2021-06-28T20:49:22.840Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==Installed the sigaction for signal 8
[task 2021-06-28T20:49:22.840Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==T0: stack [0x7ffd626b2000,0x7ffd62eb2000) size 0x800000; local=0x7ffd62eacc6c
[task 2021-06-28T20:49:22.840Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==AddressSanitizer Init done
[task 2021-06-28T20:49:22.840Z] 20:49:22 INFO - [neqo-crypto 0.4.26] ==19949==LeakSanitizer has encountered a fatal error.
[task 2021-06-28T20:49:22.840Z] 20:49:22 INFO - [neqo-crypto 0.4.26] ==19949==HINT: For debugging, try setting environment variable LSAN_OPTIONS=verbosity=1:log_threads=1
[task 2021-06-28T20:49:22.840Z] 20:49:22 INFO - [neqo-crypto 0.4.26] ==19949==HINT: LeakSanitizer does not work under ptrace (strace, gdb, etc)
[task 2021-06-28T20:49:22.841Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res
[task 2021-06-28T20:49:22.841Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_radial_gradient.glsl
[task 2021-06-28T20:49:22.841Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_fast_linear_gradient.glsl
[task 2021-06-28T20:49:22.841Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/transform.glsl
[task 2021-06-28T20:49:22.841Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/rect.glsl
[task 2021-06-28T20:49:22.841Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/gpu_cache.glsl
[task 2021-06-28T20:49:22.841Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_border_segment.glsl
[task 2021-06-28T20:49:22.842Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/brush_opacity.glsl
[task 2021-06-28T20:49:22.842Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/debug_font.glsl
[task 2021-06-28T20:49:22.842Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/gpu_cache_update.glsl
[task 2021-06-28T20:49:22.842Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/base.glsl
[task 2021-06-28T20:49:22.842Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_conic_gradient.glsl
[task 2021-06-28T20:49:22.842Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/ps_clear.glsl
[task 2021-06-28T20:49:22.842Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_clip_box_shadow.glsl
[task 2021-06-28T20:49:22.843Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/brush_solid.glsl
[task 2021-06-28T20:49:22.843Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_scale.glsl
[task 2021-06-28T20:49:22.843Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/brush_blend.glsl
[task 2021-06-28T20:49:22.843Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/brush_image.glsl
[task 2021-06-28T20:49:22.843Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_linear_gradient.glsl
[task 2021-06-28T20:49:22.843Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/ellipse.glsl
[task 2021-06-28T20:49:22.843Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/brush.glsl
[task 2021-06-28T20:49:22.844Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/ps_split_composite.glsl
[task 2021-06-28T20:49:22.844Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/brush_yuv_image.glsl
[task 2021-06-28T20:49:22.844Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_clip_rectangle.glsl
[task 2021-06-28T20:49:22.844Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/gradient.glsl
[task 2021-06-28T20:49:22.844Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/clip_shared.glsl
[task 2021-06-28T20:49:22.844Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/gradient_shared.glsl
[task 2021-06-28T20:49:22.844Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_svg_filter.glsl
[task 2021-06-28T20:49:22.845Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/shared.glsl
[task 2021-06-28T20:49:22.845Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/debug_color.glsl
[task 2021-06-28T20:49:22.845Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/prim_shared.glsl
[task 2021-06-28T20:49:22.845Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/shared_other.glsl
[task 2021-06-28T20:49:22.845Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/brush_linear_gradient.glsl
[task 2021-06-28T20:49:22.845Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/brush_mix_blend.glsl
[task 2021-06-28T20:49:22.846Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_blur.glsl
[task 2021-06-28T20:49:22.846Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_clip_image.glsl
[task 2021-06-28T20:49:22.846Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/ps_text_run.glsl
[task 2021-06-28T20:49:22.846Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/render_task.glsl
[task 2021-06-28T20:49:22.846Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/yuv.glsl
[task 2021-06-28T20:49:22.846Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/composite.glsl
[task 2021-06-28T20:49:22.846Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_line_decoration.glsl
[task 2021-06-28T20:49:22.847Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/blend.glsl
[task 2021-06-28T20:49:22.847Z] 20:49:22 INFO - [webrender 0.61.0] cargo:rerun-if-changed=res/cs_border_solid.glsl
[task 2021-06-28T20:49:22.847Z] 20:49:22 INFO - [webrender 0.61.0] ==22127==T6: stack [0x7f45c14d8000,0x7f45c16d6e80) size 0x1fee80; local=0x7f45c16d6d7c
[task 2021-06-28T20:49:22.847Z] 20:49:22 INFO - [webrender 0.61.0] Optimizing shader ShaderOptimizationInput { shader_name: "cs_conic_gradient", config: "", gl_version: Gl }
[task 2021-06-28T20:49:22.847Z] 20:49:22 INFO - error: failed to run custom build command for neqo-crypto v0.4.26 (https://github.com/mozilla/neqo?tag=v0.4.26#2ad6f5f6)
[task 2021-06-28T20:49:22.847Z] 20:49:22 INFO - Caused by:
[task 2021-06-28T20:49:22.848Z] 20:49:22 INFO - process didn't exit successfully: /builds/worker/workspace/obj-build/release/build/neqo-crypto-08eeb903173dbf7a/build-script-build (exit status: 1)

[task 2021-06-28T20:49:22.915Z] 20:49:22 INFO - /builds/worker/workspace/obj-build/dist/include/nspr
[task 2021-06-28T20:49:22.916Z] 20:49:22 INFO - /builds/worker/workspace/obj-build/dist/include/nss
[task 2021-06-28T20:49:22.916Z] 20:49:22 INFO - /builds/worker/workspace/obj-build/dist/include/cairo
[task 2021-06-28T20:49:22.916Z] 20:49:22 INFO - /builds/worker/fetches/clang/bin/../lib/gcc/x86_64-unknown-linux-gnu/7.5.0/../../../../include/c++/7.5.0
[task 2021-06-28T20:49:22.916Z] 20:49:22 INFO - /builds/worker/fetches/clang/bin/../lib/gcc/x86_64-unknown-linux-gnu/7.5.0/../../../../include/c++/7.5.0/x86_64-unknown-linux-gnu
[task 2021-06-28T20:49:22.916Z] 20:49:22 INFO - /builds/worker/fetches/clang/bin/../lib/gcc/x86_64-unknown-linux-gnu/7.5.0/../../../../include/c++/7.5.0/backward
[task 2021-06-28T20:49:22.917Z] 20:49:22 INFO - /builds/worker/fetches/clang/lib/clang/12.0.0/include
[task 2021-06-28T20:49:22.917Z] 20:49:22 INFO - /builds/worker/fetches/sysroot/usr/include/x86_64-linux-gnu
[task 2021-06-28T20:49:22.917Z] 20:49:22 INFO - /builds/worker/fetches/sysroot/usr/include
[task 2021-06-28T20:49:22.917Z] 20:49:22 INFO - /builds/worker/fetches/sysroot/usr/lib/gcc/x86_64-linux-gnu/4.9/../../../../include/c++/4.9
[task 2021-06-28T20:49:22.917Z] 20:49:22 INFO - /builds/worker/fetches/sysroot/usr/lib/gcc/x86_64-linux-gnu/4.9/../../../../include/x86_64-linux-gnu/c++/4.9
[task 2021-06-28T20:49:22.917Z] 20:49:22 INFO - /builds/worker/fetches/sysroot/usr/lib/gcc/x86_64-linux-gnu/4.9/../../../../include/c++/4.9/backward
[task 2021-06-28T20:49:22.917Z] 20:49:22 INFO - End of search list.
[task 2021-06-28T20:49:22.918Z] 20:49:22 INFO - ==19949==T12 TSDDtor
[task 2021-06-28T20:49:22.918Z] 20:49:22 INFO - ==19949==T12 exited
[task 2021-06-28T20:49:22.918Z] 20:49:22 INFO - Failed to run rustfmt: No such file or directory (os error 2) (non-fatal, continuing)
[task 2021-06-28T20:49:22.918Z] 20:49:22 INFO - ==22120==Processing thread 19949.
[task 2021-06-28T20:49:22.918Z] 20:49:22 INFO - ==22120==Stack at 0x7fff2950b000-0x7fff29d0b000 (SP = 0x7fff29d05d48).
[task 2021-06-28T20:49:22.918Z] 20:49:22 INFO - ==22120==TLS at 0x7f6f43f24dc0-0x7f6f43f25fc0.
[task 2021-06-28T20:49:22.918Z] 20:49:22 INFO - ==22120==DTLS 4 at 0x000038800001-0x001838801103.
[task 2021-06-28T20:49:22.919Z] 20:49:22 INFO - Tracer caught signal 11: addr=0x38800008 pc=0x56004323ba2a sp=0x7f6f36156d50
[task 2021-06-28T20:49:22.919Z] 20:49:22 INFO - ==19949==LeakSanitizer has encountered a fatal error.
[task 2021-06-28T20:49:22.919Z] 20:49:22 INFO - ==19949==HINT: For debugging, try setting environment variable LSAN_OPTIONS=verbosity=1:log_threads=1
[task 2021-06-28T20:49:22.919Z] 20:49:22 INFO - ==19949==HINT: LeakSanitizer does not work under ptrace (strace, gdb, etc)
[task 2021-06-28T20:49:22.919Z] 20:49:22 INFO - warning: build failed, waiting for other jobs to finish...

Emilio are you still working on this?

Comment 76

[Emilio Cobos Álvarez (:emilio)]

I don't see anything super-suspicious in that log. Mike, any ideas?

Comment 77

[Intermittent Failures Robot]

9 failures in 723 pushes (0.012 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• try: 1

Platform and build breakdown:

• linux1804-64-asan: 4
  • opt: 4
• linux64: 1
  • asan: 1
• linux1804-64-asan-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-06-28&endday=2021-07-04&tree=all

Comment 78

[Intermittent Failures Robot]

25 failures in 2387 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 16
• mozilla-central: 5
• mozilla-beta: 1
• try: 3

Platform and build breakdown:

• linux1804-64-asan: 8
  • opt: 8
• linux1804-64-asan-qr: 15
  • opt: 15
• linux64: 2
  • asan: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-07-05&endday=2021-07-11&tree=all

Comment 79

[Intermittent Failures Robot]

12 failures in 2224 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 2
• try: 2

Platform and build breakdown:

• linux1804-64-asan-qr: 6
  • opt: 6
• linux1804-64-asan: 5
  • opt: 5
• linux64: 1
  • asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-07-12&endday=2021-07-18&tree=all

Comment 81

[Mike Hommey [:glandium]]

Attachment: Bug 1635327 - Disable __tls_get_addr interception in sanitizer builds.

Sanitizers try to intercept __tls_get_addr to find DTLS blocks. In some
cases, they fail miserably with a crash. And in the cases they don't
crash, they don't seem to actually work properly anyways.

This affects both build time when running host programs compiled with
sanitizer flags (this only actually affects rust build
scripts/procedural macros on non-cross builds, not C/C++ host programs),
and execution time, e.g. when running tests.

Comment 82

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/011840f345c0
Disable __tls_get_addr interception in sanitizer builds. r=firefox-build-system-reviewers,emilio,andi

Comment 83

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/011840f345c0

Comment 84

[Intermittent Failures Robot]

15 failures in 2940 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 6
• mozilla-beta: 5
• try: 1
• mozilla-central: 3

Platform and build breakdown:

• linux1804-64-asan-qr: 7
  • opt: 7
• linux64: 3
  • asan: 3
• linux1804-64-asan: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-07-19&endday=2021-07-25&tree=all

Comment 85

[Intermittent Failures Robot]

5 failures in 3131 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 4
• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 3
  • opt: 3
• linux1804-64-asan: 1
  • opt: 1
• linux64-noopt: 1
  • asan: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-07-26&endday=2021-08-01&tree=all

Comment 86

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-esr91/rev/ffa7b201cdf5

Comment 87

[Intermittent Failures Robot]

2 failures in 2829 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-08-02&endday=2021-08-08&tree=all

Comment 88

[Iulian Moraru]

This is failing on mozilla-esr78: https://treeherder.mozilla.org/logviewer?job_id=348224076&repo=mozilla-esr78&lineNumber=3542

[task 2021-08-12T13:28:26.694Z] 13:28:26     INFO - TEST-START | dom/canvas/test/webgl-conf/generated/test_2_conformance__textures__webgl_canvas__tex-2d-rgba-rgba-unsigned_short_5_5_5_1.html
[task 2021-08-12T13:28:27.944Z] 13:28:27     INFO - GECKO(1494) | MEMORY STAT | vsize 20975905MB | residentFast 2218MB
[task 2021-08-12T13:28:27.968Z] 13:28:27     INFO - TEST-OK | dom/canvas/test/webgl-conf/generated/test_2_conformance__textures__webgl_canvas__tex-2d-rgba-rgba-unsigned_short_5_5_5_1.html | took 1276ms
[task 2021-08-12T13:28:28.210Z] 13:28:28     INFO - TEST-START | Shutdown
[task 2021-08-12T13:28:28.211Z] 13:28:28     INFO - Passed:  29553
[task 2021-08-12T13:28:28.212Z] 13:28:28     INFO - Failed:  0
[task 2021-08-12T13:28:28.213Z] 13:28:28     INFO - Todo:    0
[task 2021-08-12T13:28:28.213Z] 13:28:28     INFO - Mode:    e10s
[task 2021-08-12T13:28:28.214Z] 13:28:28     INFO - Slowest: 11618ms - /tests/dom/canvas/test/webgl-conf/generated/test_2_conformance__glsl__misc__shader-uniform-packing-restrictions.html
[task 2021-08-12T13:28:28.215Z] 13:28:28     INFO - SimpleTest FINISHED
[task 2021-08-12T13:28:28.216Z] 13:28:28     INFO - TEST-INFO | Ran 1 Loops
[task 2021-08-12T13:28:28.216Z] 13:28:28     INFO - SimpleTest FINISHED
[task 2021-08-12T13:28:29.937Z] 13:28:29     INFO - GECKO(1494) | 1628774909927	Marionette	TRACE	Received observer notification xpcom-will-shutdown
[task 2021-08-12T13:28:29.937Z] 13:28:29     INFO - GECKO(1494) | 1628774909928	Marionette	INFO	Stopped listening on port 2828
[task 2021-08-12T13:28:29.938Z] 13:28:29     INFO - GECKO(1494) | 1628774909928	Marionette	DEBUG	Marionette stopped listening
[task 2021-08-12T13:28:30.630Z] 13:28:30     INFO - GECKO(1494) | -----------------------------------------------------
[task 2021-08-12T13:28:30.630Z] 13:28:30     INFO - GECKO(1494) | Suppressions used:
[task 2021-08-12T13:28:30.630Z] 13:28:30     INFO - GECKO(1494) |   count      bytes template
[task 2021-08-12T13:28:30.630Z] 13:28:30     INFO - GECKO(1494) |      23        712 nsComponentManagerImpl
[task 2021-08-12T13:28:30.630Z] 13:28:30     INFO - GECKO(1494) |       2        288 libfontconfig.so
[task 2021-08-12T13:28:30.630Z] 13:28:30     INFO - GECKO(1494) | -----------------------------------------------------
[task 2021-08-12T13:28:30.686Z] 13:28:30     INFO - GECKO(1494) | -----------------------------------------------------
[task 2021-08-12T13:28:30.686Z] 13:28:30     INFO - GECKO(1494) | Suppressions used:
[task 2021-08-12T13:28:30.687Z] 13:28:30     INFO - GECKO(1494) |   count      bytes template
[task 2021-08-12T13:28:30.687Z] 13:28:30     INFO - GECKO(1494) |      23        712 nsComponentManagerImpl
[task 2021-08-12T13:28:30.687Z] 13:28:30     INFO - GECKO(1494) |     633      18287 libfontconfig.so
[task 2021-08-12T13:28:30.687Z] 13:28:30     INFO - GECKO(1494) | -----------------------------------------------------
[task 2021-08-12T13:28:30.845Z] 13:28:30     INFO - GECKO(1494) | Tracer caught signal 11: addr=0x0 pc=0x5582ca457209 sp=0x7f7f7cf73d30
[task 2021-08-12T13:28:30.855Z] 13:28:30     INFO - GECKO(1494) | ==1551==LeakSanitizer has encountered a fatal error.
[task 2021-08-12T13:28:30.856Z] 13:28:30     INFO - GECKO(1494) | ==1551==HINT: For debugging, try setting environment variable LSAN_OPTIONS=verbosity=1:log_threads=1
[task 2021-08-12T13:28:30.856Z] 13:28:30     INFO - GECKO(1494) | ==1551==HINT: LeakSanitizer does not work under ptrace (strace, gdb, etc)
[task 2021-08-12T13:28:31.222Z] 13:28:31     INFO - GECKO(1494) | -----------------------------------------------------
[task 2021-08-12T13:28:31.222Z] 13:28:31     INFO - GECKO(1494) | Suppressions used:
[task 2021-08-12T13:28:31.222Z] 13:28:31     INFO - GECKO(1494) |   count      bytes template
[task 2021-08-12T13:28:31.222Z] 13:28:31     INFO - GECKO(1494) |       1         32 nsComponentManagerImpl
[task 2021-08-12T13:28:31.222Z] 13:28:31     INFO - GECKO(1494) | -----------------------------------------------------
[task 2021-08-12T13:28:32.525Z] 13:28:32     INFO - GECKO(1494) | -----------------------------------------------------
[task 2021-08-12T13:28:32.526Z] 13:28:32     INFO - GECKO(1494) | Suppressions used:
[task 2021-08-12T13:28:32.527Z] 13:28:32     INFO - GECKO(1494) |   count      bytes template
[task 2021-08-12T13:28:32.528Z] 13:28:32     INFO - GECKO(1494) |      20        608 nsComponentManagerImpl
[task 2021-08-12T13:28:32.528Z] 13:28:32     INFO - GECKO(1494) |     633      18083 libfontconfig.so
[task 2021-08-12T13:28:32.529Z] 13:28:32     INFO - GECKO(1494) |       3        576 mozJSComponentLoader
[task 2021-08-12T13:28:32.530Z] 13:28:32     INFO - GECKO(1494) | -----------------------------------------------------
[task 2021-08-12T13:28:32.607Z] 13:28:32     INFO - TEST-INFO | Main app process: exit 0
[task 2021-08-12T13:28:32.609Z] 13:28:32    ERROR - TEST-UNEXPECTED-FAIL | LeakSanitizer | LeakSanitizer has encountered a fatal error.
[task 2021-08-12T13:28:32.611Z] 13:28:32     INFO - runtests.py | Application ran for: 0:10:24.059188
[task 2021-08-12T13:28:32.612Z] 13:28:32     INFO - zombiecheck | Reading PID log: /tmp/tmp43kJpypidlog
[task 2021-08-12T13:28:32.614Z] 13:28:32     INFO - ==> process 1494 launched child process 1514
[task 2021-08-12T13:28:32.615Z] 13:28:32     INFO - ==> process 1494 launched child process 1551
[task 2021-08-12T13:28:32.617Z] 13:28:32     INFO - ==> process 1494 launched child process 1563
[task 2021-08-12T13:28:32.618Z] 13:28:32     INFO - ==> process 1494 launched child process 1633
[task 2021-08-12T13:28:32.619Z] 13:28:32     INFO - ==> process 1494 launched child process 1695
[task 2021-08-12T13:28:32.620Z] 13:28:32     INFO - zombiecheck | Checking for orphan process with PID: 1633
[task 2021-08-12T13:28:32.621Z] 13:28:32     INFO - zombiecheck | Checking for orphan process with PID: 1514
[task 2021-08-12T13:28:32.622Z] 13:28:32     INFO - zombiecheck | Checking for orphan process with PID: 1563
[task 2021-08-12T13:28:32.623Z] 13:28:32     INFO - zombiecheck | Checking for orphan process with PID: 1695
[task 2021-08-12T13:28:32.624Z] 13:28:32     INFO - zombiecheck | Checking for orphan process with PID: 1551
[task 2021-08-12T13:28:32.625Z] 13:28:32     INFO - Stopping web server
[task 2021-08-12T13:28:32.626Z] 13:28:32     INFO - Stopping web socket server
[task 2021-08-12T13:28:32.627Z] 13:28:32     INFO - Stopping ssltunnel
[task 2021-08-12T13:28:32.644Z] 13:28:32  WARNING - leakcheck | refcount logging is off, so leaks can't be detected!
[task 2021-08-12T13:28:32.646Z] 13:28:32     INFO - runtests.py | Running tests: end.
[task 2021-08-12T13:28:32.764Z] 13:28:32     INFO - Buffered messages finished
[task 2021-08-12T13:28:32.766Z] 13:28:32     INFO -  0 INFO TEST-START | Shutdown
[task 2021-08-12T13:28:32.767Z] 13:28:32     INFO -  1 INFO Passed:  29553
[task 2021-08-12T13:28:32.768Z] 13:28:32     INFO -  2 INFO Failed:  1
[task 2021-08-12T13:28:32.769Z] 13:28:32     INFO -  3 INFO Todo:    0
[task 2021-08-12T13:28:32.770Z] 13:28:32     INFO -  4 INFO Mode:    e10s
[task 2021-08-12T13:28:32.772Z] 13:28:32     INFO -  5 INFO SimpleTest FINISHED
[task 2021-08-12T13:28:32.773Z] 13:28:32     INFO - Buffered messages finished
[task 2021-08-12T13:28:32.774Z] 13:28:32     INFO - SUITE-END | took 625s

Comment 89

[Intermittent Failures Robot]

2 failures in 3025 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1
• mozilla-esr78: 1

Platform and build breakdown:

• linux1804-64-asan: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-08-09&endday=2021-08-15&tree=all

Comment 90

[Intermittent Failures Robot]

1 failures in 2580 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-08-23&endday=2021-08-29&tree=all

Comment 91

[Intermittent Failures Robot]

1 failures in 3084 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr78: 1

Platform and build breakdown:

• linux1804-64-asan: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2021-08-30&endday=2021-09-05&tree=all

Comment 92

[Intermittent Failures Robot]

1 failures in 2837 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• linux1804-64-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1635327&startday=2022-03-07&endday=2022-03-13&tree=all