1944415 - Intermittent mozilla/tests/webdriver/harness/detect_crash.py | test_content_process - UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb0 in position 727: invalid start byte

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=492211218&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XILt-nULQvaxf2gf-21R7g/runs/0/artifacts/public/logs/live_backing.log

---

[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -  'host': '127.0.0.1',
[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -  'port': 51195,
[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -  'target_platform': 'mac',
[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -  'timeout_multiplier': 1,
[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -  'webdriver': {'args': ['-vv',
[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -                         '--binary',
[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -                         '/opt/worker/tasks/task_173809905473863/build/application/Firefox '
[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -                         'Nightly.app/Contents/MacOS/firefox'],
[task 2025-01-28T21:34:04.525Z] 21:34:04     INFO -                'binary': '/opt/worker/tasks/task_173809905473863/fetches/geckodriver'}}
[task 2025-01-28T21:34:04.527Z] 21:34:04     INFO - STDOUT: geckodriver = <function geckodriver.<locals>._geckodriver at 0x10b224c20>
[task 2025-01-28T21:34:04.528Z] 21:34:04     INFO - STDOUT: trigger_crash = <function test_content_process.<locals>.trigger_crash at 0x10b224b80>
[task 2025-01-28T21:34:04.529Z] 21:34:04     INFO - STDOUT: tests/web-platform/mozilla/tests/webdriver/harness/detect_crash.py
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO - 
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO - TEST-UNEXPECTED-FAIL | /_mozilla/webdriver/harness/detect_crash.py | test_content_process - UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb0 in position 727: invalid start byte
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO - configuration = {'browser': {'args': ['--profile', '/var/folders/kk/zwl7bgwj63s69lv_hxnscwxr0000jb/T/tmpayaeqlce.mozrunner'], 'binary'...toland', 'GECKO_HEAD_REV': '31e9d38de951a377a5389b36a3cbab670629509c', ...}}}, 'host': '127.0.0.1', 'port': 51195, ...}
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO - geckodriver = <function geckodriver.<locals>._geckodriver at 0x10b224c20>
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO - 
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -     def test_content_process(configuration, geckodriver):
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -         def trigger_crash(driver):
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -             # The crash is delayed and happens after this command finished.
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -             driver.session.url = "about:crashcontent"
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -     
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -             # Bug 1943038: geckodriver fails to detect minidump files for content
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -             # crashes when the next command is sent immediately.
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -             time.sleep(1)
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -     
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -             # Send another command that should fail
[task 2025-01-28T21:34:04.954Z] 21:34:04     INFO -             with pytest.raises(error.UnknownErrorException):
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                 driver.session.url
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -     
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO - >       run_crash_test(configuration, geckodriver, crash_callback=trigger_crash)
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO - 
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO - configuration = {'browser': {'args': ['--profile',
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                       '/var/folders/kk/zwl7bgwj63s69lv_hxnscwxr0000jb/T/tmpayaeqlce.mozrunner'],
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -              'binary': '/opt/worker/tasks/task_173809905473863/build/application/Firefox '
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                        'Nightly.app/Contents/MacOS/firefox',
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -              'env': {'DYLD_LIBRARY_PATH': '/opt/worker/tasks/task_173809905473863/build/application/Firefox '
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                                           'Nightly.app/Contents/MacOS',
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                      'EXTRA_MOZHARNESS_CONFIG': '{"installer_url": '
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                                                 '"https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VOvnCErlQFGH7Z-kumry1g/artifacts/public/build/target.dmg", '
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                                                 '"test_packages_url": '
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                                                 '"https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/VOvnCErlQFGH7Z-kumry1g/artifacts/public/build/target.test_packages.json"}',
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                      'GECKO_HEAD_REPOSITORY': 'https://hg.mozilla.org/integration/autoland',
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                      'GECKO_HEAD_REV': '31e9d38de951a377a5389b36a3cbab670629509c',
[task 2025-01-28T21:34:04.955Z] 21:34:04     INFO -                      'GNOME_DISABLE_CRASH_DIALOG': '1',
[task 2025-01-28T21:34:04.956Z] 21:34:04     INFO -                      'HOME': '/Users/cltbld',
[task 2025-01-28T21:34:04.956Z] 21:34:04     INFO -                      'LANG': 'en_US.UTF-8',
[task 2025-01-28T21:34:04.956Z] 21:34:04     INFO -                      'LC_ALL': 'en_US.UTF-8',

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This is a problem with the reading and decoding the data from the extra file, which contains some non UTF-8 characters like \\u0000\\u0000\xb0sX\xb3\xf7\x7f\\u0000. Checking the extra file I see such a sequence for a font name:

\u0000 pX\u0000\u0000سU

For our purpose we could replace those invalid characters. They are not relevant given that we are only interested in the value for Marionette and RemoteAgent.

This is a regression from bug 1880257.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Attachment: Bug 1944415 - [wdspec] Handle invalid UTF-8 when reading minidump .extra files.

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This actually affects tier 1 jobs.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f403c30fc515
[wdspec] Handle invalid UTF-8 when reading minidump .extra files. r=webdriver-reviewers,jdescottes

Comment 5

[amarc]

https://hg.mozilla.org/mozilla-central/rev/f403c30fc515

Comment 6

[Intermittent Failures Robot]

Summary

1 failures in 4566 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• macosx1470-64: 1
  • opt: 1

Table

	no_variant
macosx1470-64--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1944415&startday=2025-01-27&endday=2025-02-02&tree=all