1834673 - Perma jit-1proc [tier 2] UnicodeDecodeError: 'charmap' codec can't decode byte 0x90 in position 1009: character maps to <undefined>

Status: RESOLVED FIXED

(Core :: JavaScript Engine, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=416800219&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/V4ejyCs5RZGdW3Y0xEq64w/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-05-24T00:10:16.213Z] Error: No objdir path for Z:\task_168488612479260\build\tests\jit-test\jit-test\tests\debug\Frame-eval-12.js.
[task 2023-05-24T00:10:16.213Z] Couldn't find source info for Z:\task_168488612479260\build\tests\jit-test\jit-test\tests\debug\Frame-eval-12.js, removing record
[task 2023-05-24T00:10:16.215Z] Error: No objdir path for Z:\task_168488612479260\build\tests\jit-test\jit-test\tests\debug\Frame-eval-16.js.
[task 2023-05-24T00:10:16.215Z] Couldn't find source info for Z:\task_168488612479260\build\tests\jit-test\jit-test\tests\debug\Frame-eval-16.js, removing record
[task 2023-05-24T00:10:16.219Z] 00:10:16    ERROR - Exception during post-action for run-tests: Traceback (most recent call last):
[task 2023-05-24T00:10:16.219Z] 00:10:16    ERROR -   File "Z:\task_168488612479260\mozharness\mozharness\base\script.py", line 2339, in run_action
[task 2023-05-24T00:10:16.219Z] 00:10:16    ERROR -     method(action, success=success and self.return_code == 0)
[task 2023-05-24T00:10:16.219Z] 00:10:16    ERROR -   File "Z:\task_168488612479260\mozharness\mozharness\mozilla\testing\codecoverage.py", line 519, in _package_coverage_data
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -     grcov_output_file, jsvm_output_file = self.parse_coverage_artifacts(
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -   File "Z:\task_168488612479260\mozharness\mozharness\mozilla\testing\codecoverage.py", line 305, in parse_coverage_artifacts
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -     rewriter.rewrite_files(jsvm_files, jsvm_output_file, "")
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -   File "Z:\task_168488612479260\build\tests\mozbuild\codecoverage\lcov_rewriter.py", line 696, in rewrite_files
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -     lcov_file.print_file(
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -   File "Z:\task_168488612479260\build\tests\mozbuild\codecoverage\lcov_rewriter.py", line 312, in print_file
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -     for source_file, pp_info, record_content in self.iterate_records(
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -   File "Z:\task_168488612479260\build\tests\mozbuild\codecoverage\lcov_rewriter.py", line 239, in iterate_records
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -     for line in lcov_fh:
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -   File "c:\mozilla-build\python3\lib\encodings\cp1252.py", line 23, in decode
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR -     return codecs.charmap_decode(input,self.errors,decoding_table)[0]
[task 2023-05-24T00:10:16.223Z] 00:10:16    ERROR - UnicodeDecodeError: 'charmap' codec can't decode byte 0x90 in position 1009: character maps to <undefined>
[task 2023-05-24T00:10:16.225Z] 00:10:16     INFO - Running post-action listener: _resource_record_post_action
[task 2023-05-24T00:10:16.225Z] 00:10:16     INFO - Running post-action listener: process_java_coverage_data
[task 2023-05-24T00:10:16.226Z] 00:10:16     INFO - [mozharness: 2023-05-24 00:10:16.225401Z] Finished run-tests step (success)
[task 2023-05-24T00:10:16.226Z] 00:10:16    FATAL - Aborting due to failure in post-action listener.
[task 2023-05-24T00:10:16.226Z] 00:10:16    FATAL - Running post_fatal callback...
[task 2023-05-24T00:10:16.226Z] 00:10:16    FATAL - Exiting -1
[task 2023-05-24T00:10:16.226Z] 00:10:16     INFO - Running post-run listener: _resource_record_post_run
[task 2023-05-24T00:10:16.314Z] 00:10:16     INFO - instance_metadata.json not found; unable to determine instance type
[task 2023-05-24T00:10:16.320Z] 00:10:16     INFO - Validating Perfherder data against Z:\task_168488612479260\mozharness\external_tools\performance-artifact-schema.json
[task 2023-05-24T00:10:16.322Z] 00:10:16     INFO - PERFHERDER_DATA: {"framework": {"name": "job_resource_usage"}, "suites": [{"name": "jittest.jittest.4.overall", "extraOptions": ["buildbot-unknown"], "subtests": [{"name": "cpu_percent", "value": 93.98065610859727}, {"name": "io_write_bytes", "value": 1958458880}, {"name": "io.read_bytes", "value": 90433536}, {"name": "io_write_time", "value": 29}, {"name": "io_read_time", "value": 3}]}, {"name": "jittest.jittest.4.start-pulseaudio", "subtests": [{"name": "time", "value": 0.010260820388793945}, {"name": "cpu_percent", "value": 0}]}, {"name": "jittest.jittest.4.install", "subtests": [{"name": "time", "value": 3.8197531700134277}, {"name": "cpu_percent", "value": 35.237500000000004}]}, {"name": "jittest.jittest.4.stage-files", "subtests": [{"name": "time", "value": 0.0}, {"name": "cpu_percent", "value": 0}]}, {"name": "jittest.jittest.4.run-tests", "subtests": [{"name": "time", "value": 222.33345794677734}, {"name": "cpu_percent", "value": 95.08341013824884}]}]}
[task 2023-05-24T00:10:16.322Z] 00:10:16     INFO - Total resource usage - Wall time: 225s; CPU: 95%; Read bytes: 90433536; Write bytes: 1958458880; Read time: 3; Write time: 29
[task 2023-05-24T00:10:16.322Z] 00:10:16     INFO - TinderboxPrint: CPU usage<br/>95.1%
[task 2023-05-24T00:10:16.322Z] 00:10:16     INFO - TinderboxPrint: I/O read bytes / time<br/>90,433,536 / 3
[task 2023-05-24T00:10:16.322Z] 00:10:16     INFO - TinderboxPrint: I/O write bytes / time<br/>1,958,458,880 / 29
[task 2023-05-24T00:10:16.322Z] 00:10:16     INFO - TinderboxPrint: CPU idle<br/>106.4 (5.9%)
[task 2023-05-24T00:10:16.322Z] 00:10:16     INFO - TinderboxPrint: CPU system<br/>650.5 (36.0%)
[task 2023-05-24T00:10:16.323Z] 00:10:16     INFO - TinderboxPrint: CPU user<br/>1,046.3 (57.9%)
[task 2023-05-24T00:10:16.323Z] 00:10:16     INFO - start-pulseaudio - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2023-05-24T00:10:16.323Z] 00:10:16     INFO - install - Wall time: 4s; CPU: 35%; Read bytes: 672256; Write bytes: 18886656; Read time: 0; Write time: 0
[task 2023-05-24T00:10:16.323Z] 00:10:16     INFO - stage-files - Wall time: 0s; CPU: Can't collect data; Read bytes: 0; Write bytes: 0; Read time: 0; Write time: 0
[task 2023-05-24T00:10:16.324Z] 00:10:16     INFO - run-tests - Wall time: 222s; CPU: 95%; Read bytes: 89122816; Write bytes: 1914406400; Read time: 3; Write time: 29
[taskcluster 2023-05-24T00:10:16.439Z]    Exit Code: 4294967295
[taskcluster 2023-05-24T00:10:16.439Z]    User Time: 15.625ms
[taskcluster 2023-05-24T00:10:16.439Z]  Kernel Time: 31.25ms
[taskcluster 2023-05-24T00:10:16.439Z]    Wall Time: 6m10.1509877s
[taskcluster 2023-05-24T00:10:16.439Z]       Result: FAILED
[taskcluster 2023-05-24T00:10:16.439Z] === Task Finished ===
[taskcluster 2023-05-24T00:10:16.439Z] Task Duration: 6m10.1526933s
[taskcluster 2023-05-24T00:10:16.565Z] Uploading artifact public/logs/localconfig.json from file logs\localconfig.json with content encoding "gzip", mime type "application/json" and expiry 2023-08-21T21:51:43.242Z
[taskcluster 2023-05-24T00:10:16.924Z] Uploading link artifact public/logs/live.log to artifact public/logs/live_backing.log with expiry 2023-08-21T21:51:43.242Z
[taskcluster:error] exit status 0xffffffff

Comment 1

[Iulian Moraru]

Hi Tooru! Can you please take a look at this?
Thank you!

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1492090

Comment 3

[Tooru Fujisawa [:arai]]

This is caused by the error logging which doesn't properly handle the encoding, where the internal encoding is changed to UTF-8 and the output encoding is still using cp1252.
performing lossy conversion or something should solve the issue, given the logging itself isn't critical part.

Comment 4

[Tooru Fujisawa [:arai]]

Attachment: Bug 1834673 - Part 1: Use UTF-8 in LCOV rewriter. r?#build!

Comment 5

[Tooru Fujisawa [:arai]]

Attachment: Bug 1834673 - Part 2: Replace incompatible characters in LCOV error reporting. r?#build!

Depends on D179051

Comment 6

[Intermittent Failures Robot]

14 failures in 3946 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 14

Platform and build breakdown:

• windows11-64-2009-ccov-qr: 14
  • opt: 14

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1834673&startday=2023-05-22&endday=2023-05-28&tree=all

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b51c00bccac7
Part 1: Use UTF-8 in LCOV rewriter. r=firefox-build-system-reviewers,nalexander
https://hg.mozilla.org/integration/autoland/rev/229ef449c483
Part 2: Replace incompatible characters in LCOV error reporting. r=ahochheiden,firefox-build-system-reviewers

Comment 8

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/b51c00bccac7
https://hg.mozilla.org/mozilla-central/rev/229ef449c483

Comment 9

[Intermittent Failures Robot]

7 failures in 3471 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7

Platform and build breakdown:

• windows11-64-2009-ccov-qr: 7
  • opt: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1834673&startday=2023-05-29&endday=2023-06-04&tree=all