Closed Bug 1511162 Opened 6 years ago Closed 5 years ago

Intermittent /encoding/<randomtest> | <encoder> encoding (<random>) - ReferenceError: <encoder> is not defined

Categories

(Core :: Internationalization, defect, P5)

Product:
Core
Component:
Internationalization
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure)

Filed by: rmaries [at] mozilla.com https://treeherder.mozilla.org/logviewer.html#?job_id=214642703&repo=mozilla-central https://queue.taskcluster.net/v1/task/VX0YKVhcQomU8SLcnS4xRA/runs/0/artifacts/public/logs/live_backing.log [task 2018-11-29T17:33:45.757Z] 17:33:45 INFO - TEST-START | /encoding/legacy-mb-tchinese/big5/big5-encode-form-cn-big5.html?14001-last [task 2018-11-29T17:33:45.814Z] 17:33:45 INFO - Closing window 1187 [task 2018-11-29T17:34:12.047Z] 17:34:12 INFO - [task 2018-11-29T17:34:12.048Z] 17:34:12 INFO - TEST-UNEXPECTED-FAIL | /encoding/legacy-mb-tchinese/big5/big5-encode-form-cn-big5.html?14001-last | cn-big5 encoding (form) - ReferenceError: big5 is not defined [task 2018-11-29T17:34:12.048Z] 17:34:12 INFO - @http://web-platform.test:8000/encoding/legacy-mb-tchinese/big5/big5-encoder.js:2:20 [task 2018-11-29T17:34:12.048Z] 17:34:12 INFO - TEST-OK | /encoding/legacy-mb-tchinese/big5/big5-encode-form-cn-big5.html?14001-last | took 26335ms [task 2018-11-29T17:34:13.054Z] 17:34:13 INFO - Browser exited with return code 0 [task 2018-11-29T17:34:13.054Z] 17:34:13 INFO - Closing logging queue [task 2018-11-29T17:34:13.054Z] 17:34:13 INFO - queue closed [task 2018-11-29T17:34:13.070Z] 17:34:13 INFO - Setting up ssl [task 2018-11-29T17:34:13.085Z] 17:34:13 INFO - certutil | [task 2018-11-29T17:34:13.106Z] 17:34:13 INFO - certutil | [task 2018-11-29T17:34:13.121Z] 17:34:13 INFO - certutil | [task 2018-11-29T17:34:13.121Z] 17:34:13 INFO - Certificate Nickname Trust Attributes [task 2018-11-29T17:34:13.122Z] 17:34:13 INFO - SSL,S/MIME,JAR/XPI [task 2018-11-29T17:34:13.122Z] 17:34:13 INFO - [task 2018-11-29T17:34:13.122Z] 17:34:13 INFO - web-platform-tests CT,, [task 2018-11-29T17:34:13.122Z] 17:34:13 INFO - [task 2018-11-29T17:34:14.701Z] 17:34:14 INFO - adb Granting important runtime permissions to org.mozilla.fennec_aurora [task 2018-11-29T17:34:15.965Z] 17:34:15 INFO - adb launch_application: am start -W -n org.mozilla.fennec_aurora/org.mozilla.gecko.BrowserApp -a android.intent.action.VIEW --es env9 MOZ_PROCESS_LOG=/tmp/tmpOUF_oWpidlog --es env8 MOZ_CRASHREPORTER_NO_REPORT=1 --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 STYLO_THREADS=4 --es env2 MOZ_HIDE_RESULTS_TABLE=1 --es env1 R_LOG_VERBOSE=1 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env6 R_LOG_DESTINATION=stderr --es env5 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env4 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4,MediaPipelineFactory:4 --es env10 R_LOG_LEVEL=6
Mostly affects Android 7.0x86.
Summary: Intermittent /encoding/legacy-mb-tchinese/big5/big5-encode-form-cn-big5.html?14001-last | cn-big5 encoding (form) - ReferenceError: big5 is not defined → Intermittent /encoding/<randomtest> | <encoder> encoding (<random>) - ReferenceError: <encoder> is not defined
kwierso - did you see these when you were greening android wpt?
Flags: needinfo?(wkocher)
The earliest failure I can find is https://treeherder.mozilla.org/logviewer.html#?job_id=214642680&repo=mozilla-central and that's only a few revisions after bug 1510536 started running wpt on android. So I think this is a fairly infrequent intermittent failure that has been there all along. Should we skip the encoding tests on android?
(In reply to Geoff Brown [:gbrown] from comment #12) > Should we skip the encoding tests on android? Up to Aryx if these passed a combined threshold of failing too much to leave enabled. I know Hsivonen has done things with encoding stuff, maybe he knows why the various encoders are intermittently not being defined on Fennec?
Flags: needinfo?(hsivonen)
Flags: needinfo?(aryx.bugmail)
The frequency is nothing to worry about at the moment. Keep them enabled, if this can't be fixed in a sane way, this can still be revisited.
Flags: needinfo?(aryx.bugmail)
There are two script: index and the actual test. In the Big5 case https://searchfox.org/mozilla-central/source/testing/web-platform/tests/encoding/legacy-mb-tchinese/big5/big5_index.js is the index, which defines var big5. https://searchfox.org/mozilla-central/source/testing/web-platform/tests/encoding/legacy-mb-tchinese/big5/big5-encoder.js is the test that expect var big5 to exist. Since we aren't seeing other reports of scripts running out of order, I expect the scripts to execute always big5_index.js first and big5-encoder.js second, as they should. My hypothesis, therefore, is that the loading of big5_index.js, which is very large, intermittently times out so that we end up not executing big5_index.js at all. Splitting big5_index.js doesn't really make sense.
Flags: needinfo?(hsivonen)

Henri, can you do something about these tests failing rather frequently?

Aryx, can you do something about the flood of duplicates that spins up every other week and then gets duped again?

As I'm watching the intl component, this is a rather annoying amount of bugmail. In particular with the dupes, it's hard to mute it.

Flags: needinfo?(hsivonen)
Flags: needinfo?(aryx.bugmail)

(In reply to Axel Hecht [:Pike] from comment #40)

Henri, can you do something about these tests failing rather frequently?

Comment 15 still holds: It doesn't make sense to try to split the test. We could disable the test.

Aryx, should we just disable the test?

Flags: needinfo?(hsivonen)

There are 30 failures associated to this bug in the last 7 days. These are occurring on android-em-7-0-x86 debug and opt builds.

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → INCOMPLETE

New occurrence: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=309672969&repo=autoland&lineNumber=5201

Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

(In reply to Atila Butkovits from comment #106)

New occurrence: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=309672969&repo=autoland&lineNumber=5201

No, this is another issue. New failure is WPT's test suite.

[task 2020-07-14T00:20:44.231Z] 00:20:44  WARNING - Unexpected value (expecting string-like): None
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING - Traceback (most recent call last):
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/server.py", line 267, in finish_handling
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING -     handler(request, response)
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/handlers.py", line 294, in __call__
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING -     self._set_path_and_load_file(request, response, func)
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/handlers.py", line 277, in _set_path_and_load_file
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING -     return func(request, response, environ, path)
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/handlers.py", line 289, in func
[task 2020-07-14T00:20:44.233Z] 00:20:44  WARNING -     handler(request, response)
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/handlers.py", line 347, in __call__
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -     response.headers.update(headers)
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/response.py", line 395, in update
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -     self.append(name, value)
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/response.py", line 351, in append
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -     value = _maybe_encode(value)
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/response.py", line 324, in _maybe_encode
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -     return isomorphic_encode(s)
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -   File "/builds/worker/workspace/build/venv/lib/python2.7/site-packages/wptserve/utils.py", line 40, in isomorphic_encode
[task 2020-07-14T00:20:44.234Z] 00:20:44  WARNING -     raise TypeError("Unexpected value (expecting string-like): %r" % s)

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: REOPENED → RESOLVED
Closed: 5 years ago → 5 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.