1571527 - Intermittent TEST-UNEXPECTED-PASS | /css/css-writing-modes/text-orientation-script-001i.html | Default orientation for vo=R - expected FAIL

Reporter

Description

•

6 years ago

treeherder

Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=259967914&repo=mozilla-inbound
Full log: https://queue.taskcluster.net/v1/task/Y2iLGRgwSLK6bGOEpT9gvA/runs/0/artifacts/public/logs/live_backing.log

[task 2019-08-05T18:38:20.025Z] 18:38:20 [task 2019-08-05T18:38:20.029Z] 18:38:20 [task 2019-08-05T18:38:20.036Z] 18:38:20 [task 2019-08-05T18:38:20.036Z] 18:38:20 [task 2019-08-05T18:38:20.051Z] 18:38:20 [task 2019-08-05T18:38:20.098Z] 18:38:20 [task 2019-08-05T18:38:20.098Z] 18:38:20 [task 2019-08-05T18:38:20.099Z] 18:38:20 [task 2019-08-05T18:38:20.106Z] 18:38:20 [task 2019-08-05T18:38:20.110Z] 18:38:20 [task 2019-08-05T18:38:20.110Z] 18:38:20 [task 2019-08-05T18:38:20.110Z] 18:38:20 [task 2019-08-05T18:38:20.113Z] 18:38:20 [task 2019-08-05T18:38:20.120Z] 18:38:20 [task 2019-08-05T18:38:20.121Z] 18:38:20 [task 2019-08-05T18:38:20.124Z] 18:38:20 [task 2019-08-05T18:38:20.224Z] 18:38:20 [task 2019-08-05T18:38:20.224Z] 18:38:20 [task 2019-08-05T18:38:20.224Z] 18:38:20 [task 2019-08-05T18:38:20.225Z] 18:38:20 [task 2019-08-05T18:38:20.228Z] 18:38:20 [task 2019-08-05T18:38:20.228Z] 18:38:20 [task 2019-08-05T18:38:20.243Z] 18:38:20 [task 2019-08-05T18:38:20.243Z] 18:38:20 [task 2019-08-05T18:38:20.278Z] 18:38:20 [task 2019-08-05T18:38:20.281Z] 18:38:20 [task 2019-08-05T18:38:20.304Z] 18:38:20 [task 2019-08-05T18:38:20.347Z] 18:38:20 [task 2019-08-05T18:38:20.349Z] 18:38:20 [task 2019-08-05T18:38:20.349Z] 18:38:20 [task 2019-08-05T18:38:20.350Z] 18:38:20 [task 2019-08-05T18:38:20.350Z] 18:38:20 [task 2019-08-05T18:38:20.386Z] 18:38:20 [task 2019-08-05T18:38:20.387Z] 18:38:20 [task 2019-08-05T18:38:20.387Z] 18:38:20 [task 2019-08-05T18:38:20.388Z] 18:38:20 [task 2019-08-05T18:38:20.388Z] 18:38:20 [task 2019-08-05T18:38:20.389Z] 18:38:20 [task 2019-08-05T18:38:20.389Z] 18:38:20 [task 2019-08-05T18:38:20.389Z] 18:38:20 [task 2019-08-05T18:38:20.389Z] 18:38:20 [task 2019-08-05T18:38:20.389Z] 18:38:20 [task 2019-08-05T18:38:20.390Z] 18:38:20 [task 2019-08-05T18:38:20.390Z] 18:38:20 [task 2019-08-05T18:38:20.738Z] 18:38:20 [task 2019-08-05T18:38:20.738Z] 18:38:20 [task 2019-08-05T18:38:20.738Z] 18:38:20 [task 2019-08-05T18:38:20.740Z] 18:38:20 [task 2019-08-05T18:38:20.740Z] 18:38:20 INFO - TEST-START | /css/css-writing-modes/text-orientation-script-001i.html
INFO - Closing window 98784247809
INFO - PID 4420 | [Parent 4536, Main Thread] WARNING: Constructing RangeBoundary with invalid value: 'mRef || aOffset == 0', file z:/build/build/src/obj-firefox/dist/include\mozilla/RangeBoundary.h, line 79
INFO - PID 4420 | [Parent 4536, Main Thread] WARNING: Constructing RangeBoundary with invalid value: 'mRef || aOffset == 0', file z:/build/build/src/obj-firefox/dist/include\mozilla/RangeBoundary.h, line 79
INFO - PID 4420 | [Child 4100, Main Thread] WARNING: No active window: file z:/build/build/src/js/xpconnect/src/XPCJSContext.cpp, line 664
INFO - PID 4420 | [Parent 4536, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | [Child 2700, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | [Child 2700, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | [Parent 4536, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | ++DOCSHELL 01762000 == 1 [pid = 4968] [id = {b65a2ec9-dbeb-4dd3-b760-39f664eca599}]
INFO - PID 4420 | [Child 4968, Main Thread] WARNING: 'NS_FAILED(rv)', file z:/build/build/src/widget/windows/nsLookAndFeel.cpp, line 853
INFO - PID 4420 | ++DOMWINDOW == 1 (017A6280) [pid = 4968] [serial = 1] [outer = 00000000]
INFO - PID 4420 | [Child 4968, Main Thread] WARNING: No active window: file z:/build/build/src/js/xpconnect/src/XPCJSContext.cpp, line 664
INFO - PID 4420 | [Parent 4536, Main Thread] WARNING: Constructing RangeBoundary with invalid value: 'mRef || aOffset == 0', file z:/build/build/src/obj-firefox/dist/include\mozilla/RangeBoundary.h, line 79
INFO - PID 4420 | [Parent 4536, Main Thread] WARNING: Constructing RangeBoundary with invalid value: 'mRef || aOffset == 0', file z:/build/build/src/obj-firefox/dist/include\mozilla/RangeBoundary.h, line 79
INFO - PID 4420 | ++DOMWINDOW == 2 (0176A400) [pid = 4968] [serial = 2] [outer = 017A6280]
INFO - PID 4420 | [Parent 4536, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | [Parent 4536, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | [Parent 4536, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | [Parent 4536, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | [Parent 4536, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | [Parent 4536, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
INFO - PID 4420 | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to c:\users\task_1565028912\appdata\local\temp\tmptc_te5.mozrunner\runtests_leaks_860_tab_pid1512.log
INFO - PID 4420 | [Child 4968, Main Thread] WARNING: 'NS_FAILED(GetAccentColor(unused))', file z:/build/build/src/widget/windows/nsLookAndFeel.cpp, line 481
INFO - PID 4420 | ++DOMWINDOW == 3 (070AE400) [pid = 4968] [serial = 3] [outer = 017A6280]
INFO - PID 4420 | [Child 4968, Main Thread] WARNING: NS_ENSURE_SUCCESS(mStatus, *this) failed with result 0x80004005: file z:/build/build/src/obj-firefox/dist/include\nsIURIMutator.h, line 489
INFO - PID 4420 | --DOCSHELL 00862000 == 0 [pid = 2700] [id = {1a1fd86b-25fa-43c4-944c-10055ba8c181}] [url = http://web-platform.test:8000/css/css-writing-modes/text-orientation-script-001h.html]
INFO - PID 4420 | ++DOMWINDOW == 4 (0A16A400) [pid = 4968] [serial = 4] [outer = 017A6280]
INFO - PID 4420 | --DOMWINDOW == 3 (008AD280) [pid = 2700] [serial = 1] [outer = 00000000] [url = http://web-platform.test:8000/css/css-writing-modes/text-orientation-script-001h.html]
INFO - PID 4420 | --DOMWINDOW == 2 (0086A400) [pid = 2700] [serial = 2] [outer = 00000000] [url = about:blank]
INFO - PID 4420 | --DOMWINDOW == 1 (088B1400) [pid = 2700] [serial = 3] [outer = 00000000] [url = about:blank]
INFO - PID 4420 | --DOMWINDOW == 0 (0A46A400) [pid = 2700] [serial = 4] [outer = 00000000] [url = http://web-platform.test:8000/css/css-writing-modes/text-orientation-script-001h.html]
INFO - PID 4420 | [Parent 4536, Main Thread] WARNING: Constructing RangeBoundary with invalid value: 'mRef || aOffset == 0', file z:/build/build/src/obj-firefox/dist/include\mozilla/RangeBoundary.h, line 79
INFO - PID 4420 | [Parent 4536, Main Thread] WARNING: Constructing RangeBoundary with invalid value[Child 2700, Main :Thread] WARNI 'mRNG: XPef || aCOffset == 0',OM obj ects cfile z:/build/buildr/srce/obated/destrj-firoyed freom statfoic ctoxr/dtor: fi/le z:/builddist//build/src/xpcominclu/de\mbozilla/RangeBoundaase/nry.h, linsTe 79
INFO - PID 4420 | raceRefcnt.cpp, line 198
INFO - PID 4420 | [Child 2700, Main Thread] WARNING: XPCOM objects created/destroyed from static ctor/dtor: file z:/build/build/src/xpcom/base/nsTraceRefcnt.cpp, line 198
INFO - PID 4420 | nsStringStats
INFO - PID 4420 | => mAllocCount: 12717
INFO - PID 4420 | => mReallocCount: 0
INFO - PID 4420 | => mFreeCount: 12717
INFO - PID 4420 | => mShareCount: 14543
INFO - PID 4420 | => mAdoptCount: 534
INFO - PID 4420 | => mAdoptFreeCount: 538
INFO - PID 4420 | => Process ID: 2700, Thread ID: 4800
INFO -
INFO - TEST-UNEXPECTED-PASS | /css/css-writing-modes/text-orientation-script-001i.html | Default orientation for vo=R - expected FAIL
INFO - TEST-INFO | expected FAIL
INFO - ..
INFO - TEST-OK | /css/css-writing-modes/text-orientation-script-001i.html | took 718ms

Bogdan Tara[:bogdan_tara | bogdant]

Updated

•

6 years ago

Regressed by: 1532639

Bogdan Tara[:bogdan_tara | bogdant]

Comment 1

•

6 years ago

This is very very high occurrence.

James, could you, please, take a look?

Flags: needinfo?(james)

Daniel Holbert [:dholbert]

Assignee

Comment 2

•

6 years ago

Looks like this test's annotation was changed this morning in bug 1570643 -- that's the proper "regression" bug to tag here, I think.

Prior to that change, we had windows as expected-pass:

[text-orientation-script-001i.html]
  [Default orientation for vo=R]
    expected:
      if (os == "win"): PASS
      FAIL

But, bug 1570643's patch made that condition much more specific, such that it now expects Win32 Debug jobs to fail:

[text-orientation-script-001i.html]
  [Default orientation for vo=R]
    expected:
      if (os == "win") and debug and (processor == "x86_64"): PASS
      if (os == "win") and not debug: PASS
      FAIL

https://hg.mozilla.org/integration/mozilla-inbound/diff/6e73f688336abf41ce2ab589ebf24e21a89dbe37/testing/web-platform/meta/css/css-writing-modes/text-orientation-script-001i.html.ini

But these jobs are apparently still passing, hence this "unexpected-pass".

It doesn't look like the test itself (text-orientation-script-001i.html) changed at all, so there's not really any reason the expectation should've changed.

Regressed by: 1570643
No longer regressed by: 1532639

Daniel Holbert [:dholbert]

Assignee

Comment 3

•

6 years ago

bogdan, do you know if this is at 100% occurrence since bug 1570643 landed this morning?

BTW I suspect we won't hear from James for a little while since it's quite late in his timezone (in the UK).

Daniel Holbert [:dholbert]

Assignee

Updated

•

6 years ago

Flags: needinfo?(btara)

Daniel Holbert [:dholbert]

Assignee

Updated

•

6 years ago

Comment 4

•

6 years ago

Based on the next link, i'd say it got closer to perma fail after the wpt sync:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&fromchange=00e51535a7b111613df53e2763280fe4d109f3f2&searchStr=windows%2C7%2Cdebug%2Cweb%2Cplatform%2Ctests%2Ctest-windows7-32%2Fdebug-web-platform-tests-e10s-6%2Cw%28wpt6%29&tochange=7a4031897e6bd0d5e86a56e5cd727eef4c0f2558

Since bug 1570643 landed, we have 1 green out of 20 runs.

Flags: needinfo?(btara)

Daniel Holbert [:dholbert]

Assignee

Comment 5

•

6 years ago

Thanks. So yeah, it's not 100% reliable.

I'll bet the test-failure we're "expecting" here is bug 1571049. In particular:

bug 1571049 was filed on this occasionally unexpectectly failing when the annotation made it an expected-pass.
Then we changed it to expected-fail (perhaps based on a one-off run where it happened to have been observed failing)
...which spawned this bug on it unexpectedly passing.

Really, this test is probably just nondeterministic on Win32 Debug, and we need to annotate it as such (rather than expected-pass/expected-fail).

Pulsebot

Comment 6

•

6 years ago

Pushed by dholbert@mozilla.com: https://hg.mozilla.org/integration/mozilla-inbound/rev/c72b357d60dd Annotate web-platform-test text-orientation-script-001i.html as intermittent on Win debug. (no review, test-annotation-only)

Daniel Holbert [:dholbert]

Assignee

Updated

•

6 years ago

Flags: needinfo?(james)

Daniel Holbert [:dholbert]

Assignee

Updated

•

6 years ago

Blocks: 1571049

Bob Clary [:bc] (inactive)

Updated

•

6 years ago

Whiteboard: [test isolation]

Comment hidden (Intermittent Failures Robot)

Dorel Luca [:dluca]

Comment 9

•

6 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/c72b357d60dd

Status: NEW → RESOLVED

Closed: 6 years ago

status-firefox70: --- → fixed

Resolution: --- → FIXED

Target Milestone: --- → mozilla70

BugBot [:suhaib / :marco/ :calixte]

Updated

•

6 years ago

Assignee: nobody → dholbert

Comment hidden (Intermittent Failures Robot)

Ryan VanderMeulen [:RyanVM]

Updated

•

6 years ago

status-firefox68: --- → unaffected

status-firefox69: --- → unaffected

status-firefox-esr60: --- → unaffected

status-firefox-esr68: --- → unaffected

Daniel Holbert [:dholbert]

Assignee

Comment 11

•

6 years ago

(In reply to Intermittent Failures Robot from comment #10)

30 failures in 4666 pushes (0.006 failures/push) were associated with this bug in the last 7 days.

The graph shows that these failures dropped to 0 between Aug 6th & Aug 7th (via comment 9) and haven't happened since.

--> All's well, and I'm calling this intermittent VERIFIED.

Status: RESOLVED → VERIFIED

BugBot [:suhaib / :marco/ :calixte]

Updated

•

4 years ago

Has Regression Range: --- → yes

Bugzilla

Intermittent TEST-UNEXPECTED-PASS | /css/css-writing-modes/text-orientation-script-001i.html | Default orientation for vo=R - expected FAIL

Categories

(Core :: CSS Parsing and Computation, defect, P5)

Tracking

()

People

(Reporter: intermittent-bug-filer, Assigned: dholbert)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [test isolation])

Crash Data

Security

(public)

User Story

Description

Updated

Comment 1

Comment 2

Comment 3

Updated

Updated

Comment 4

Comment 5

Comment 6

Updated

Updated

Updated

Comment 8

Comment 9

Updated

Comment 10

Updated

Comment 11

Updated