1805227 - Intermittent /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | single tracking bug

Reporter

Description

•

3 years ago

treeherder

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=399338359&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/A8Qn7HkFS1SBznQ8DFSUBg/runs/0/artifacts/public/logs/live_backing.log

[task 2022-12-12T15:21:59.181Z] 15:21:59     INFO - TEST-PASS | /css/css-writing-modes/forms/text-input-block-size.optional.html | Test input[type=number] block-size in writing-mode: sideways-rl 
[task 2022-12-12T15:21:59.181Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=text] in vertical-lr: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 285 but got 708
[task 2022-12-12T15:21:59.182Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.182Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=text] in vertical-rl: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 284 but got 916
[task 2022-12-12T15:21:59.182Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.182Z] 15:21:59     INFO - TEST-UNEXPECTED-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=text] in sideways-lr: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 225 but got 224
[task 2022-12-12T15:21:59.182Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - 
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=text] in sideways-rl: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 225 but got 916
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=password] in vertical-lr: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 332 but got 916
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=password] in vertical-rl: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 332 but got 916
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - TEST-UNEXPECTED-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=password] in sideways-lr: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 225 but got 224
[task 2022-12-12T15:21:59.184Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - 
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=password] in sideways-rl: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 225 but got 916
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=search] in vertical-lr: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 332 but got 916
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=search] in vertical-rl: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 332 but got 916
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - TEST-UNEXPECTED-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=search] in sideways-lr: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 225 but got 224
[task 2022-12-12T15:21:59.186Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - 
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=search] in sideways-rl: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 225 but got 916
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=number] in vertical-lr: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 332 but got 916
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - TEST-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=number] in vertical-rl: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 332 but got 916
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - TEST-UNEXPECTED-FAIL | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=number] in sideways-lr: typing characters in input should not cause the page to scroll - assert_equals: Typing lots of characters in input did not cause scrolling expected 225 but got 224
[task 2022-12-12T15:21:59.189Z] 15:21:59     INFO - @http://web-platform.test:8000/css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html:59:26
[task 2022-12-12T15:21:59.241Z] 15:21:59     INFO - TEST-OK | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | took 13704ms

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 9

•

3 years ago

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED

Closed: 3 years ago

Resolution: --- → INCOMPLETE

Treeherder Bug Filer

Reporter

Comment 10

•

3 years ago

treeherder

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=411252113&repo=autoland

Status: RESOLVED → REOPENED

Resolution: INCOMPLETE → ---

Comment hidden (Intermittent Failures Robot)

Noemi Erli[:noemi_erli]

Updated

•

3 years ago

Summary: Intermittent /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | single tracking bug → High frequency /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | single tracking bug

Noemi Erli[:noemi_erli]

Comment 14

•

3 years ago

This seems to be a high frequency since https://hg.mozilla.org/integration/autoland/rev/2e2638b00bd3 landed.
A better glance of the frequency can be seen here: https://treeherder.mozilla.org/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cusercancel&author=ctuns%40mozilla.com&fromchange=b99cdfd9c94f27a5ea5d5739e552dc890739fb1e&tochange=5fb38f51b93ac3e2b4c95f17bf4034f02e759a1d&searchStr=wpt2&selectedTaskRun=YYWh63rKQYmfpaquaN1w-g.0
James, could you please take a look at this?

Flags: needinfo?(james)

Keywords: regression

Regressed by: 1827782

BugBot [:suhaib / :marco/ :calixte]

Comment 15

•

3 years ago

Set release status flags based on info from the regressing bug 1827782

status-firefox112: --- → unaffected

status-firefox113: --- → unaffected

status-firefox114: --- → affected

status-firefox-esr102: --- → unaffected

Comment hidden (Intermittent Failures Robot)

Natalia Csoregi [:nataliaCs]

Comment 21

•

2 years ago

Update:

There have been 52 failures within the last 7 days:

3 failures on Linux 18.04 x64 WebRender opt
19 failures on Linux 18.04 x64 WebRender Shippable opt
15 failures on Windows 11 x86 22H2 WebRender debug
1 failure on Windows 11 x86 22H2 WebRender Shippable opt
6 failures on Windows 11 x64 22H2 WebRender debug
8 failures on Windows 11 x64 22H2 WebRender Shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=414101712&repo=mozilla-central&lineNumber=5676

[task 2023-04-28T11:23:42.996Z] 11:23:42     INFO - TEST-KNOWN-INTERMITTENT-PASS | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=search] in sideways-lr: typing characters in input should not cause the page to scroll 
[task 2023-04-28T11:23:42.997Z] 11:23:42     INFO - 
[task 2023-04-28T11:23:42.997Z] 11:23:42     INFO - TEST-UNEXPECTED-PASS | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | input[type=search] in sideways-rl: typing characters in input should not cause the page to scroll - expected FAIL
[task 2023-04-28T11:23:42.997Z] 11:23:42     INFO - TEST-INFO | expected FAIL
[task 2023-04-28T11:23:43.001Z] 11:23:43     INFO - ....
[task 2023-04-28T11:23:43.001Z] 11:23:43     INFO - TEST-OK | /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | took 875ms

Whiteboard: [stockwell needswork:owner]

Cosmin Sabou [:CosminS]

Comment 22

•

2 years ago

Attached file Bug 1805227 - Mark subtests on text-input-vertical-overflow-no-scroll.html as intermittent due to frequent passes. r=dholbert,aryx — Details

Phabricator Automation

Updated

•

2 years ago

Assignee: nobody → csabou

Comment hidden (Intermittent Failures Robot)

Daniel Holbert [:dholbert]

Updated

•

2 years ago

Comment 24

•

2 years ago

bug 1802466 is filed on the underlying test failure here. It's odd but not entirely surprising that it's intermittent.

I think the unexpected-passes/fails here are just due to the WPT-sync-bot insufficiently capturing the space of possibilities when running this test and capturing the passes & fails to generate the .ini file.

Thanks for updating the .ini file to reflect reality, CosminS!

Pulsebot

Comment 25

•

2 years ago

Pushed by archaeopteryx@coole-files.de: https://hg.mozilla.org/integration/autoland/rev/3dd4d6788b5c Mark subtests on text-input-vertical-overflow-no-scroll.html as intermittent due to frequent passes. r=dholbert

Noemi Erli[:noemi_erli]

Comment 26

•

2 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/3dd4d6788b5c

Status: REOPENED → RESOLVED

Closed: 3 years ago → 2 years ago

status-firefox114: affected → fixed

Resolution: --- → FIXED

Target Milestone: --- → 114 Branch

Cosmin Sabou [:CosminS]

Comment 27

•

2 years ago

There still are some unexpected passes as https://treeherder.mozilla.org/logviewer?job_id=414471626&repo=try.
Let's see how the failure rate goes.

Assignee: csabou → nobody

Status: RESOLVED → REOPENED

status-firefox114: fixed → ---

Flags: needinfo?(james)

Keywords: leave-open

Resolution: FIXED → ---

Summary: High frequency /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | single tracking bug → Intermittent /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | single tracking bug

Whiteboard: [stockwell disable-recommended]

Target Milestone: 114 Branch → ---

BugBot [:suhaib / :marco/ :calixte]

Comment 28

•

2 years ago

Set release status flags based on info from the regressing bug 1827782

status-firefox114: --- → affected

Comment hidden (Intermittent Failures Robot)

Cosmin Sabou [:CosminS]

Comment 30

•

2 years ago

Attached file Bug 1805227 - Further update expectations of subtests on text-input-vertical-overflow-no-scroll.html. r=dholbert,aryx — Details

BugBot [:suhaib / :marco/ :calixte]

Comment 31

•

2 years ago

Set release status flags based on info from the regressing bug 1827782

status-firefox115: --- → affected

Pulsebot

Comment 32

•

2 years ago

Pushed by csabou@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/53e3113eaf48 Further update expectations of subtests on text-input-vertical-overflow-no-scroll.html. r=dholbert

Daniel Holbert [:dholbert]

Comment 33

•

2 years ago

If the annotation needs further curation, I think we can just simplify and drop the platform-specific annotations, and mark the failure-prone parts as [PASS,FAIL] regardless of platform. We're aware that this test has some failures, per comment 24, so I'm not too concerned with losing test coverage there from marking it as pass-or-fail-everwywhere.

Atila Butkovits

Comment 34

•

2 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/53e3113eaf48

Cosmin Sabou [:CosminS]

Comment 35

•

2 years ago

The failure rate is low, I think we can live with it: https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2023-05-04&endday=2023-05-11&tree=trunk&failurehash=all&bug=1805227

Whiteboard: [stockwell disable-recommended]

Comment hidden (Intermittent Failures Robot)

Donal Meehan [:dmeehan]

Updated

•

2 years ago

status-firefox114: affected → wontfix

status-firefox115: affected → wontfix

Comment hidden (Intermittent Failures Robot)

Joel Maher ( :jmaher ) (UTC -8)

Updated

•

2 years ago

Duplicate of this bug: 1849600

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 83

•

1 year ago

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED

Closed: 2 years ago → 1 year ago

Resolution: --- → INCOMPLETE

BugBot (nomail) [:suhaib / :marco/ :calixte]

Updated

•

1 year ago

Keywords: leave-open

Treeherder Bug Filer

Reporter

Comment 84

•

1 year ago

treeherder

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=482714118&repo=mozilla-esr115

Status: RESOLVED → REOPENED

Resolution: INCOMPLETE → ---

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 88

•

1 year ago

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED

Closed: 1 year ago → 1 year ago

Resolution: --- → INCOMPLETE

Treeherder Bug Filer

Reporter

Comment 89

•

1 year ago

treeherder

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=491107967&repo=mozilla-esr115

Status: RESOLVED → REOPENED

Resolution: INCOMPLETE → ---

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 92

•

1 year ago

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED

Closed: 1 year ago → 1 year ago

Resolution: --- → INCOMPLETE

Comment hidden (Intermittent Failures Robot)

Treeherder Bug Filer

Reporter

Comment 97

•

6 months ago

treeherder

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=528740020&repo=mozilla-esr115

Status: RESOLVED → REOPENED

Resolution: INCOMPLETE → ---

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 101

•

5 months ago

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED

Closed: 1 year ago → 5 months ago

Resolution: --- → INCOMPLETE

Comment hidden (Intermittent Failures Robot)

Treeherder Bug Filer

Reporter

Comment 107

•

3 months ago

treeherder

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=542274716&repo=mozilla-esr115

Bug 1805227 - Mark subtests on text-input-vertical-overflow-no-scroll.html as intermittent due to frequent passes. r=dholbert,aryx 2 years ago Cosmin Sabou [:CosminS] 48 bytes, text/x-phabricator-request		Details \| Review
Bug 1805227 - Further update expectations of subtests on text-input-vertical-overflow-no-scroll.html. r=dholbert,aryx 2 years ago Cosmin Sabou [:CosminS] 48 bytes, text/x-phabricator-request		Details \| Review

	no_variant
linux1804-x86_64/opt	1
windows11-x86/opt	1
windows11-x86_64/opt	1

Intermittent /css/css-writing-modes/forms/text-input-vertical-overflow-no-scroll.html | single tracking bug

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Repository breakdown:

Table

For more details, see:

Repository breakdown:

Table

For more details, see:

Repository breakdown:

Table

For more details, see: