1563905 - PERMA TEST-UNEXPECTED-FAIL | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Checking array values: Check all menuitems are displayed correctly. - got 1, expected 2 when Gecko 69 merges to Beta on 2019-07-01

Status: VERIFIED FIXED

(Toolkit :: Password Manager, defect)

Description

[Daniel Varga [:dvarga]]

Central as beta simulation: https://hg.mozilla.org/try/rev/b9c00793544c6bc8bd8f1d425a24dfa11afec515

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=255093816&repo=try&lineNumber=4864

[task 2019-07-06T12:00:51.536Z] 12:00:51     INFO - TEST-PASS | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | the footer text is shown correctly 
[task 2019-07-06T12:00:51.537Z] 12:00:51     INFO - Buffered messages finished
[task 2019-07-06T12:00:51.537Z] 12:00:51     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Checking array values: Check all menuitems are displayed correctly. - got 1, expected 2
[task 2019-07-06T12:00:51.539Z] 12:00:51     INFO - SimpleTest.is@https://example.com/tests/SimpleTest/SimpleTest.js:320:16
[task 2019-07-06T12:00:51.540Z] 12:00:51     INFO - checkArrayValues@https://example.com/tests/toolkit/components/satchel/test/satchel_common.js:66:3
[task 2019-07-06T12:00:51.541Z] 12:00:51     INFO - checkAutoCompleteResults@https://example.com/tests/toolkit/components/passwordmgr/test/mochitest/pwmgr_common.js:77:3
[task 2019-07-06T12:00:51.541Z] 12:00:51     INFO - test_form1_menu_shows_two_logins_same_usernames_for_different_subdomain@https://example.com/tests/toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html:113:3
[task 2019-07-06T12:00:51.542Z] 12:00:51     INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-07-06T12:00:51.543Z] 12:00:51     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Check all menuitems are displayed correctly. Checking array entry #0 - got "dsdu1", expected "dsdu1 (Jul 6, 2019)"
[task 2019-07-06T12:00:51.544Z] 12:00:51     INFO - SimpleTest.is@https://example.com/tests/SimpleTest/SimpleTest.js:320:16
[task 2019-07-06T12:00:51.545Z] 12:00:51     INFO - checkArrayValues@https://example.com/tests/toolkit/components/satchel/test/satchel_common.js:72:5
[task 2019-07-06T12:00:51.545Z] 12:00:51     INFO - checkAutoCompleteResults@https://example.com/tests/toolkit/components/passwordmgr/test/mochitest/pwmgr_common.js:77:3
[task 2019-07-06T12:00:51.547Z] 12:00:51     INFO - test_form1_menu_shows_two_logins_same_usernames_for_different_subdomain@https://example.com/tests/toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html:113:3
[task 2019-07-06T12:00:51.548Z] 12:00:51     INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-07-06T12:00:51.549Z] 12:00:51     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Check all menuitems are displayed correctly. Checking array entry #1 - got undefined, expected "dsdu1 (Jul 6, 2019)"
[task 2019-07-06T12:00:51.550Z] 12:00:51     INFO - SimpleTest.is@https://example.com/tests/SimpleTest/SimpleTest.js:320:16
[task 2019-07-06T12:00:51.551Z] 12:00:51     INFO - checkArrayValues@https://example.com/tests/toolkit/components/satchel/test/satchel_common.js:72:5
[task 2019-07-06T12:00:51.552Z] 12:00:51     INFO - checkAutoCompleteResults@https://example.com/tests/toolkit/components/passwordmgr/test/mochitest/pwmgr_common.js:77:3
[task 2019-07-06T12:00:51.552Z] 12:00:51     INFO - test_form1_menu_shows_two_logins_same_usernames_for_different_subdomain@https://example.com/tests/toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html:113:3
[task 2019-07-06T12:00:51.553Z] 12:00:51     INFO - TEST-PASS | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Checking form1 username is:  
[task 2019-07-06T12:00:51.554Z] 12:00:51     INFO - TEST-PASS | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Checking form1 password is:  
[task 2019-07-06T12:00:51.555Z] 12:00:51     INFO - 1 form(s) processed
[task 2019-07-06T12:00:51.555Z] 12:00:51     INFO - TEST-PASS | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | password should match the login that was selected 
[task 2019-07-06T12:00:51.556Z] 12:00:51     INFO - TEST-PASS | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Checking form1 username is: dsdu1 
[task 2019-07-06T12:00:51.557Z] 12:00:51     INFO - TEST-PASS | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Checking form1 password is: dsdp1 
[task 2019-07-06T12:00:51.558Z] 12:00:51     INFO - TEST-PASS | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Checking form1 username is:  
[task 2019-07-06T12:00:51.558Z] 12:00:51     INFO - TEST-PASS | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Checking form1 password is:  
[task 2019-07-06T12:06:17.768Z] 12:06:17     INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-07-06T12:06:17.769Z] 12:06:17     INFO - TEST-UNEXPECTED-FAIL | toolkit/components/passwordmgr/test/mochitest/test_basic_form_autocomplete_subdomain.html | Test timed out. 
[task 2019-07-06T12:06:17.769Z] 12:06:17     INFO - SimpleTest.ok@https://example.com/tests/SimpleTest/SimpleTest.js:275:18
[task 2019-07-06T12:06:17.769Z] 12:06:17     INFO - reportError@https://example.com/tests/SimpleTest/TestRunner.js:121:22
[task 2019-07-06T12:06:17.769Z] 12:06:17     INFO - TestRunner._checkForHangs@https://example.com/tests/SimpleTest/TestRunner.js:142:7
[task 2019-07-06T12:06:18.816Z] 12:06:18     INFO - GECKO(3153) | Removing 1 popup notifications.
[task 2019-07-06T12:06:18.858Z] 12:06:18     INFO - GECKO(3153) | MEMORY STAT | vsize 20974515MB | residentFast 761MB

Comment 1

[Intermittent Failures Robot]

50 failures in 175 pushes (0.286 failures/push) were associated with this bug yesterday.

Repository breakdown:

• try: 50

Platform breakdown:

• linux64: 24
• linux64-qr: 3
• macosx1014-64: 2
• macosx1014-64-shippable: 2
• macosx1014-64-devedition: 1
• windows10-64: 2
• windows10-64-qr: 2
• windows7-32: 2
• linux64-shippable: 2
• linux64-shippable-qr: 2
• linux64-devedition: 1
• windows7-32-devedition: 1
• windows10-64-devedition: 1
• windows10-64-shippable: 2
• windows10-64-shippable-qr: 2
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563905&startday=2019-07-06&endday=2019-07-06&tree=all

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

More likely from bug 1563325 because the second failing test test_basic_form_honor_autocomplete_off.html didn't get modified.

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Back to bug 1541557, noticed the missing date now.

Comment 4

[Intermittent Failures Robot]

50 failures in 3501 pushes (0.014 failures/push) were associated with this bug in the last 7 days.

This is the #32 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• try: 50

Platform breakdown:

• linux64: 24
• linux64-qr: 3
• macosx1014-64-shippable: 2
• macosx1014-64: 2
• macosx1014-64-devedition: 1
• windows10-64: 2
• windows10-64-qr: 2
• windows7-32: 2
• linux64-shippable: 2
• linux64-shippable-qr: 2
• linux64-devedition: 1
• windows7-32-devedition: 1
• windows7-32-shippable: 1
• windows10-64-devedition: 1
• windows10-64-shippable-qr: 2
• windows10-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563905&startday=2019-07-01&endday=2019-07-07&tree=all

Comment 5

[Matthew N. [:MattN]]

(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #3)

Back to bug 1541557, noticed the missing date now.

I don't know what this means but the cause is likely bug 1563325 .

Comment 6

[Matthew N. [:MattN]]

Attachment: Bug 1563905 - Enable eTLD+1 login lookup in test_basic_form_autocomplete_subdomain.html. r=sfoster

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/68862d6e2d22
Enable eTLD+1 login lookup in test_basic_form_autocomplete_subdomain.html. r=jaws

Comment 8

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/68862d6e2d22

Comment 9

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/releases/mozilla-beta/rev/e92c6b3eef13

Comment 10

[Cosmin Sabou [:CosminS]]

Verified in beta-sims: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cusercancel%2Crunnable&revision=77c16030b36ccdd0d575b9dcc644a88d5932875a&searchStr=linux%2Cx64%2Casan%2Cmochitests%2Ctest-linux64-asan%2Fopt-mochitest-e10s-10%2Cm%2810%29&selectedJob=255700112

Comment 11

[Intermittent Failures Robot]

5 failures in 4710 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-beta: 3

Platform breakdown:

• linux64: 4
• linux64-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1563905&startday=2019-07-08&endday=2019-07-14&tree=all