1579975 - Perma Fission Tier 2 test_ext_cookies.html | fail-if condition in manifest - We expected at least one failure

Status: RESOLVED FIXED

(Core :: DOM: Navigation, defect)

Description

[Raul Gurzau (:RaulG)]

Bug 1542415 got merged and started to fail on m-c:

https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&selectedJob=265736975&resultStatus=testfailed%2Cbusted%2Cexception&searchStr=m-fis%2C%285%29

Bug 1542415 seems to be the culprit:

https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=m-fis%285%29&tochange=b5ef2b8f7c2b739502c441a776e3266b53d10f5d&fromchange=edaf6d0b4d0432d61f8cfdbacbb80d532b8374a3&selectedJob=265761872

Log link: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=265736975&repo=mozilla-central&lineNumber=5170

Log snippet:

[task 2019-09-09T16:32:23.717Z] 16:32:23 INFO - TEST-FAIL | toolkit/components/extensions/test/mochitest/test_ext_cookies.html | deleted the private cookie - Expected: null, Actual: null
[task 2019-09-09T16:32:23.717Z] 16:32:23 INFO - TEST-FAIL | toolkit/components/extensions/test/mochitest/test_ext_cookies.html | executeScript returns one result - Expected: 1, Actual: 1
[task 2019-09-09T16:32:23.718Z] 16:32:23 INFO - TEST-FAIL | toolkit/components/extensions/test/mochitest/test_ext_cookies.html | private document.cookie should be removed - Expected: , Actual:
[task 2019-09-09T16:32:23.718Z] 16:32:23 INFO - TEST-FAIL | toolkit/components/extensions/test/mochitest/test_ext_cookies.html | cookies
[task 2019-09-09T16:32:23.718Z] 16:32:23 INFO - TEST-FAIL | toolkit/components/extensions/test/mochitest/test_ext_cookies.html | test result correct
[task 2019-09-09T16:32:23.719Z] 16:32:23 INFO - add_task | Leaving test test_cookies
[task 2019-09-09T16:32:23.719Z] 16:32:23 INFO - Buffered messages finished
[task 2019-09-09T16:32:23.719Z] 16:32:23 INFO - TEST-UNEXPECTED-PASS | toolkit/components/extensions/test/mochitest/test_ext_cookies.html | fail-if condition in manifest - We expected at least one failure
[task 2019-09-09T16:32:23.720Z] 16:32:23 INFO - TEST-INFO | expected FAIL
[task 2019-09-09T16:32:23.720Z] 16:32:23 INFO - GECKO(5252) | MEMORY STAT | vsize 2498MB | residentFast 136MB | heapAllocated 15MB
[task 2019-09-09T16:32:23.720Z] 16:32:23 INFO - TEST-OK | toolkit/components/extensions/test/mochitest/test_ext_cookies.html | took 1630ms

Comment 1

[Intermittent Failures Robot]

16 failures in 844 pushes (0.019 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 4
• mozilla-central: 12

Platform breakdown:

• linux64: 6
• windows10-64: 2
• windows10-64-qr: 2
• linux64-shippable-qr: 1
• linux64-qr: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1579975&startday=2019-09-09&endday=2019-09-09&tree=all

Comment 3

[Alexandru Michis [:malexandru]]

Attachment: Bug 1579975 - Removed expectation for test_ext_cookies.html r=#intermittent-reviewers

Comment 4

[Alexandru Michis [:malexandru]]

Fixed by: https://hg.mozilla.org/integration/autoland/rev/dd9684586ba3#l8.12

Comment 5

[Intermittent Failures Robot]

23 failures in 4637 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 19
• autoland: 4

Platform breakdown:

• linux64: 9
• linux64-qr: 7
• windows10-64: 3
• windows10-64-qr: 3
• linux64-shippable-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1579975&startday=2019-09-09&endday=2019-09-15&tree=all

Comment 6

[Chris Peterson [:cpeterson]]

Retroactively moving fixed bugs whose summaries mention "Fission" (or other Fission-related keywords) but are not assigned to a Fission Milestone to an appropriate Fission Milestone.

This will generate a lot of bugmail, so you can filter your bugmail for the following UUID and delete them en masse:

0ee3c76a-bc79-4eb2-8d12-05dc0b68e732