1478218 - Intermittent browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item when filtering by lastVisitDate - Got undefined, expected [object Object]

Status: RESOLVED FIXED

(Firefox :: New Tab Page, defect, P1)

Description

[Treeherder Bug Filer]

Filed by: btara [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=189942554&repo=autoland

https://queue.taskcluster.net/v1/task/SU0yVScXQ3W6NnKEyQBrSQ/runs/0/artifacts/public/logs/live_backing.log

00:54:43     INFO -  62 INFO Entering test bound checkFrecentSites
00:54:43     INFO -  63 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by host in topFrecentSites -
00:54:43     INFO -  64 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should not select incorrect item by host in topFrecentSites -
00:54:43     INFO -  65 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item when filtering by frecency -
00:54:43     INFO -  66 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should not select incorrect item when filtering by frecency -
00:54:43     INFO -  Buffered messages finished
00:54:43    ERROR -  67 INFO TEST-UNEXPECTED-FAIL | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item when filtering by lastVisitDate - Got undefined, expected [object Object]
00:54:43     INFO -  Stack trace:
00:54:43     INFO -  chrome://mochikit/content/browser-test.js:test_is:1306
00:54:43     INFO -  chrome://mochitests/content/browser/browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js:checkFrecentSites:219
00:54:43     INFO -  chrome://mochikit/content/browser-test.js:Tester_execTest/<:1104
00:54:43     INFO -  chrome://mochikit/content/browser-test.js:Tester_execTest:1095
00:54:43     INFO -  chrome://mochikit/content/browser-test.js:nextTest/<:992
00:54:43     INFO -  chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
00:54:43     INFO -  68 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should not select incorrect item when filtering by lastVisitDate -
00:54:43     INFO -  69 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item when filtering by frecency and lastVisitDate with multiple candidate domains -
00:54:43     INFO -  70 INFO Leaving test bound checkFrecentSites
00:54:43     INFO -  GECKO(6604) | MEMORY STAT | vsize 1769MB | vsizeMaxContiguous 132261873MB | residentFast 285MB | heapAllocated 119MB
00:54:43     INFO -  71 INFO TEST-OK | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | took 645ms
00:54:43     INFO -  GECKO(6604) | ++DOCSHELL 000002912D449800 == 1 [pid = 1464] [id = {73cf6f97-1162-42ca-acd8-900d3a2da4e3}]
00:54:43     INFO -  GECKO(6604) | ++DOMWINDOW == 1 (000002912D415200) [pid = 1464] [serial = 1] [outer = 0000000000000000]
00:54:43     INFO -  72 INFO checking window state
00:54:43     INFO -  GECKO(6604) | ++DOMWINDOW == 18 (000001D4E7983C00) [pid = 6604] [serial = 18] [outer = 000001D4ECE5FE00]
00:54:43     INFO -  GECKO(6604) | ++DOMWINDOW == 19 (000001D4E7984C00) [pid = 6604] [serial = 19] [outer = 000001D4ECE5FE00]
00:54:43     INFO -  GECKO(6604) | ++DOMWINDOW == 2 (00000291325F4000) [pid = 1464] [serial = 2] [outer = 000002912D415200]
00:54:43     INFO -  GECKO(6604) | --DOCSHELL 0000026D85549000 == 0 [pid = 5804] [id = {f90db29b-0b3f-4058-877a-ce11f2a94d90}]
00:54:43     INFO -  GECKO(6604) | --DOCSHELL 000001F0308C0000 == 1 [pid = 5684] [id = {fe424eac-2a87-4967-b3b1-2b4a85bbe6c2}]
00:54:43     INFO -  GECKO(6604) | --DOCSHELL 000001F028D48000 == 0 [pid = 5684] [id = {460fdbae-13a1-4a79-a92e-8682d03de1fd}]
00:54:43     INFO -  GECKO(6604) | --DOMWINDOW == 4 (000001F030409C00) [pid = 5684] [serial = 2] [outer = 0000000000000000] [url = about:blank]
00:54:43     INFO -  GECKO(6604) | --DOMWINDOW == 2 (0000027D0B40E400) [pid = 816] [serial = 2] [outer = 0000000000000000] [url = about:blank]
00:54:43     INFO -  GECKO(6604) | --DOCSHELL 000001F3BFA48800 == 1 [pid = 5068] [id = {0c77a908-b323-4ee6-90fa-afe29d610161}]
00:54:43     INFO -  GECKO(6604) | --DOCSHELL 000001F3BFA4A000 == 0 [pid = 5068] [id = {0001c2ef-0462-40c1-a98d-4af386d1c239}]
00:54:43     INFO -  GECKO(6604) | --DOMWINDOW == 6 (000001F3C73DA800) [pid = 5068] [serial = 6] [outer = 0000000000000000] [url = about:blank]
00:54:43     INFO -  GECKO(6604) | --DOMWINDOW == 5 (000001F3C7110800) [pid = 5068] [serial = 2] [outer = 0000000000000000] [url = about:blank]
00:54:44     INFO -  GECKO(6604) | --DOCSHELL 000001D4ECD30000 == 6 [pid = 6604] [id = {1c952a4b-60f7-4817-9431-f2cf28adef18}]
00:54:44     INFO -  GECKO(6604) | --DOCSHELL 000001D4E8542000 == 5 [pid = 6604] [id = {fb13d22e-b5f3-429f-895f-6620eb9a7565}]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 1 (0000026D85514800) [pid = 5804] [serial = 1] [outer = 0000000000000000] [url = about:blank]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 0 (0000026D8CB0C800) [pid = 5804] [serial = 2] [outer = 0000000000000000] [url = about:blank]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 3 (000001F030867000) [pid = 5684] [serial = 4] [outer = 0000000000000000] [url = about:blank]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 2 (000001F0308EEC00) [pid = 5684] [serial = 5] [outer = 0000000000000000] [url = about:blank]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 1 (000001F0304C9400) [pid = 5684] [serial = 3] [outer = 0000000000000000] [url = chrome://gfxsanity/content/sanitytest.html]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 0 (000001F028D14800) [pid = 5684] [serial = 1] [outer = 0000000000000000] [url = chrome://gfxsanity/content/sanitytest.html]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 4 (000001F3C71DDC00) [pid = 5068] [serial = 4] [outer = 0000000000000000] [url = about:blank]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 3 (000001F3C71D5400) [pid = 5068] [serial = 3] [outer = 0000000000000000] [url = about:blank]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 2 (000001F3C71FCC00) [pid = 5068] [serial = 5] [outer = 0000000000000000] [url = about:newtab]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 1 (000001F3BFA14800) [pid = 5068] [serial = 1] [outer = 0000000000000000] [url = about:blank]
00:54:44     INFO -  GECKO(6604) | --DOMWINDOW == 0 (000001F3C73DF000) [pid = 5068] [serial = 7] [outer = 0000000000000000] [url = about:newtab]
00:54:45     INFO -  GECKO(6604) | --DOMWINDOW == 18 (000001D4EE746000) [pid = 6604] [serial = 11] [outer = 0000000000000000] [url = about:blank]
00:54:45     INFO -  GECKO(6604) | --DOMWINDOW == 17 (000001D4E850F800) [pid = 6604] [serial = 4] [outer = 0000000000000000] [url = about:blank]
00:54:45     INFO -  GECKO(6604) | --DOMWINDOW == 16 (000001D4EE9AF000) [pid = 6604] [serial = 13] [outer = 0000000000000000] [url = about:blank]
00:54:45     INFO -  GECKO(6604) | --DOMWINDOW == 15 (000001D4EE9AFC00) [pid = 6604] [serial = 14] [outer = 0000000000000000] [url = about:blank]
00:54:45     INFO -  GECKO(6604) | --DOMWINDOW == 14 (000001D4EE259400) [pid = 6604] [serial = 10] [outer = 0000000000000000] [url = about:blank]
00:54:45     INFO -  GECKO(6604) | --DOMWINDOW == 13 (000001D4ECE60000) [pid = 6604] [serial = 9] [outer = 0000000000000000] [url = about:blank]
00:54:45     INFO -  GECKO(6604) | --DOMWINDOW == 12 (000001D4E7983C00) [pid = 6604] [serial = 18] [outer = 0000000000000000] [url = about:blank]
00:54:45     INFO -  73 INFO Console message: [JavaScript Warning: "Use of nsIFile in content process is deprecated." {file: "resource://gre/modules/FileUtils.jsm" line: 170}]

Comment 1

[Ed Lee :Mardak]

Sheriff was about to back out the export, but looks like it'll stay and this bug was filed. This is a Test Verify failure, so it only gets run when the test file changes

Looks like this was touched in 2 commits:

https://github.com/mozilla/activity-stream/commit/eb70e0f02189de0b64c2682c57b28082e6943716
https://github.com/mozilla/activity-stream/commit/22d315956f4d912b90a13b62f682d7a925ee42de

Comment 2

[Kate Hudson :k88hudson]

Looks like some cleanup of the places db needs to be added to the tests to prevent failures here, adam's going to work on a fix

Comment 3

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/activity-stream/pull/4262

Comment 4

[[github robot]]

Commit pushed to master at https://github.com/mozilla/activity-stream

https://github.com/mozilla/activity-stream/commit/42106b2951694f7ef14f5ab79142f47838eb39b2
Fix Bug 1478218: add Places cleanup to browser_asrouter_targeting.js (#4262)

Comment 5

[Intermittent Failures Robot]

16 failures in 138 pushes (0.116 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-central: 15
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 4
* windows10-64: 3
* linux64: 3
* windows7-32-msvc: 2
* windows10-64-msvc: 2
* osx-10-10: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1478218&startday=2018-07-25&endday=2018-07-25&tree=trunk

Comment 6

[Raul Gurzau (:RaulG)]

https://treeherder.mozilla.org/logviewer.html#?job_id=190414046&repo=autoland&lineNumber=5578

23:42:30     INFO -  5 INFO TEST-START | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js
23:42:30     INFO -  GECKO(4528) | 1532648550808	addons.xpi	WARN	Addon with ID [e-mail] already installed, older version will be disabled
23:42:30     INFO -  TEST-INFO | started process screenshot
23:42:31     INFO -  TEST-INFO | screenshot: exit 0
23:42:31     INFO -  Buffered messages logged at 23:42:30
23:42:31     INFO -  6 INFO Entering test bound should_do_correct_targeting
23:42:31     INFO -  7 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should return true for a matching value -
23:42:31     INFO -  8 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should return false for a non-matching value -
23:42:31     INFO -  9 INFO Leaving test bound should_do_correct_targeting
23:42:31     INFO -  10 INFO Entering test bound should_handle_async_getters
23:42:31     INFO -  11 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should return true for a matching async value -
23:42:31     INFO -  12 INFO Leaving test bound should_handle_async_getters
23:42:31     INFO -  13 INFO Entering test bound find_matching_message
23:42:31     INFO -  14 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should match and return the correct message -
23:42:31     INFO -  15 INFO Leaving test bound find_matching_message
23:42:31     INFO -  16 INFO Entering test bound return_nothing_for_no_matching_message
23:42:31     INFO -  17 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should return nothing since no matching message exists -
23:42:31     INFO -  18 INFO Leaving test bound return_nothing_for_no_matching_message
23:42:31     INFO -  19 INFO Entering test bound checkProfileAgeCreated
23:42:31     INFO -  20 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should return correct profile age creation date -
23:42:31     INFO -  21 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by profile age created -
23:42:31     INFO -  22 INFO Leaving test bound checkProfileAgeCreated
23:42:31     INFO -  23 INFO Entering test bound checkProfileAgeReset
23:42:31     INFO -  24 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should return correct profile age reset -
23:42:31     INFO -  25 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by profile age reset -
23:42:31     INFO -  26 INFO Leaving test bound checkProfileAgeReset
23:42:31     INFO -  27 INFO Entering test bound checkhasFxAccount
23:42:31     INFO -  28 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should return true if a fx account is set -
23:42:31     INFO -  29 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by hasFxAccount -
23:42:31     INFO -  30 INFO Leaving test bound checkhasFxAccount
23:42:31     INFO -  31 INFO Entering test bound checksearchEngines
23:42:31     INFO -  32 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | searchEngines.installed should be a non-empty array -
23:42:31     INFO -  33 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | searchEngines.installed should be an array of visible search engines -
23:42:31     INFO -  34 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | searchEngines.current should be a truthy string -
23:42:31     INFO -  35 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | searchEngines.current should be the current engine name -
23:42:31     INFO -  36 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by searchEngines.current -
23:42:31     INFO -  37 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by searchEngines.installed -
23:42:31     INFO -  38 INFO Leaving test bound checksearchEngines
23:42:31     INFO -  39 INFO Entering test bound checkisDefaultBrowser
23:42:31     INFO -  40 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | isDefaultBrowser should be a boolean value -
23:42:31     INFO -  41 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | isDefaultBrowser should be equal to ShellService.isDefaultBrowser() -
23:42:31     INFO -  42 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by isDefaultBrowser -
23:42:31     INFO -  43 INFO Leaving test bound checkisDefaultBrowser
23:42:31     INFO -  44 INFO Entering test bound checkdevToolsOpenedCount
23:42:31     INFO -  45 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | devToolsOpenedCount should be equal to devtools.selfxss.count pref value -
23:42:31     INFO -  46 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by devToolsOpenedCount -
23:42:31     INFO -  47 INFO Leaving test bound checkdevToolsOpenedCount
23:42:31     INFO -  48 INFO Entering test bound checkAddonsInfo
23:42:31     INFO -  49 INFO Console message: [JavaScript Warning: "Use of nsIFile in content process is deprecated." {file: "resource://gre/modules/FileUtils.jsm" line: 170}]
23:42:31     INFO -  50 INFO Console message: 1532648550808	addons.xpi	WARN	Addon with ID [e-mail] already installed, older version will be disabled
23:42:31     INFO -  51 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should contain every addon -
23:42:31     INFO -  52 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should contain no incorrect addons -
23:42:31     INFO -  53 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should correctly provide `version` property -
23:42:31     INFO -  54 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should correctly provide `type` property -
23:42:31     INFO -  55 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should correctly provide `isSystem` property -
23:42:31     INFO -  56 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should correctly provide `isWebExtension` property -
23:42:31     INFO -  57 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should receive full data -
23:42:31     INFO -  58 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should correctly provide `name` property from full data -
23:42:31     INFO -  59 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should correctly provide `userDisabled` property from full data -
23:42:31     INFO -  60 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should correctly provide `installDate` property from full data -
23:42:31     INFO -  61 INFO Leaving test bound checkAddonsInfo
23:42:31     INFO -  62 INFO Entering test bound checkFrecentSites
23:42:31     INFO -  63 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item by host in topFrecentSites -
23:42:31     INFO -  64 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should not select incorrect item by host in topFrecentSites -
23:42:31     INFO -  65 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item when filtering by frecency -
23:42:31     INFO -  66 INFO TEST-PASS | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should not select incorrect item when filtering by frecency -
23:42:31     INFO -  Buffered messages finished
23:42:31    ERROR -  67 INFO TEST-UNEXPECTED-FAIL | browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js | should select correct item when filtering by lastVisitDate - Got undefined, expected [object Object]
23:42:31     INFO -  Stack trace:
23:42:31     INFO -  chrome://mochikit/content/browser-test.js:test_is:1305
23:42:31     INFO -  chrome://mochitests/content/browser/browser/extensions/activity-stream/test/functional/mochitest/browser_asrouter_targeting.js:checkFrecentSites:219
23:42:31     INFO -  chrome://mochikit/content/browser-test.js:Tester_execTest/<:1103
23:42:31     INFO -  chrome://mochikit/content/browser-test.js:Tester_execTest:1094
23:42:31     INFO -  chrome://mochikit/content/browser-test.js:nextTest/<:991
23:42:31     INFO -  chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795

Comment 7

[Ed Lee :Mardak]

This will be fixed by the next export bug 1478870.

Comment 8

[Intermittent Failures Robot]

21 failures in 134 pushes (0.157 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-central: 14
* mozilla-inbound: 7

Platform breakdown:
* windows7-32: 6
* windows10-64: 6
* linux64: 3
* windows7-32-msvc: 2
* windows10-64-msvc: 2
* osx-10-10: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1478218&startday=2018-07-27&endday=2018-07-27&tree=trunk

Comment 9

[Ed Lee :Mardak]

https://hg.mozilla.org/mozilla-central/rev/01ee10ce0d71

Comment 11

[Intermittent Failures Robot]

60 failures in 760 pushes (0.079 failures/push) were associated with this bug in the last 7 days. 

This is the #28 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-central: 30
* autoland: 22
* mozilla-inbound: 8

Platform breakdown:
* windows7-32: 15
* windows10-64: 14
* linux64: 14
* osx-10-10: 9
* windows7-32-msvc: 4
* windows10-64-msvc: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1478218&startday=2018-07-23&endday=2018-07-29&tree=trunk

Comment 12

[meck93]

We are trying to build a tool to automatically classify intermittent failures, which would provide a starting point for fixing the bug, reducing the manual work for the developers.
We are collecting some feedback on the results, to see if they’re good enough and where we need to improve.
    
For this bug, the tool says that the intermittent failure is most likely a:
Concurrency Issue: This includes tests in which failures occur due to thread management issues (different threads or their outcomes depending on an implicit ordering), race conditions and/or deadlocks, and issues related to an asynchronous waits (e.g. a process trying to access an external resource or continuing before the external resource is available).


Once you’re done investigating and/or fixing the bug, could you tell me:
- Did the tool correctly recognize the type of intermittent failure?
- Did the information from the tool help your analysis, the bug fixing process, or anything in the process? (please also let us know how the tool was useful and/or what would improve the tool's usefulness for you)

Comment 13

[Adam Hillier :ahillier]

(In reply to meck93 from comment #12)
> We are trying to build a tool to automatically classify intermittent
> failures, which would provide a starting point for fixing the bug, reducing
> the manual work for the developers.
> We are collecting some feedback on the results, to see if they’re good
> enough and where we need to improve.
>     
> For this bug, the tool says that the intermittent failure is most likely a:
> Concurrency Issue: This includes tests in which failures occur due to thread
> management issues (different threads or their outcomes depending on an
> implicit ordering), race conditions and/or deadlocks, and issues related to
> an asynchronous waits (e.g. a process trying to access an external resource
> or continuing before the external resource is available).
> 
> 
> Once you’re done investigating and/or fixing the bug, could you tell me:
> - Did the tool correctly recognize the type of intermittent failure?
> - Did the information from the tool help your analysis, the bug fixing
> process, or anything in the process? (please also let us know how the tool
> was useful and/or what would improve the tool's usefulness for you)

The failure was a problem with tests not getting cleaned up properly, so I
guess not a concurrency issue. The problem was already fixed so I can't comment
on the usefulness.

Comment 14

[meck93]

[:ahillier]: Thanks for the feedback that's good to know. Sorry, about the wrong message regarding the usefulness. We have both fixed and not-yet-fixed intermittent-failures in the test data set for which we ran the predictions (this bug must have mistakenly landed in the wrong data set).