1628308 - Permafailing damp failure damp | webconsole/complicated.js: Test timed out when Gecko 77 merges to Beta on 2020-05-04

Status: VERIFIED FIXED

(DevTools :: Console, defect)

Description

[Natalia Csoregi [:nataliaCs]]

Central as Beta:
https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=ab5de001a168243326acca3420f5667acad93d26&searchStr=damp&selectedJob=296793606

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=296793606&repo=try&lineNumber=1579

[task 2020-04-08T12:42:53.783Z] 12:42:53 INFO - PID 3703 | TEST-UNEXPECTED-FAIL | damp | webconsole/complicated.js: Test timed out
[task 2020-04-08T12:42:53.839Z] 12:42:53 INFO - Terminating psutil.Process(pid=3703, name='firefox-bin', started='12:37:32')
[task 2020-04-08T12:42:53.846Z] 12:42:53 INFO - PID 3703 | Exiting due to channel error.
[task 2020-04-08T12:42:53.846Z] 12:42:53 INFO - PID 3703 | Exiting due to channel error.
[task 2020-04-08T12:42:53.848Z] 12:42:53 INFO - PID 3703 | Exiting due to channel error.
[task 2020-04-08T12:42:53.849Z] 12:42:53 INFO - mozcrash checking /tmp/tmpa9lMa2/profile/minidumps for minidumps...
[task 2020-04-08T12:42:53.849Z] 12:42:53 INFO - PID 3703 | Exiting due to channel error.
[task 2020-04-08T12:42:53.869Z] 12:42:53 INFO - TEST-UNEXPECTED-ERROR | damp | unexpected error
[task 2020-04-08T12:42:53.870Z] 12:42:53 ERROR - Traceback (most recent call last):
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - File "/home/cltbld/tasks/task_1586346044/build/tests/talos/talos/run_tests.py", line 306, in run_tests
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - talos_results.add(mytest.runTest(browser_config, test))
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - File "/home/cltbld/tasks/task_1586346044/build/tests/talos/talos/ttest.py", line 64, in runTest
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - return self._runTest(browser_config, test_config, setup)
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - File "/home/cltbld/tasks/task_1586346044/build/tests/talos/talos/ttest.py", line 216, in _runTest
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - debugger_args=browser_config['debugger_args']
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - File "/home/cltbld/tasks/task_1586346044/build/tests/talos/talos/talos_process.py", line 173, in run_browser
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - raise TalosError("unexpected error")
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - TalosError: unexpected error
[task 2020-04-08T12:42:53.870Z] 12:42:53 INFO - TEST-INFO took 321840ms

Comment 1

[Nicolas Chevobbe [:nchevobbe]]

Looks like we don't get the same messages as we expected on Nightly:

[TEST_LOG] Console output changed - checking content:
[TEST_LOG] Still waiting for the following messages:
Some cookies are misusing the “sameSite“ attribute, so it won’t work as expected (✕1)
InvalidStateError: XMLHttpRequest state must be OPENED. (✕1)
SyntaxError: missing ) after argument list (✕2)
ReferenceError: Bootloaddisableder is not defined (✕4)

I can explain the sameSite one, since I think it's an "info" log that is only emitted on Nightly.
For the other ones, that's a bit weird.
Is there a way to easily simulate a beta locally? It would be easier for me to investigate this.

Comment 2

[Natalia Csoregi [:nataliaCs]]

You can follow the steps in the Trunk as Early Beta section:
https://wiki.mozilla.org/Sheriffing/How_To/Beta_simulations#TRUNK_AS_EARLY_BETA

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

The differences to central are

[task 2020-04-07T16:46:42.793Z] 16:46:42     INFO -  PID 3549 | This page uses the non standard property “zoom” (✕3)
[task 2020-04-07T16:46:42.793Z] 16:46:42     INFO -  PID 3549 | Layout was forced before the page was fully loaded. (✕1)

Comment 4

[Intermittent Failures Robot]

1 failures in 4823 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1628308&startday=2020-04-06&endday=2020-04-12&tree=all

Comment 5

[Nicolas Chevobbe [:nchevobbe]]

I don't know what I'm doing wrong, but when I try to do a beta simulation, the damp tests are crashing https://treeherder.mozilla.org/#/jobs?repo=try&revision=19c7c4ee864719739c5d4ca94bc66bf772b6c2d1&selectedJob=297690486 ( I did follow https://wiki.mozilla.org/Sheriffing/How_To/Beta_simulations#TRUNK_AS_EARLY_BETA)

Comment 6

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Please Try with a normal instead of an artifact build.

Comment 7

[Nicolas Chevobbe [:nchevobbe]]

(In reply to Sebastian Hengst [:aryx] (needinfo on intermittent or backout) from comment #6)

Please Try with a normal instead of an artifact build.

duh, I always forget about this.
TRY looks happy so far https://treeherder.mozilla.org/#/jobs?repo=try&revision=9b0a35ebef8257f1907298992203d9ea5e48f34a , I'll put my patch up for review

Comment 8

[Nicolas Chevobbe [:nchevobbe]]

Attachment: Bug 1628308 - Fix console complicated test for non-nightly builds. r=jdescottes.

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/2e4325292ad4
Fix console complicated test  for non-nightly builds. r=jdescottes,perftest-reviewers,sparky.

Comment 10

[Cristian Brindusan [:cbrindusan]]

https://hg.mozilla.org/mozilla-central/rev/2e4325292ad4

Comment 11

[Andreea Pavel [:apavel]]

Verified fixed in latest beta sims: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=3711c89b5c7572131c8c5e3fda43e32c8cb84d6d