1608082 - Intermittent ccov TEST-UNEXPECTED-TIMEOUT | /webdriver/tests/delete_session/delete.py | expected OK

Status: RESOLVED WORKSFORME

(Testing :: geckodriver, defect, P5)

Comment 1

[Marco Castelluccio [:marco]]

How do I disable this test? I can't find the ini file that contains it.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

You have to create the file if it doesn't exist yet. Its file name should be testing/web-platform/meta/webdriver/tests/delete_session/delete.py.

But why do we have to disable it? Where do you see problems?

Comment 3

[Marco Castelluccio [:marco]]

Thanks!
It is timing out on the Linux coverage build: https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=ccov%2Cwd3&revision=e6427fac5ee8d1d87fb78e917781e85dda119a81&selectedJob=283728159.

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Oh, wow! Is this a perma failure? It is timing out due to bug 1382162, which I was never able to reproduce yet! So if I could use such a build for running the tests maybe I can figure out what's wrong here. So how do I built and run it locally via mach?

Comment 5

[Marco Castelluccio [:marco]]

(In reply to Henrik Skupin (:whimboo) [⌚️UTC+1] from comment #4)

Oh, wow! Is this a perma failure?

It looks like a perma failure, I've never seen a push in which it passed.

It is timing out due to bug 1382162, which I was never able to reproduce yet! So if I could use such a build for running the tests maybe I can figure out what's wrong here. So how do I built and run it locally via mach?

You can use the CI mozconfigs (trimming the parts you don't need): browser/config/mozconfigs/linux64/code-coverage and browser/config/mozconfigs/linux64/code-coverage-opt.
Also described in "Creating your own Coverage Build" from https://developer.mozilla.org/en-US/docs/Mozilla/Testing/Measuring_Code_Coverage_on_Firefox.

Comment 6

[Marco Castelluccio [:marco]]

Attachment: Bug 1608082 - Disable webdriver/tests/delete_session/delete.py as it is consistently timing out with the Linux coverage build. r=whimboo

Depends on D59415

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bfebf4a765f4
Disable webdriver/tests/delete_session/delete.py as it is consistently timing out with the Linux coverage build. r=whimboo

Comment 8

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/bfebf4a765f4

Comment 9

[Bogdan Tara[:bogdan_tara | bogdant]]

This also seems to perma fail on Windows 10 ccov:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=windows%2C10%2Cx64%2Cccov%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-windows10-64-ccov%2Fopt-web-platform-tests-wdspec-e10s-3%2Cw%28wd3%29&fromchange=7fa78b1baf59668cd160ff12190ed53bbb4fbe5b&tochange=1536cf66a302811c1e302118e0d356c6c7545fab&selectedJob=284600558

Comment 10

[Marco Castelluccio [:marco]]

I'll disable it on Windows too.

Comment 11

[Marco Castelluccio [:marco]]

Attachment: Bug 1608082 - Disable webdriver/tests/delete_session/delete.py as it is consistently timing out with the Windows coverage build. r=whimboo

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f5d00fc35ad6
Disable webdriver/tests/delete_session/delete.py as it is consistently timing out with the Windows coverage build. r=whimboo

Comment 13

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/f5d00fc35ad6

Comment 14

[Cosmin Sabou [:CosminS]]

webdriver/tests/permissions/set.py is also timing out since https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=windows%2C10%2Cx64%2Cccov%2Copt%2Cweb%2Cplatform%2Ctests%2Ctest-windows10-64-ccov%2Fopt-web-platform-tests-wdspec-e10s-3%2Cw%28wd3%29&revision=7fa78b1baf59668cd160ff12190ed53bbb4fbe5b maybe we should disable this one too.
Range: https://tinyurl.com/wwm7k9k
Marco, is that ok with you?

Comment 16

[Marco Castelluccio [:marco]]

Yes, we can disable that too (in bug 1495002).

Comment 17

[Intermittent Failures Robot]

7 failures in 3773 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7

Platform breakdown:

• windows10-64-ccov: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-01-13&endday=2020-01-19&tree=all

Comment 19

[Intermittent Failures Robot]

3 failures in 2984 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• windows10-64-ccov: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-08-31&endday=2020-09-06&tree=all

Comment 20

[Intermittent Failures Robot]

3 failures in 3410 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1
• mozilla-central: 2

Platform breakdown:

• windows10-64: 1
• windows10-64-ccov: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-09-07&endday=2020-09-13&tree=all

Comment 21

[Intermittent Failures Robot]

4 failures in 3760 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform breakdown:

• windows10-64-ccov: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-09-14&endday=2020-09-20&tree=all

Comment 22

[Intermittent Failures Robot]

1 failures in 4019 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-09-21&endday=2020-09-27&tree=all

Comment 23

[Intermittent Failures Robot]

4 failures in 3694 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform breakdown:

• windows10-64-ccov: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-10-12&endday=2020-10-18&tree=all

Comment 24

[Intermittent Failures Robot]

2 failures in 4230 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ccov: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-10-19&endday=2020-10-25&tree=all

Comment 25

[Intermittent Failures Robot]

4 failures in 4275 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 1

Platform breakdown:

• windows10-64-ccov: 2
• windows10-64-ccov-qr: 1
• windows7-32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-10-26&endday=2020-11-01&tree=all

Comment 26

[Intermittent Failures Robot]

2 failures in 4128 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ccov-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1608082&startday=2020-11-02&endday=2020-11-08&tree=all

Comment 27

[Intermittent Failures Robot]

2 failures in 4040 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ccov-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2020-11-09&endday=2020-11-15&tree=all

Comment 28

[Intermittent Failures Robot]

1 failures in 4810 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ccov-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2020-11-16&endday=2020-11-22&tree=all

Comment 29

[Intermittent Failures Robot]

2 failures in 3712 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ccov-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 30

[Intermittent Failures Robot]

2 failures in 3421 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ccov-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2020-12-14&endday=2020-12-20&tree=all

Comment 31

[Intermittent Failures Robot]

2 failures in 525 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform breakdown:

• windows10-64-ccov-qr: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2020-12-28&endday=2021-01-03&tree=all

Comment 32

[Intermittent Failures Robot]

1 failures in 2956 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ccov-qr: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-01-04&endday=2021-01-10&tree=all

Comment 33

[Intermittent Failures Robot]

3 failures in 3810 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• windows10-64-ccov-qr: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-01-11&endday=2021-01-17&tree=all

Comment 34

[Intermittent Failures Robot]

2 failures in 3488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• windows10-64-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-01-18&endday=2021-01-24&tree=all

Comment 35

[Intermittent Failures Robot]

3 failures in 3891 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• windows10-64-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-01-25&endday=2021-01-31&tree=all

Comment 36

[Intermittent Failures Robot]

4 failures in 3966 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 4

Platform and build breakdown:

• windows10-64-ccov-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-02-01&endday=2021-02-07&tree=all

Comment 37

[Intermittent Failures Robot]

3 failures in 4322 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• windows10-64-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-02-08&endday=2021-02-14&tree=all

Comment 38

[Intermittent Failures Robot]

1 failures in 3737 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-02-15&endday=2021-02-21&tree=all

Comment 39

[Intermittent Failures Robot]

3 failures in 4327 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• windows10-64-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-02-22&endday=2021-02-28&tree=all

Comment 40

[Intermittent Failures Robot]

1 failures in 3683 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-03-01&endday=2021-03-07&tree=all

Comment 41

[Intermittent Failures Robot]

1 failures in 4622 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-03-08&endday=2021-03-14&tree=all

Comment 42

[Intermittent Failures Robot]

2 failures in 4257 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• windows10-64-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-03-15&endday=2021-03-21&tree=all

Comment 43

[Intermittent Failures Robot]

3 failures in 3967 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• windows10-64-ccov-qr: 2
  • opt: 2
• windows10-64-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-03-22&endday=2021-03-28&tree=all

Comment 44

[Intermittent Failures Robot]

2 failures in 3125 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2

Platform and build breakdown:

• windows10-64-ccov-qr: 2
  • opt: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-03-29&endday=2021-04-04&tree=all

Comment 45

[Intermittent Failures Robot]

3 failures in 4255 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform and build breakdown:

• windows10-64-ccov-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-04-12&endday=2021-04-18&tree=all

Comment 46

[Intermittent Failures Robot]

1 failures in 3224 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform and build breakdown:

• windows10-64-ccov-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1608082&startday=2021-04-19&endday=2021-04-25&tree=all

Comment 47

[Henrik Skupin [:whimboo][⌚️UTC+1]]

At some point the meta data for ccov got removed but I cannot find the exact changeset for it. Given that the tests are running fine these days lets close this bug.