Intermittent test_execute_script.py TestExecuteChrome.test_async_script_timeout | AssertionError: ScriptTimeoutException not raised

RESOLVED FIXED in Firefox 59

Status

Testing
Marionette
P5
normal
RESOLVED FIXED
11 months ago
3 months ago

People

(Reporter: Treeherder Bug Filer, Assigned: ato)

Tracking

(Depends on: 1 bug, {intermittent-failure})

unspecified
mozilla60
All
Windows
intermittent-failure
Points:
---

Firefox Tracking Flags

(firefox56 wontfix, firefox57 wontfix, firefox58 wontfix, firefox59 fixed, firefox60 fixed)

Details

MozReview Requests

Submitter Diff Changes Open Issues Last Updated
Loading...
Error loading review requests:

Attachments

(1 attachment)

Comment 1

11 months ago
2 failures in 892 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 2

Platform breakdown:
* windows7-32-vm: 1
* windows10-64-vm: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-06-19&endday=2017-06-25&tree=all

Comment 2

11 months ago
4 failures in 718 pushes (0.006 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 2
* mozilla-inbound: 1
* mozilla-central: 1

Platform breakdown:
* windows7-32-vm: 3
* windows10-64-vm: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-06-26&endday=2017-07-02&tree=all

Comment 3

11 months ago
1 failures in 656 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows7-32-vm: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-07-03&endday=2017-07-09&tree=all

Updated

10 months ago
Component: Headless → Marionette
Product: Firefox → Testing

Comment 4

10 months ago
Last failure was non-headless.
22:07:12     INFO -  1499465232714	Marionette	TRACE	554 -> [0,11,"executeAsyncScript",{"scriptTimeout":100,"sandbox":"default","debug_script":false,"script":"\n                var cb = arguments[arguments.length - 1];\n                setTimeout(function() { cb() }, 250);\n                ","newSandbox":true,"line":401,"args":[],"filename":"test_execute_script.py"}]
22:07:13     INFO -  1499465233063	Marionette	TRACE	554 <- [1,11,null,{"value":null}]

Interestingly the execution of the command takes around 350ms, so the timeout was never taken into account here, or the timer got delayed due to a system slowdown maybe?

Even not sure what `cb` actually is in this case because we don't pass any arguments into the call to `execute_async_script`, and in JS we access it via `arguments[arguments.length - 1]`. So after 250ms we try to call `undefined`? What stops us from even using a higher timeout value than 250 here?
status-firefox56: --- → affected
Flags: needinfo?(ato)
OS: Unspecified → Windows
Hardware: Unspecified → All

Comment 6

10 months ago
1 failures in 720 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows7-32-vm: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-07-10&endday=2017-07-16&tree=all
(Assignee)

Comment 7

10 months ago
(In reply to Henrik Skupin (:whimboo) [away 07/21 - 07/31] from
comment #5)

> Even not sure what `cb` actually is in this case because we don't
> pass any arguments into the call to `execute_async_script`, and in
> JS we access it via `arguments[arguments.length - 1]`. So after
> 250ms we try to call `undefined`? What stops us from even using a
> higher timeout value than 250 here?

The last argument to the WebDriver:ExecuteAsyncScript command (as it
is now known) is always the callback to stop script evaluation and
return control to the user.  When arguments[arguments.length - 1]
(or cb) is called after 250, the script returns.

This script is supposed to cause a timeout error because the
scriptTimeout parameter is 100 ms.
Flags: needinfo?(ato)

Comment 8

10 months ago
3 failures in 822 pushes (0.004 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 2
* try: 1

Platform breakdown:
* windows7-32: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 9

10 months ago
3 failures in 1008 pushes (0.003 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 2
* autoland: 1

Platform breakdown:
* windows7-32: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-07-24&endday=2017-07-30&tree=all

Comment 10

10 months ago
2 failures in 888 pushes (0.002 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 2

Platform breakdown:
* windows10-64: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-07-31&endday=2017-08-06&tree=all

Updated

10 months ago
status-firefox57: --- → affected
Depends on: 1386590

Comment 11

9 months ago
1 failures in 901 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-08-07&endday=2017-08-13&tree=all

Comment 12

9 months ago
1 failures in 949 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* autoland: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-08-14&endday=2017-08-20&tree=all

Comment 13

9 months ago
1 failures in 908 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-08-21&endday=2017-08-27&tree=all

Comment 14

9 months ago
1 failures in 924 pushes (0.001 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows7-32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-09-04&endday=2017-09-10&tree=all

Comment 15

8 months ago
2 failures in 1032 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* windows7-32: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-09-11&endday=2017-09-17&tree=all

Comment 16

8 months ago
9 failures in 943 pushes (0.01 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 5
* mozilla-central: 2
* autoland: 2

Platform breakdown:
* windows10-64: 9

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-09-18&endday=2017-09-24&tree=all

Comment 17

8 months ago
6 failures in 885 pushes (0.007 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2
* try: 1
* mozilla-inbound: 1
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* windows10-64: 6

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-09-25&endday=2017-10-01&tree=all

Comment 18

8 months ago
4 failures in 824 pushes (0.005 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 2
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* windows10-64: 3
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-10-02&endday=2017-10-08&tree=all

Comment 19

7 months ago
8 failures in 947 pushes (0.008 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* autoland: 2
* try: 1
* mozilla-central: 1
* mozilla-beta: 1

Platform breakdown:
* windows10-64: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-10-09&endday=2017-10-15&tree=all

Comment 20

7 months ago
8 failures in 864 pushes (0.009 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 3
* try: 2
* mozilla-inbound: 2
* mozilla-central: 1

Platform breakdown:
* windows10-64: 8

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-10-16&endday=2017-10-22&tree=all

Comment 21

7 months ago
3 failures in 912 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 2
* autoland: 1

Platform breakdown:
* windows10-64: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-10-23&endday=2017-10-29&tree=all

Comment 22

7 months ago
3 failures in 857 pushes (0.004 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1
* mozilla-beta: 1
* autoland: 1

Platform breakdown:
* windows10-64: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-10-30&endday=2017-11-05&tree=all

Comment 23

6 months ago
4 failures in 849 pushes (0.005 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 2
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* windows7-32: 2
* windows10-64: 1
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-11-06&endday=2017-11-12&tree=all

Comment 24

6 months ago
2 failures in 762 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2

Platform breakdown:
* windows10-64: 1
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-11-13&endday=2017-11-19&tree=all

Comment 25

6 months ago
5 failures in 744 pushes (0.007 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 4
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 4
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-11-20&endday=2017-11-26&tree=all

Comment 26

6 months ago
9 failures in 792 pushes (0.011 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 3
* mozilla-central: 3
* try: 1
* mozilla-beta: 1
* autoland: 1

Platform breakdown:
* windows10-64: 6
* windows7-32: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-11-27&endday=2017-12-03&tree=all

Comment 27

6 months ago
5 failures in 889 pushes (0.006 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 2
* autoland: 2
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 3
* windows7-32: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-12-04&endday=2017-12-10&tree=all

Comment 28

5 months ago
2 failures in 423 pushes (0.005 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* osx-10-10: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-12-11&endday=2017-12-17&tree=all

Comment 29

5 months ago
3 failures in 590 pushes (0.005 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1
* mozilla-beta: 1
* autoland: 1

Platform breakdown:
* osx-10-10: 2
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-12-18&endday=2017-12-24&tree=all

Comment 30

5 months ago
1 failures in 147 pushes (0.007 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2017-12-25&endday=2017-12-31&tree=all

Comment 31

5 months ago
1 failures in 462 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2018-01-01&endday=2018-01-07&tree=all

Comment 32

4 months ago
1 failures in 788 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2018-01-08&endday=2018-01-14&tree=all

Comment 33

4 months ago
3 failures in 701 pushes (0.004 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2018-01-22&endday=2018-01-28&tree=all

Comment 34

4 months ago
3 failures in 735 pushes (0.004 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 2
* mozilla-inbound: 1

Platform breakdown:
* osx-10-10: 3

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2018-01-29&endday=2018-02-04&tree=all
(Assignee)

Updated

4 months ago
Assignee: nobody → ato
Priority: -- → P5
Comment hidden (mozreview-request)

Comment 36

3 months ago
1 failures in 702 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* osx-10-10: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1375637&startday=2018-02-05&endday=2018-02-11&tree=all

Comment 37

3 months ago
mozreview-review
Comment on attachment 8949106 [details]
Bug 1375637 - Make test_async_script_timeout less likely to fail.

https://reviewboard.mozilla.org/r/218504/#review225144
Attachment #8949106 - Flags: review?(dburns) → review+

Comment 38

3 months ago
Pushed by atolfsen@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/9bc3906d3dc9
Make test_async_script_timeout less likely to fail. r=automatedtester

Comment 39

3 months ago
bugherder
https://hg.mozilla.org/mozilla-central/rev/9bc3906d3dc9
Status: NEW → RESOLVED
Last Resolved: 3 months ago
status-firefox60: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla60
status-firefox56: affected → wontfix
status-firefox57: affected → wontfix
status-firefox58: --- → wontfix
status-firefox59: --- → affected

Comment 40

3 months ago
bugherderuplift
https://hg.mozilla.org/releases/mozilla-beta/rev/8306ccb1dd27
status-firefox59: affected → fixed
You need to log in before you can comment on or make changes to this bug.