1781850 - Intermittent browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js | single tracking bug

Should not have rounded 'new content.Date().getTime()' to nearest 7.97 ms; saw 1681689110076. scenario: TEST_SCENARIO_8 - false == true - got false, expected true (operator ==);
Should not have rounded 'content.performance.now()' to nearest 7.97 ms; saw 407. scenario: TEST_SCENARIO_8 - false == true - got false, expected true (operator ==);
Should not have rounded 'new content.Event("").timeStamp' to nearest 7.97 ms; saw 407. scenario: TEST_SCENARIO_8 - false == true - got false, expected true (operator ==).

Recent failure log.

[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - TEST-PASS | browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js | Should not have rounded 'new content.File([], "").lastModified' to nearest 7.97 ms; saw 1682169977740. scenario: TEST_SCENARIO_8 - true == true - 
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - Buffered messages finished
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - TEST-UNEXPECTED-FAIL | browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js | Should not have rounded 'new content.Date().getTime()' to nearest 7.97 ms; saw 1682169977738. scenario: TEST_SCENARIO_8 - false == true - got false, expected true (operator ==)
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - Stack trace:
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - ok@resource://specialpowers/SpecialPowersSandbox.sys.mjs:85:21
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - @chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js line 97 > eval:15:9
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - @chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js:154:19
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - execute@resource://specialpowers/SpecialPowersSandbox.sys.mjs:139:12
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - _spawnTask@resource://specialpowers/SpecialPowersChild.sys.mjs:1648:15
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - receiveMessage@resource://specialpowers/SpecialPowersChild.sys.mjs:261:21
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - JSActor query*receiveMessage@resource://specialpowers/SpecialPowersParent.sys.mjs:1388:14
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - JSActor query*spawn@resource://specialpowers/SpecialPowersChild.sys.mjs:1579:17
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - setupAndRunCrossOriginIsolatedTest@chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/head.js:233:23
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - async*runRTPTestDOM@chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js:240:9
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - async*handleTask@chrome://mochikit/content/browser-test.js:1127:26
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - _runTaskBasedTest@chrome://mochikit/content/browser-test.js:1199:18
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - Tester_execTest@chrome://mochikit/content/browser-test.js:1341:14
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - nextTest/<@chrome://mochikit/content/browser-test.js:1116:14
[task 2023-04-22T13:26:17.929Z] 13:26:17     INFO - SimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1056:13
[task 2023-04-22T13:26:17.937Z] 13:26:17     INFO - Not taking screenshot here: see the one that was previously logged
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - TEST-UNEXPECTED-FAIL | browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js | Should not have rounded 'content.performance.now()' to nearest 7.97 ms; saw 375. scenario: TEST_SCENARIO_8 - false == true - got false, expected true (operator ==)
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - Stack trace:
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - ok@resource://specialpowers/SpecialPowersSandbox.sys.mjs:85:21
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - @chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js line 97 > eval:15:9
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - @chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js:154:19
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - execute@resource://specialpowers/SpecialPowersSandbox.sys.mjs:139:12
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - _spawnTask@resource://specialpowers/SpecialPowersChild.sys.mjs:1648:15
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - receiveMessage@resource://specialpowers/SpecialPowersChild.sys.mjs:261:21
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - JSActor query*receiveMessage@resource://specialpowers/SpecialPowersParent.sys.mjs:1388:14
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - JSActor query*spawn@resource://specialpowers/SpecialPowersChild.sys.mjs:1579:17
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - setupAndRunCrossOriginIsolatedTest@chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/head.js:233:23
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - async*runRTPTestDOM@chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js:240:9
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - async*handleTask@chrome://mochikit/content/browser-test.js:1127:26
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - _runTaskBasedTest@chrome://mochikit/content/browser-test.js:1199:18
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - Tester_execTest@chrome://mochikit/content/browser-test.js:1341:14
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - nextTest/<@chrome://mochikit/content/browser-test.js:1116:14
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - SimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1056:13
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - Not taking screenshot here: see the one that was previously logged
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - TEST-UNEXPECTED-FAIL | browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js | Should not have rounded 'new content.Event("").timeStamp' to nearest 7.97 ms; saw 375. scenario: TEST_SCENARIO_8 - false == true - got false, expected true (operator ==)
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - Stack trace:
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - ok@resource://specialpowers/SpecialPowersSandbox.sys.mjs:85:21
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - @chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js line 97 > eval:15:9
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - @chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js:154:19
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - execute@resource://specialpowers/SpecialPowersSandbox.sys.mjs:139:12
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - _spawnTask@resource://specialpowers/SpecialPowersChild.sys.mjs:1648:15
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - receiveMessage@resource://specialpowers/SpecialPowersChild.sys.mjs:261:21
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - JSActor query*receiveMessage@resource://specialpowers/SpecialPowersParent.sys.mjs:1388:14
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - JSActor query*spawn@resource://specialpowers/SpecialPowersChild.sys.mjs:1579:17
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - setupAndRunCrossOriginIsolatedTest@chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/head.js:233:23
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - async*runRTPTestDOM@chrome://mochitests/content/browser/browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js:240:9
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - async*handleTask@chrome://mochikit/content/browser-test.js:1127:26
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - _runTaskBasedTest@chrome://mochikit/content/browser-test.js:1199:18
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - Tester_execTest@chrome://mochikit/content/browser-test.js:1341:14
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - nextTest/<@chrome://mochikit/content/browser-test.js:1116:14
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - SimpleTest.waitForFocus/<@chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:1056:13
[task 2023-04-22T13:26:17.945Z] 13:26:17     INFO - TEST-PASS | browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js | webCOOP+COEP=https://example.com expected to be coop+coep -

Hello Tim! Any chance you could help us assign this to someone?

Thank you!

Flags: needinfo?(tihuang)

Whiteboard: [stockwell needswork:owner]

Comment hidden (Intermittent Failures Robot)

Tim Huang[:timhuang]

Comment 21

•

2 years ago

Tom, do you know of any recent changes that may cause this intermittent?

Flags: needinfo?(tom)

Flags: needinfo?(tihuang)

Flags: needinfo?(evilpies)

Tom S

Updated

•

2 years ago

Flags: needinfo?(evilpies)

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 22

•

2 years ago

Bug 1824235 extended them.

Keywords: regression

Regressed by: 1824235

BugBot [:suhaib / :marco/ :calixte]

Comment 23

•

2 years ago

Set release status flags based on info from the regressing bug 1824235

status-firefox112: --- → unaffected

status-firefox113: --- → unaffected

status-firefox114: --- → affected

status-firefox-esr102: --- → unaffected

Tom Ritter [:tjr]

Assignee

Comment 24

•

2 years ago

So this might be the intermittents we expected, and tried to minimize. It's reporting that these timestamps should not be rounded, but that they are. This could be because we are doing something wrong or it could be because the number just happened to be a value that is evenly(ish) divisible by the precision.

I suspect it is the latter. This is doubly true because scenario 8 is the highest precision (7.97 ms) meaning it is more likely to trigger. I would expect there to be some, smaller number, of failures on test scenarios 5 (13ms), test scenario 2 (100ms). I gather that comment 19 is not comprehensive of all failures, so I'm assuming that's the case.

So what do we do? Most of the failures are on opt, we could always disable the test on opt, but we'll still have intermittents on debug, just fewer. We could remove these test scenarios entirely, in which case we wouldn't be noticing the scenario where RFP is enabled on PBM, but we are accidentally applying it in normal windows.

I think we probably need to do the latter, although it sucks, because intermittents suck more. There should be other tests where we are verifying that RFP is not being applied in PBM. (It won't be testing time precision specifically, it will be testing some other API, like hardware concurrency, but it's still something.) I will leave the ni to verify that the other test exists, and then remove these scenarios.

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 27

•

2 years ago

Set release status flags based on info from the regressing bug 1824235

status-firefox115: --- → affected

Cristina Horotan [:chorotan]

Comment 28

•

2 years ago

There have been 37 total failures in the last 7 days.
There are:

2 failures on linux1804-64-qr opt and debug
2 failures on linux1804-64-shippable-qr opt
3 failures on macosx1015-64-qr opt and debug
1 failure on windows11-64-2009-ccov-qr opt
2 failures on windows11-64-2009-qr opt
16 failures on windows7-32-qr opt
11 failures on windows7-32-shippable-qr opt

Recent failure log.

Tim, as the owner of this component, can you help us assign the bug to someone? Thank you.

Flags: needinfo?(tihuang)

Whiteboard: [stockwell unknown] → [stockwell unknown][stockwell needswork:owner]

Comment hidden (Intermittent Failures Robot)

Tim Huang[:timhuang]

Comment 30

•

2 years ago

Tom, I will assign this bug to you for now because you have an idea in comment 24 to reduce the intermittent.

Assignee: nobody → tom

Flags: needinfo?(tihuang)

Comment hidden (Intermittent Failures Robot)

Tom Ritter [:tjr]

Assignee

Comment 32

•

2 years ago

Attached file Bug 1781850: Disable test scenarios that cause too many intermittents r?timhuang — Details

I am leaving the 100ms case - hopefully that intermittent rate
is low enough that we can leave it and still test the scenario.

Pulsebot

Comment 33

•

2 years ago

Pushed by tritter@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/bc038853ad36 Disable test scenarios that cause too many intermittents r=timhuang

Narcis Beleuzu [:NarcisB]

Comment 34

•

2 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/bc038853ad36

Status: NEW → RESOLVED

Closed: 2 years ago

status-firefox115: affected → fixed

Resolution: --- → FIXED

Target Milestone: --- → 115 Branch

Serban Stanca [:SerbanS]

Comment 35

•

2 years ago

Reopened this because the debug failures are still present, as specified in comment 24 and as encountered here.

Status: RESOLVED → REOPENED

status-firefox115: fixed → affected

Resolution: FIXED → ---

Target Milestone: 115 Branch → ---

Comment hidden (Intermittent Failures Robot)

Donal Meehan [:dmeehan]

Updated

•

2 years ago

status-firefox114: affected → wontfix

status-firefox115: affected → wontfix

Comment hidden (Intermittent Failures Robot)

Tom Ritter [:tjr]

Assignee

Updated

•

10 months ago

Flags: needinfo?(tom)

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 76

•

4 months ago

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED

Closed: 2 years ago → 4 months ago

Resolution: --- → INCOMPLETE

Treeherder Bug Filer

Comment 77

•

4 months ago

treeherder

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=477096435&repo=autoland

Status: RESOLVED → REOPENED

Resolution: INCOMPLETE → ---

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 90

•

4 days ago

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.

Status: REOPENED → RESOLVED

Closed: 4 months ago → 4 days ago

Resolution: --- → INCOMPLETE

Treeherder Bug Filer

Comment 91

•

1 days ago

treeherder

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=494716807&repo=mozilla-beta

Status: RESOLVED → REOPENED

Resolution: INCOMPLETE → ---

	1proc	1proc-s	1proc-swr	a11y-checks	a11y-checks-s	a11y-checks-swr	a11y-checks-swr-s	condprof	condprof-s	fis	fis-hv	fis-hv-s	fis-s	headless	headless-s	http2	http3	mda-gpu	msix	msix-s	no_variant	nofis	nofis-aab	nofis-s	nofis-ship	nofis-ship-s	nofis-spi	nofis-swr	nofis-swr-s	nogpu	nogpu-s	s	spi	spi-nw	spi-nw-1proc	spi-nw-nofis	spi-nw-nofis-s	spi-nw-s	spi-s	swr	swr-s	wmfme	wr-dc1-p	xorig	xorig-s
macosx1015-64-qr/debug																																		1
macosx1015-64-shippable-qr/opt																																						1

	1proc	1proc-s	1proc-swr	a11y-checks	a11y-checks-s	a11y-checks-swr	a11y-checks-swr-s	condprof-s	fis	fis-hv	fis-hv-s	fis-s	headless	headless-s	http2	http3	mda-gpu	mda-gpu-s	msix	msix-s	no_variant	nofis	nofis-aab	nofis-s	nofis-ship	nofis-ship-s	nofis-spi	nofis-swr	nofis-swr-s	nogpu	nogpu-s	s	spi	spi-nw	spi-nw-1proc	spi-nw-nofis	spi-nw-nofis-s	spi-nw-s	spi-s	swr	swr-s	vt	vt-s	wmfme	wr-dc1-p	wr-dc2-o	wr-dc3-c	wr-dc3-c-s	xorig	xorig-s
macosx1015-64-qr/debug																																		2
macosx1015-64-shippable-qr/opt																																						1

	1proc	1proc-s	1proc-swr	a11y-checks	a11y-checks-s	a11y-checks-swr	a11y-checks-swr-s	cf	condprof-s	fis	fis-hv	fis-hv-s	fis-s	headless	headless-s	http2	http3	msix	msix-s	no_variant	nofis	nofis-aab	nofis-s	nofis-ship	nofis-ship-s	nofis-spi	nofis-swr	nogpu	nogpu-s	s	spi	spi-nw	spi-nw-1proc	spi-nw-cf	spi-nw-nofis	spi-nw-s	swr	swr-s	vt	vt-s	wmfme	wmfme-s	xorig	xorig-s
macosx1015-64-qr/opt																																1
macosx1015-64-qr/debug																				1

	no_variant	spi-nw
macosx1015-64-qr/-/debug	1
macosx1100-aarch64-qr/-/opt		1

Intermittent browser/components/resistfingerprinting/test/browser/browser_cross_origin_isolated_reduce_time_precision.js | single tracking bug

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see:

Summary

Repository breakdown:

Platform and build breakdown:

Table

For more details, see: