1709948 - [meta] Fix mochitests for isolated process

Status: NEW

(GeckoView :: General, task, P2)

Description

[[:owlish] 🦉 PST]

Affected tests:

• mochitest-plain M()
• mochitest-plain-gpu M(gpu)
• mochitest-media M(mda)
• mochitest-media, socketprocess variant M-spi(mda)

Once fixed, these should be enabled in automation (i.e. have the same tier in sandboxed builds as in non-sandboxed builds of the same type)

Comment 1

[Chris Peterson [:cpeterson]]

Moving isolated process bugs to the new GeckoView::Sandboxing component.

Comment 2

[Olivia Hall [:olivia]]

Overview of mochitests

M-nofis(1)

Test	Error	Call	Possible Bug
docshell/test/navigation/test_blockBFCache.html	AudioFlinger not published	-	1700243
dom/worklet/tests/test_audioWorklet_insecureContext.html	AudioFlinger not published	likely new AudioContext()	1700243

M-nofis(2)

Test	Error	Call	Possible Bug
dom/canvas/test/test_capture.html	AudioFlinger not published	captureStream()	1700243
dom/events/test/test_all_synthetic_events.html	AudioFlinger not published	likely new AudioContext()	1700243
toolkit/content/tests/widgets/test_bug898940.html	AudioFlinger not published	likely audio.play();	1700243
toolkit/content/tests/widgets/test_videocontrols_audio.html	AudioFlinger not published	-	1700243
toolkit/content/tests/widgets/test_videocontrols_error.html	Passed Locally (?)	-	-
dom/origin-trials/tests/mochitest/test_expired_token.html	AudioFlinger not published	likely new AudioContext()	1700243

M-nofis(3)

Test	Error	Call	Possible Bug
dom/canvas/test/crossorigin/test_canvas2d_crossorigin.html	AudioFlinger not published	captureStream()	1700243

M-nofis(gpu)

Test	Error	Call	Possible Bug
dom/canvas/test/crossorigin/test_video_crossorigin.html	AudioFlinger not published	captureStream()	1700243

M-nofis(mda)

Test	Error	Call	Possible Bug
dom/media/mediasource/test/test_AVC3_mp4.html	Waiting for service SurfaceFlinger	-	1706656
dom/media/test/test_VideoPlaybackQuality.html	Waiting for service SurfaceFlinger	-	1706656
dom/media/test/test_imagecapture.html	AudioFlinger not published	-	1700243
dom/media/test/test_bug1113600.html	AudioFlinger not published	-	1700243
dom/media/test/test_bug1242338.html	Waiting for service SurfaceFlinger	-	1706656
dom/media/test/test_mediacapabilities_resistfingerprinting.html	Waiting for service SurfaceFlinger	-	1706656
dom/media/test/test_mediarecorder_avoid_recursion.html	AudioFlinger not published	-	1700243
dom/media/test/test_seek_duration.html	Waiting for service SurfaceFlinger	-	1706656

M-spi-nofis(mda)

Test
dom/media/mediasource/test/test_AVC3_mp4.html
dom/media/test/test_VideoPlaybackQuality.html
dom/media/test/test_imagecapture.html
dom/media/test/test_bug1113600.html
dom/media/test/test_bug1242338.html
dom/media/test/test_mediacapabilities_resistfingerprinting.html
dom/media/test/test_mediarecorder_avoid_recursion.html
dom/media/test/test_seek_duration.html

Try used to build list + local runs.

Comment 3

[Chris Peterson [:cpeterson]]

Tasks should have severity N/A.

Comment 4

[Intermittent Failures Robot]

3 failures in 2218 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 3

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • debug-isolated-process: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1709948&startday=2023-08-21&endday=2023-08-27&tree=all

Comment 6

[Intermittent Failures Robot]

2 failures in 4052 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 2
  • debug-isolated-process: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1709948&startday=2024-02-26&endday=2024-03-03&tree=all

Comment 8

[Intermittent Failures Robot]

1 failures in 3649 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • debug-isolated-process: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1709948&startday=2024-06-03&endday=2024-06-09&tree=all

Comment 9

[Olivia Hall [:olivia]]

Try to check latest state of tests.

Comment 10

[Olivia Hall [:olivia]]

Many tests are still failing - I thought some might be fixed due to the cubeb updates.

Non-comprehensive list of failures:

• dom/canvas/test/test_capture.html
• docshell/test/navigation/test_blockBFCache.html
• dom/canvas/test/crossorigin/test_canvas2d_crossorigin.html
• dom/canvas/test/crossorigin/test_video_crossorigin.html
• dom/media/test/test_complete_length.html

It seems like some of the failures also bring down the test harness, so there is the possibility that more tests failing as well. It does seem like less failures than listed in the original report, so maybe we have some improvement or at least new metadata.

Comment 13

[Olivia Hall [:olivia]]

Sending another try up since bug 1698214 has unblocked some things around media.

Comment 14

[Olivia Hall [:olivia]]

It looks like bug 1698214 did clear many additional tests in the plain M suite, but some remain. M(mda1) & M(mda2) still have many failures.

M(2)

• TEST-UNEXPECTED-FAIL | netwerk/test/mochitests/test_android_content_uri.html | [Exception... "Component returned failure code: 0x80520015 (NS_ERROR_FILE_ACCESS_DENIED) [nsIAndroidContentInputStream.init]" nsresult: "0x80520015 (NS_ERROR_FILE_ACCESS_DENIED)" location: "JS frame :: resource://testing-common/WrapPrivileged.sys.mjs :: doApply :: line 117" data: no] - Should not throw any errors

M(mda1) & M(mda2)

• PROCESS-CRASH | dom/media/autoplay/test/mochitest/mochitest.toml
• PROCESS-CRASH | dom/media/mediasource/test/mochitest.toml
• PROCESS-CRASH | dom/media/test/mochitest.toml
• TEST-UNEXPECTED-FAIL | dom/media/test/test_complete_length.html | Test timed out.
• TEST-UNEXPECTED-ERROR | dom/media/test/test_complete_length.html |
• TEST-UNEXPECTED-FAIL | dom/media/test/test_complete_length.html
• TEST-UNEXPECTED-FAIL | dom/media/test/test_streams_element_capture.html
• PROCESS-CRASH | application crashed [None] | dom/media/test/mochitest_stream.toml
• TEST-UNEXPECTED-ERROR | dom/media/test/test_streams_individual_pause.html | called finish() multiple times
• And so on ...

Notably see in the logs:

04-28 20:06:58.482  3753  3769 E HardwareCodecCapability: Failed to retrieve media codec support list
04-28 20:06:58.482  3753  3769 E HardwareCodecCapability: java.lang.RuntimeException: cannot get MediaCodecList

Possibly connected to same root cause of remoting issues in bug 1961624. Maybe will be fixed by bug 1934009, would need to research further to confirm same causes.

Comment 15

[Makoto Kato [:m_kato]]

TEST-UNEXPECTED-FAIL | netwerk/test/mochitests/test_android_content_uri.html | [Exception... "Component returned failure code: 0x80520015 (NS_ERROR_FILE_ACCESS_DENIED) [nsIAndroidContentInputStream.init]" nsresult: "0x80520015 (NS_ERROR_FILE_ACCESS_DENIED)" location: "JS frame :: resource://testing-common/WrapPrivileged.sys.mjs :: doApply :: line 117" data: no] - Should not throw any errors

This is bug 1952525. This should be converted to mochitest-browser, mochitest-chrome or xpcshell. But I guess that mochitest-browser and mochitest-chrome won't run on GeckoView. So I am considering it to convert to xpcshell if possible.

Comment 16

[Olivia Hall [:olivia]]

Mochitests will have metadata categorizations as soon as bug 1975257 lands.

The failing mochitests can be found by searching this bug number bug 1709948.