1822775 - High frequency Android opt /webdriver/tests/bidi/script/add_preload_script/add_preload_script_tentative.py | test_add_preload_script[tab] - AssertionError: assert {'type': 'undefined'} == {'type': 'string', 'value': 'bar'}

Status: RESOLVED FIXED

(Remote Protocol :: WebDriver BiDi, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: hskupin [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=409109742&repo=try
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/MJBmkHhfRcKVHCTaz1ndtg/runs/0/artifacts/public/logs/live_backing.log

---

This is a test failure on Android only and I can see this for the try builds of the downstream sync for bug 1791565. Those will most likely be marked as perma fail by the sync.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Given that this is a feature for M6 could you please have a look at it Sasha?

Comment 2

[Intermittent Failures Robot]

8 failures in 3761 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 8

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 3
  • opt: 3
• android-em-7-0-x86_64-lite-qr: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1822775&startday=2023-03-13&endday=2023-03-19&tree=all

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

This failure was present for a wpt sync try build. So it might get disabled when bug 1791565 is fixed / synced.

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+1]]

I think that we should wait until bug 1791565 has been fixed. Then we can check what's wrong on Android.

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Sasha, now that the changes are on mozilla-central can you please have a look? Thanks.

Comment 6

[Alexandra Borovova [:Sasha]]

I've tried to push to try with this test enabled for Android with 10 times rebuild, and it didn't fail even once: https://treeherder.mozilla.org/jobs?repo=try&revision=9ce1604c52034d6bb8e05f7d06567c82da376fa3. Not sure, if we maybe want to enable it and observe a bit more?

Comment 7

[Henrik Skupin [:whimboo][⌚️UTC+1]]

If it's no longer failing then yes, lets get it re-enabled. Feel free to attach the patch directly on this bug. Thanks.

Comment 8

[Alexandra Borovova [:Sasha]]

Attachment: Bug 1822775 - [wdspec] Enable "test_add_preload_script[tab]" on Android

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/992bc1f00796
[wdspec] Enable "test_add_preload_script[tab]" on Android r=webdriver-reviewers,whimboo

Comment 10

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/992bc1f00796