Open Bug 1763188 Opened 3 years ago Updated 7 months ago

Make mozregression work with snap builds

Categories

(Testing :: mozregression, enhancement)

Product:
Testing
Component:
mozregression
Version:
Default
Type:
enhancement

Tracking

(Not tracked)

People

(Reporter: pascalc, Assigned: gerard-majax)

References

(Blocks 1 open bug)

Details

Attachments

(1 file)

GitHub Pull Request
50 bytes, text/x-github-pull-request
Details | Review

Mozregression cannot be used to find a regression range in snap builds which are increasingly used as a default in Ubuntu.

This is especially useful for snap specific regressions usually caused by the sandboxing we have in these builds.

Blocks: snap
Assignee: nobody → lissyx+mozillians
See Also: → 1782828

Probably we should just add upstream builds on Treeherder, they differ (quite slightly) from our repack

Depends on: 1839317
Attached file GitHub Pull Request —

draft wip, basic support:

  • find builds
  • snap install / snap run / snap remove

nothing abstracted over mozrunner, we probably want to do that

all snap interactions for install/remove will trigger password request

user still needs sudo snap set system experimental.parallel-instances=true

Depends on: 1864841

Fake ESR mozregression session:

$ mozregression -n firefox-snap --good 2023-11-01 --bad 2023-11-03 --allow-sudo --build-type opt --repo snap-esr 
**********
You should use a config file. Please use the --write-config command line flag to help you create one.
**********

 0:00.23 WARNING: You are using mozregression version 0.1.dev1732+ge9c2fa1, however version 6.0.1 is available.
 0:00.23 WARNING: You should consider upgrading via the 'pip install --upgrade mozregression' command.
 0:00.24 INFO: Getting snap-esr builds between 2023-11-01 and 2023-11-03
 0:01.22 INFO: Using 251055c46bfcc027766c9bdaccaaa919c3e6c8f6 (pushed on 2023-11-01 03:44:46) for date 2023-11-01
 0:01.22 INFO: Using db8c28afe588aab0cd434e280a4614c075350cde (pushed on 2023-11-03 20:05:28) for date 2023-11-03
 0:02.40 WARNING: Skipping build 251055c46bfc: Unable to find build info using the taskcluster route 'gecko.v2.mozilla-central.revision.251055c46bfcc027766c9bdaccaaa919c3e6c8f6.firefox.esr'
 0:03.58 INFO: Testing good and bad builds to ensure that they are really good and bad...
 0:03.58 INFO: Downloading build from: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YPKFegr8Ss-eoPvR24UrcA/runs/0/artifacts/public%2Fbuild%2Ffirefox_115.4.0esr-1_amd64.snap
===== Downloaded 109% =====
 0:07.47 INFO: Running snap-esr build built on 2023-11-02 01:51:07.724000, revision b73ef4c8
firefox_3042ea9e1 115.4.0esr-1 install\u00e9
erreur\u00a0: cannot perform the following tasks:
- D\u00e9finir les alias automatiques pour le paquet Snap "firefox_3042ea9e1" (cannot enable alias "geckodriver" for "firefox_3042ea9e1", already enabled for "firefox")
['sudo', 'snap', 'refresh', '--amend', 'firefox_3042ea9e1'] 1 None
 0:51.91 INFO: Launching /snap/firefox_3042ea9e1/current/usr/lib/firefox/firefox [True]
 0:51.91 INFO: Application command: snap run firefox_3042ea9e1 -profile /home/user/snap/firefox_3042ea9e1/common/.mozilla/firefox/tmpmkn980p1.mozrunner
 0:51.92 INFO: application_buildid: 20231102012023
 0:51.92 INFO: application_changeset: 7e770707fe156fc2e62c5f624235e4b2dadc1e7b
 0:51.92 INFO: application_name: Firefox
 0:51.92 INFO: application_repository: https://hg.mozilla.org/releases/mozilla-esr115
 0:51.92 INFO: application_version: 115.4.0
Was this integration build good, bad, or broken? (type 'good', 'bad', 'skip', 'retry' or 'exit' and press Enter): Gtk-Message: 10:37:18.400: Not loading module "atk-bridge": The functionality is provided by GTK natively. Please try to not load it.

(firefox-esr:223421): Gtk-WARNING **: 10:37:18.495: GTK+ module /snap/firefox/x1/gnome-platform/usr/lib/gtk-2.0/modules/libcanberra-gtk-module.so cannot be loaded.
GTK+ 2.x symbols detected. Using GTK+ 2.x and GTK+ 3 in the same process is not supported.
Gtk-Message: 10:37:18.495: Failed to load module "canberra-gtk-module"

(firefox-esr:223421): Gtk-WARNING **: 10:37:18.497: GTK+ module /snap/firefox/x1/gnome-platform/usr/lib/gtk-2.0/modules/libcanberra-gtk-module.so cannot be loaded.
GTK+ 2.x symbols detected. Using GTK+ 2.x and GTK+ 3 in the same process is not supported.
Gtk-Message: 10:37:18.497: Failed to load module "canberra-gtk-module"
good
firefox_3042ea9e1 supprim\u00e9
 1:32.06 INFO: Using local file: /tmp/tmph9zk82_u/db8c28afe588--snap-esr--firefox_115.4.0esr-1_amd64.snap (downloaded in background)
 1:32.06 INFO: Running snap-esr build built on 2023-11-04 01:42:10.724000, revision db8c28af
firefox_0f42bdef9 115.4.0esr-1 install\u00e9
Handling re-refresh of "firefox_0f42bdef9" as needed                                                                                                                                   |Handling re-refresh of "firefox_0f42bdef9" as needed                                                                                                                                   /erreur\u00a0: cannot perform the following tasks:
- D\u00e9finir les alias automatiques pour le paquet Snap "firefox_0f42bdef9" (cannot enable alias "geckodriver" for "firefox_0f42bdef9", already enabled for "firefox")
['sudo', 'snap', 'refresh', '--amend', 'firefox_0f42bdef9'] 1 None
 2:18.45 INFO: Launching /snap/firefox_0f42bdef9/current/usr/lib/firefox/firefox [True]
 2:18.45 INFO: Application command: snap run firefox_0f42bdef9 -profile /home/user/snap/firefox_0f42bdef9/common/.mozilla/firefox/tmp92x5zgxn.mozrunner
 2:18.46 INFO: application_buildid: 20231104011140
 2:18.46 INFO: application_changeset: 7e770707fe156fc2e62c5f624235e4b2dadc1e7b
 2:18.46 INFO: application_name: Firefox
 2:18.46 INFO: application_repository: https://hg.mozilla.org/releases/mozilla-esr115
 2:18.46 INFO: application_version: 115.4.0
Was this integration build good, bad, or broken? (type 'good', 'bad', 'skip', 'retry' or 'exit' and press Enter): Gtk-Message: 10:38:44.923: Not loading module "atk-bridge": The functionality is provided by GTK natively. Please try to not load it.

(firefox-esr:226547): Gtk-WARNING **: 10:38:45.017: GTK+ module /snap/firefox/x1/gnome-platform/usr/lib/gtk-2.0/modules/libcanberra-gtk-module.so cannot be loaded.
GTK+ 2.x symbols detected. Using GTK+ 2.x and GTK+ 3 in the same process is not supported.
Gtk-Message: 10:38:45.017: Failed to load module "canberra-gtk-module"

(firefox-esr:226547): Gtk-WARNING **: 10:38:45.019: GTK+ module /snap/firefox/x1/gnome-platform/usr/lib/gtk-2.0/modules/libcanberra-gtk-module.so cannot be loaded.
GTK+ 2.x symbols detected. Using GTK+ 2.x and GTK+ 3 in the same process is not supported.
Gtk-Message: 10:38:45.019: Failed to load module "canberra-gtk-module"
bad
firefox_0f42bdef9 supprim\u00e9
 2:55.94 INFO: Good and bad builds are correct. Let's continue the bisection.
 2:55.94 INFO: Pushlog:
https://hg.mozilla.org/mozilla-central/pushloghtml?fromchange=b73ef4c8979fb0702de9f4bf2fdf986b1d0fd487&tochange=db8c28afe588aab0cd434e280a4614c075350cde

 2:55.94 INFO: Using local file: /tmp/tmph9zk82_u/59754ae1b713--snap-esr--firefox_115.4.0esr-1_amd64.snap (downloaded in background)
 2:55.94 INFO: Running snap-esr build built on 2023-11-03 01:50:38.515000, revision 59754ae1
 2:56.45 WARNING: Skipping build 63221dffde4f: Unable to find build info using the taskcluster route 'gecko.v2.mozilla-central.revision.63221dffde4f2b6c134c16fb540dea75d856626d.firefox.esr'
      2:56.96 WARNING: Skipping build 8be76292bf3f: Unable to find build info using the taskcluster route 'gecko.v2.mozilla-central.revision.8be76292bf3f6acbc6d7d87935f7eb147bbf27ca.firefox.esr'
           2:57.51 WARNING: Skipping build 1fcf041bc427: Unable to find build info using the taskcluster route 'gecko.v2.mozilla-central.revision.1fcf041bc427507f767a28519182263ab9925550.firefox.esr'
Monter le paquet Snap "firefox_b6423c7bd" (unset)                                                                                                                                      \ 2:58.06 WARNING: Skipping build 3eea9367b17b: Unable to find build info using the taskcluster route 'gecko.v2.mozilla-central.revision.3eea9367b17b3c112968a3f0e008b1005452bbdd.firefox.esr'
firefox_b6423c7bd 115.4.0esr-1 install\u00e9
erreur\u00a0: cannot perform the following tasks:
- D\u00e9finir les alias automatiques pour le paquet Snap "firefox_b6423c7bd" (cannot enable alias "geckodriver" for "firefox_b6423c7bd", already enabled for "firefox")
['sudo', 'snap', 'refresh', '--amend', 'firefox_b6423c7bd'] 1 None
 3:41.40 INFO: Launching /snap/firefox_b6423c7bd/current/usr/lib/firefox/firefox [True]
 3:41.40 INFO: Application command: snap run firefox_b6423c7bd -profile /home/user/snap/firefox_b6423c7bd/common/.mozilla/firefox/tmpjk_8wdhn.mozrunner
 3:41.41 INFO: application_buildid: 20231103011828
 3:41.41 INFO: application_changeset: 7e770707fe156fc2e62c5f624235e4b2dadc1e7b
 3:41.41 INFO: application_name: Firefox
 3:41.41 INFO: application_repository: https://hg.mozilla.org/releases/mozilla-esr115
 3:41.41 INFO: application_version: 115.4.0
Was this integration build good, bad, or broken? (type 'good', 'bad', 'skip', 'retry' or 'exit' and press Enter): Gtk-Message: 10:40:07.881: Not loading module "atk-bridge": The functionality is provided by GTK natively. Please try to not load it.

(firefox-esr:229719): Gtk-WARNING **: 10:40:07.977: GTK+ module /snap/firefox/x1/gnome-platform/usr/lib/gtk-2.0/modules/libcanberra-gtk-module.so cannot be loaded.
GTK+ 2.x symbols detected. Using GTK+ 2.x and GTK+ 3 in the same process is not supported.
Gtk-Message: 10:40:07.977: Failed to load module "canberra-gtk-module"

(firefox-esr:229719): Gtk-WARNING **: 10:40:07.978: GTK+ module /snap/firefox/x1/gnome-platform/usr/lib/gtk-2.0/modules/libcanberra-gtk-module.so cannot be loaded.
GTK+ 2.x symbols detected. Using GTK+ 2.x and GTK+ 3 in the same process is not supported.
Gtk-Message: 10:40:07.978: Failed to load module "canberra-gtk-module"
bad
firefox_b6423c7bd supprim\u00e9
 4:18.56 INFO: Narrowed integration regression window from [7e770707, 7e770707] (3 builds) to [7e770707, 7e770707] (2 builds) (~1 steps left)
 4:18.56 INFO: No more integration revisions, bisection finished.
 4:18.56 INFO: Last good revision: 7e770707fe156fc2e62c5f624235e4b2dadc1e7b
 4:18.56 INFO: First bad revision: 7e770707fe156fc2e62c5f624235e4b2dadc1e7b
 4:18.56 INFO: Pushlog:
https://hg.mozilla.org/releases/mozilla-esr115/pushloghtml?changeset=7e770707fe156fc2e62c5f624235e4b2dadc1e7b

 4:18.56 WARNING: It seems that you used two changesets that are in the same push. Check the pushlog url.
Depends on: 1866057

Looks like https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/2043993 is actually making this impossible to work for real at the moment: we end up having to refresh which updates the old version we installed, and any blockage of refresh I could try would not be enough ...

You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: