1963790 - Perma Linux Pfu: Local VCS (hg) is different from the one defined in the repository (git).

Status: RESOLVED WORKSFORME

(Firefox Build System :: Task Configuration, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=506305259&repo=mozilla-release
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/JLL53Dz-S9SUzP-BMjReIQ/runs/1/artifacts/public/logs/live_backing.log

---

+ continue
+ IFS=/
+ read -r bucket collection last_modified
+ local_dump_file=mozilla-release/services/settings/dumps/main/sites-classification.json
+ '[' '!' -r mozilla-release/services/settings/dumps/main/sites-classification.json ']'
+ remote_records_url='https://firefox.settings.services.mozilla.com/v1/buckets/main/collections/sites-classification/changeset?_expected=1544035467383'
+ local_location_output=mozilla-release/services/settings/dumps/main/sites-classification.json
+ '[' sites-classification = search-config-v2 ']'
+ wget -nv -qO- 'https://firefox.settings.services.mozilla.com/v1/buckets/main/collections/sites-classification/changeset?_expected=1544035467383'
+ /usr/bin/jq '{"data": .changes, "timestamp": .timestamp}'
+ '[' main = blocklists ']'
+ '[' main = main ']'
+ '[' sites-classification = search-config-icons ']'
+ '[' false == true ']'
+ /usr/bin/hg --cwd mozilla-release purge services/settings/dumps/main/search-config-icons
+ IFS=/
+ read -r bucket collection last_modified
+ local_dump_file=mozilla-release/services/settings/dumps/main-preview/sites-classification.json
+ '[' '!' -r mozilla-release/services/settings/dumps/main-preview/sites-classification.json ']'
+ continue
+ IFS=/
+ read -r bucket collection last_modified
+ echo 'INFO: diffing old/new remote settings dumps...'
INFO: diffing old/new remote settings dumps...
+ create_repo_diff mozilla-release/services/settings/dumps /home/worker/artifacts/remote-settings.diff
+ '[' false == true ']'
+ /usr/bin/hg -R mozilla-release diff mozilla-release/services/settings/dumps
+ '[' -s /home/worker/artifacts/remote-settings.diff ']'
+ return 0
+ REMOTE_SETTINGS_UPDATED=true
+ '[' false == true ']'
+ '[' true == true ']'
+ compare_mobile_experiments
+ echo 'INFO wget -nv https://experimenter.services.mozilla.com/api/v6/experiments-first-run/'
INFO wget -nv https://experimenter.services.mozilla.com/api/v6/experiments-first-run/
+ wget -nv -O experiments.json https://experimenter.services.mozilla.com/api/v6/experiments-first-run/
2025-05-01 08:26:53 URL:https://experimenter.services.mozilla.com/api/v6/experiments-first-run/ [18973/18973] -> "experiments.json" [1]
+ wget -nv -O fenix-experiments-old.json https://hg.mozilla.org/releases/mozilla-release/raw-file/default/mobile/android/fenix/app/src/main/res/raw/initial_experiments.json
2025-05-01 08:26:55 URL:https://hg-edge.mozilla.org/releases/mozilla-release/raw-file/default/mobile/android/fenix/app/src/main/res/raw/initial_experiments.json [22933/22933] -> "fenix-experiments-old.json" [1]
+ wget -nv -O focus-experiments-old.json https://hg.mozilla.org/releases/mozilla-release/raw-file/default/mobile/android/focus-android/app/src/main/res/raw/initial_experiments.json
2025-05-01 08:26:56 URL:https://hg-edge.mozilla.org/releases/mozilla-release/raw-file/default/mobile/android/focus-android/app/src/main/res/raw/initial_experiments.json [17/17] -> "focus-experiments-old.json" [1]
+ /usr/bin/jq --arg APP_NAME fenix '{"data":map(select(.appName == $APP_NAME))}'
+ /usr/bin/jq --arg APP_NAME focus_android '{"data":map(select(.appName == $APP_NAME))}'
+ /usr/bin/diff -u fenix-experiments-old.json fenix-experiments-new.json
+ /usr/bin/diff -u focus-experiments-old.json focus-experiments-new.json
+ '[' -s /home/worker/artifacts/initial_experiments.diff ']'
+ return 0
+ MOBILE_EXPERIMENTS_UPDATED=true
+ '[' false == true ']'
+ '[' false == false ']'
+ '[' false == false ']'
+ '[' true == false ']'
+ '[' false == true ']'
+ COMMIT_MESSAGE='No Bug, mozilla-release repo-update'
+ '[' false == true ']'
+ '[' false == true ']'
+ '[' true == true ']'
+ COMMIT_MESSAGE='No Bug, mozilla-release repo-update remote-settings'
+ '[' false == true ']'
+ '[' true == true ']'
+ stage_mobile_experiments_files
+ cd /builds/worker
+ cp fenix-experiments-new.json mozilla-release/mobile/android/fenix/app/src/main/res/raw/initial_experiments.json
+ cp focus-experiments-new.json mozilla-release/mobile/android/focus-android/app/src/main/res/raw/initial_experiments.json
+ COMMIT_MESSAGE='No Bug, mozilla-release repo-update remote-settings mobile-experiments'
+ '[' false == true ']'
+ '[' false == true ']'
+ '[' false == true ']'
+ '[' true == true ']'
+ COMMIT_MESSAGE='No Bug, mozilla-release repo-update remote-settings mobile-experiments - a=repo-update'
+ '[' false == true ']'
+ /usr/bin/hg -R mozilla-release commit -u 'ffxbld <[e-mail]>' -m 'No Bug, mozilla-release repo-update remote-settings mobile-experiments - a=repo-update'
+ push_repo
+ '[' false == true ']'
+ cd mozilla-release
+ '[' '!' -r /builds/worker/.arcrc ']'
++ command -v arc
+ ARC=
++ command -v arcanist
+ ARC=/usr/bin/arcanist
+ '[' -z '#release-managers' ']'
++ /usr/bin/arcanist list
++ grep 'Needs Review'
++ grep -E 'mozilla-release repo-update'
++ awk 'match($0, /D[0-9]+[^: ]/) { print substr($0, RSTART, RLENGTH)  }'
+ /usr/bin/arcanist diff --verbatim --reviewers '#release-managers'
Linting...
No lint engine configured for this project.
Running unit tests...
No unit test engine is configured for this project.
 Exception 
RuntimeException: <differential.creatediff> array_walk_recursive() expects parameter 1 to be array, null given
(Run with `--trace` for a full exception trace.)
[taskcluster 2025-05-01 08:27:15.306Z] === Task Finished ===
[taskcluster 2025-05-01 08:27:15.323Z] Artifact "public/build/StaticHPKPins.h.diff" not found at "/home/worker/artifacts/StaticHPKPins.h.diff": (HTTP code 404) no such container - Could not find the file /home/worker/artifacts/StaticHPKPins.h.diff in container 73c96446bd53dbfc5a8141e0ca49024b74ae22f03fc8deec33962d4ed2d19202 
[taskcluster 2025-05-01 08:27:15.326Z] Artifact "public/build/nsSTSPreloadList.diff" not found at "/home/worker/artifacts/nsSTSPreloadList.diff": (HTTP code 404) no such container - Could not find the file /home/worker/artifacts/nsSTSPreloadList.diff in container 73c96446bd53dbfc5a8141e0ca49024b74ae22f03fc8deec33962d4ed2d19202 
[taskcluster 2025-05-01 08:27:15.514Z] Unsuccessful task run with exit code: 1 completed in 180.556 seconds

Comment 1

[Serban Stanca [:SerbanS]]

This started to fail on mozilla-release starting with this push.

Hi Julien, could you please take a look at this?

Thank you!

Comment 2

[Mark Banner (:standard8)]

:glandium mentioned on slack:

It's the same root problem as developers using moz-phab on a mercurial clone right now, which is that arcconfig points to the git repo.

In case it is an option, I just wanted to add the script does clone its own copy of the repository (there's bug 1905848 on file for changing that at some stage), and it does have support to use git (--use-git). We would have to update the clone_repo function, but in theory the rest should work.

I'm guessing it is probably better to fix the root issue, but I thought it might just be worth mentioning.

Adding bug 1963622 as being blocked by this as it needs the latest updates on mozilla-firefox to land.

Comment 3

[:glob ✱]

It is possible to retrigger this issue?

The array_walk_recursive() expects parameter 1 to be array, null given is a generic error thrown by, ironically, our error logging in Phabricator. It's masking the real error message.

We've temporarily disabled the problematic error logging, so the real error message should be returned on next run.

Comment 4

[Donal Meehan [:dmeehan]]

The release run is quick, I can trigger a run there now

Comment 5

[Donal Meehan [:dmeehan]]

:glob fyi
https://treeherder.mozilla.org/logviewer?job_id=506329705&repo=mozilla-release&lineNumber=2557

Exception
ERR-CONDUIT-CORE: <differential.creatediff> Local VCS (hg) is different from the one defined in the repository (git).
To use Phabricator with git-cinnabar please follow the docs at https://moz-conduit.readthedocs.io/en/latest/phabricator-user.html#using-git-cinnabar

Comment 6

[:glob ✱]

ty, looks like bug 1963766.

Comment 7

[Julien Cristau [:jcristau]]

This is working now:
https://treeherder.mozilla.org/jobs?repo=mozilla-release&searchStr=pfu&revision=cb71bb7401d5687c739672363369206a394ca145&selectedTaskRun=WbbrWMKyRXGIynGbzm8ttA.1

Comment 8

[Intermittent Failures Robot]

8 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 1
• mozilla-esr115: 1
• mozilla-esr128: 1
• mozilla-central: 1
• mozilla-release: 4

Table

	no_variant
linux64--/opt	8

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1963790&startday=2025-04-28&endday=2025-05-04&tree=all