Closed Bug 1261045 Opened 9 years ago Closed 9 years ago

remove unused stuff [WAS: linux32, macosx-64 builds using MOZ_SYMBOLS_EXTRA_BUILDID=linux64]

Categories

(Taskcluster :: Services, defect)

Product:
Taskcluster
Component:
Services
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: dustin, Assigned: dustin)

References

Details

Attachments

(3 files)

MozReview Request: Bug 1261045: remove MOZ_SYMBOLS_EXTRA_BUILDID for andriod from beta/aurora/releases; r?jlund
58 bytes, text/x-review-board-request
jlund
: review+
Details
MozReview Request: Bug 1261045: remove unused MOZ_SYMBOLS_EXTRA_BUILDID; r?ted.mielczarek
58 bytes, text/x-review-board-request
ted
: review+
Details
MozReview Request: Bug 1261045: remove unused SYMBOL_SERVER_*; r?ted.mielczarek
58 bytes, text/x-review-board-request
ted
: review+
Details
https://dxr.mozilla.org/mozilla-central/source/testing/taskcluster/scripts/builder/build-linux.sh#38 export MOZ_SYMBOLS_EXTRA_BUILDID=linux64 I have no idea what that does, but I'm guessing it's wrong. Also pretty easy to fix. I'll try to find a parallel in Buildbot-land.
I see this set in buildbot-configs: > mozilla/config.py: 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64', > mozilla/config.py: 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', > mozilla/config.py: 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-tsan', > mozilla/config.py: 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan-debug', > mozilla/config.py: 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-st-an-debug', > mozilla/config.py: 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64', > mozilla/config.py: 'MOZ_SYMBOLS_EXTRA_BUILDID': 'macosx64', > mozilla/config.py: 'MOZ_SYMBOLS_EXTRA_BUILDID': 'win64', > mozilla/config.py:BRANCHES['mozilla-central']['platforms']['android-x86']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-x86' > mozilla/config.py:BRANCHES['mozilla-central']['platforms']['android-api-9']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-9' > mozilla/config.py:BRANCHES['mozilla-central']['platforms']['android-api-15']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-15' > mozilla/config.py:BRANCHES['mozilla-release']['platforms']['android-x86']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-x86' > mozilla/config.py:BRANCHES['mozilla-release']['platforms']['android-api-9']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-9' > mozilla/config.py:BRANCHES['mozilla-release']['platforms']['android-api-11']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-11' > mozilla/config.py:BRANCHES['mozilla-release']['platforms']['android-api-15']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-15' > mozilla/config.py:BRANCHES['mozilla-beta']['platforms']['android-x86']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-x86' > mozilla/config.py:BRANCHES['mozilla-beta']['platforms']['android-api-9']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-9' > mozilla/config.py:BRANCHES['mozilla-beta']['platforms']['android-api-11']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-11' > mozilla/config.py:BRANCHES['mozilla-beta']['platforms']['android-api-15']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-15' > mozilla/config.py:BRANCHES['mozilla-aurora']['platforms']['android-api-9']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-9' > mozilla/config.py:BRANCHES['mozilla-aurora']['platforms']['android-api-11']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-11' > mozilla/config.py:BRANCHES['mozilla-aurora']['platforms']['android-api-15']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-15' > mozilla/config.py:BRANCHES['mozilla-aurora']['platforms']['android-x86']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-x86' > mozilla/config.py: BRANCHES[branch]['platforms']['linux']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = branch > mozilla/config.py: BRANCHES[branch]['platforms']['android-api-9']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-9-' + branch > mozilla/config.py: BRANCHES[branch]['platforms']['android-api-11']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-11-' + branch > mozilla/config.py: BRANCHES[branch]['platforms']['android-api-15']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-api-15-' + branch > mozilla/config.py: BRANCHES[branch]['platforms']['android-x86']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'android-x86-' + branch > mozilla/config.py: BRANCHES[branch]['platforms']['linux64']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'linux64-' + branch > mozilla/config.py: BRANCHES[branch]['platforms']['win32']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = branch > mozilla/config.py: BRANCHES[branch]['platforms']['macosx64']['env']['MOZ_SYMBOLS_EXTRA_BUILDID'] = 'macosx64-' + branch and some confusing special-casing in mozharness: 951 def _query_moz_symbols_buildid(self): 952 # this is a bit confusing but every platform that make 953 # uploadsymbols may or may not include a 954 # MOZ_SYMBOLS_EXTRA_BUILDID in the env and the value of this 955 # varies. 956 # logic goes: 957 # If it's the release branch, we only include it for 958 # 64bit platforms and we use just the platform as value. 959 # If it's a project branch off m-c, we include only the branch 960 # for the value on 32 bit platforms and we include both the 961 # platform and branch for 64 bit platforms 962 c = self.config 963 moz_symbols_extra_buildid = '' 964 if c.get('use_platform_in_symbols_extra_buildid'): 965 moz_symbols_extra_buildid += self.stage_platform 966 if c.get('use_branch_in_symbols_extra_buildid'): 967 if moz_symbols_extra_buildid: 968 moz_symbols_extra_buildid += '-%s' % (self.branch,) 969 else: 970 moz_symbols_extra_buildid = self.branch 971 return moz_symbols_extra_buildid 1627 def build(self): ... 1632 if symbols_extra_buildid: 1633 env['MOZ_SYMBOLS_EXTRA_BUILDID'] = symbols_extra_buildid so basically, this can come from any number of confusing places in buildbot-configs, but be overridden by mozharness in some other cases. I admit that buildbot-configs triggers a flight response in my subconscious. Ted, is there some rhyme or reason to the expected outcome here that I could try to replicate either by pepping up mozharness so that it just sets it correctly, or by setting it in each task description? Or should I just pretend I never noticed this and back away slowly?
Flags: needinfo?(ted)
We can just remove this. It was added to avoid name collisions back when we were uploading files to NFS, but now everything goes through the Socorro symbol upload API which records the list of uploaded files anyway.
Flags: needinfo?(ted)
OK, so I can remove it from build-linux.sh for sure. Should I also remove it from mozharness and buildbot-configs?
Yes, that's fine. It's not doing anything useful anywhere nowadays. Related: SYMBOL_SERVER_{HOST,SSH_KEY,USER_PATH} and POST_SYMBOL_UPLOAD_COMMAND are all vestigial as well!
Summary: linux32, macosx-64 builds using MOZ_SYMBOLS_EXTRA_BUILDID=linux64 → remove unused stuff [WAS: linux32, macosx-64 builds using MOZ_SYMBOLS_EXTRA_BUILDID=linux64]
Jordan, note that I didn't touch the release repos since there were TODO comments about future ESRs (46). However, if you think it's safe to clean those out too, I'm all for it. Alternately, if I've cleaned out too much, let me know.
Attachment #8737201 - Flags: review?(jlund) → review+
Comment on attachment 8737201 [details] MozReview Request: Bug 1261045: remove MOZ_SYMBOLS_EXTRA_BUILDID for andriod from beta/aurora/releases; r?jlund https://reviewboard.mozilla.org/r/43799/#review40455 \o/
Comment on attachment 8737238 [details] MozReview Request: Bug 1261045: remove unused MOZ_SYMBOLS_EXTRA_BUILDID; r?ted.mielczarek https://reviewboard.mozilla.org/r/43833/#review40645 Whee!
Attachment #8737238 - Flags: review?(ted) → review+
Comment on attachment 8737239 [details] MozReview Request: Bug 1261045: remove unused SYMBOL_SERVER_*; r?ted.mielczarek https://reviewboard.mozilla.org/r/43835/#review40647 This was all obsoleted by the dependencies of bug 1071724, FYI. Specifically bug 1085557 switched the Firefox builders.
Attachment #8737239 - Flags: review?(ted) → review+
Comment on attachment 8737201 [details] MozReview Request: Bug 1261045: remove MOZ_SYMBOLS_EXTRA_BUILDID for andriod from beta/aurora/releases; r?jlund checked in
leaving open to try landing the same change for the release branches
Keywords: leave-open
Comment on attachment 8737201 [details] MozReview Request: Bug 1261045: remove MOZ_SYMBOLS_EXTRA_BUILDID for andriod from beta/aurora/releases; r?jlund Review request updated; see interdiff: https://reviewboard.mozilla.org/r/43799/diff/1-2/
Attachment #8737201 - Attachment description: MozReview Request: Bug 1261045: remove symobl-server configuration; r?jlund → MozReview Request: Bug 1261045: remove MOZ_SYMBOLS_EXTRA_BUILDID for andriod from beta/aurora/releases; r?jlund
Comment on attachment 8737201 [details] MozReview Request: Bug 1261045: remove MOZ_SYMBOLS_EXTRA_BUILDID for andriod from beta/aurora/releases; r?jlund mozreview didn't "get it" here despite my using a different bookmark and an different mozreview id. Anyway, please have a look at this additional patch!
Attachment #8737201 - Flags: review+ → review?(jlund)
Comment on attachment 8737201 [details] MozReview Request: Bug 1261045: remove MOZ_SYMBOLS_EXTRA_BUILDID for andriod from beta/aurora/releases; r?jlund I _think_ it looks good. If I am seeing what I am supposed to, this is similar but you found some stray MOZ_SYMBOLS_EXTRA_BUILDID uses? or is this from a different branch?
Attachment #8737201 - Flags: review?(jlund) → review+
It's the same branch, but these apply to mozilla-{aurora,beta,release}, and I wasn't sure that the code changes to no longer require this information had already ridden the trains out that far. So yes, pretty similar, just less confident it's right.
Well, the server those variables refer to has shuffled off this mortal coil, so I can say with great confidence that those variables are not doing anything useful.
Thanks all :)
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Depends on: 1263402
Removing leave-open keyword from resolved bugs, per :sylvestre.
Keywords: leave-open
Component: Integration → Services
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: