Closed Bug 1809927 Opened 3 years ago Closed 3 years ago

socorro deploy: 2023.01.12

Categories

(Socorro :: Infra, task, P2)

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: willkg, Assigned: willkg)

Details

We want to do a deploy for socorro tagged 2023.01.12.

It consists of the following:

4f9fc2b: bug 1791208: fix socorro to work with docker compose > 2 (willkg)
c50f5c1: bug 1791208: update circleci image versions (willkg)
0e79fc7: bug 1791208: fix docker compose build output to be less spammy (willkg)
c1ed671: Bump charset-normalizer from 2.0.12 to 3.0.1 (from PR #6270) (dependabot[bot])
ac17b3e: Bump cryptography from 37.0.4 to 38.0.4 (from PR #6271) (dependabot[bot])
8519f42: Bump urllib3 from 1.26.11 to 1.26.13 (from PR #6272) (dependabot[bot])
d44124d: Bump certifi from 2021.10.8 to 2022.12.7 (from PR #6288) (dependabot[bot])
2e44271: Bump wheel from 0.37.1 to 0.38.1 (from PR #6290) (dependabot[bot])
61134ee: Fix requirements.txt file (willkg)
f9f194f: Update dependencies (willkg)
47f8c78: Update run_verify_reqs to strip extras (willkg)
13dce18: Update python docker image and wheel (willkg)
870081c: bug 1808406: rewrite cache decorated methods in ESCrashStorage (willkg)
d70ca04: bug 1808406: rewrite cache decorated methods in CopyFromRawCrashRule (willkg)
5d5e7d9: bug 1808406: rewrite cache decorated methods in ESConnectionContext (willkg)
5fce1b7: bug 1808406: rewrite RawCrash.public_keys() caching (willkg)
239062e: bug 1808592: remove c/c/models.py:get_api_allowlist() (willkg)
2487dbc: bug 1808593: rewrite c/s/models.py get_api_allowlist (willkg)
ca4e65e: bug 1808594: remove measure_fetches (willkg)
a9b5d4c: bug 1808594: change default cache expiration to 5 minutes (willkg)
3ca41e1: bug 1808595: stop caching RawCrash and ProcessedCrash data (willkg)
48d5e5e: Add hash for an empty minidump to minidump_sha256_hash description (willkg)
834c6af: Bug 1806107 - Improve Linux shutdown hang signatures (gabrielesvelto)
6e2e173: bug 1806119: add nsQueryObject<T>::operator to irrelevant list (willkg)
dd8518c: bug 1803808: fix wrapping for field examples (willkg)
b2aca7f: bug 1795700: update raw crash schema docs (willkg)
c24a657: bug 1795700: document processed crash schema maintenance (willkg)
5a5651c: bug 1795700: add note about checking the data dictionary (willkg)
fcf52da: bug 1795700: switch to using code-block (willkg)
5df8e73: bug 1803558: add nickname for pattern_properties (willkg)
1020b9a: bug 1803558: fix example data in schemas (willkg)
3d02358: bug 1803558: support nested data structures in data dictionary (willkg)
2c7ad47: bug 1803558: switch objectfield to clearer name: objectname (willkg)
7563d62: bug 1803558: remove obvious comments (willkg)
5fc30bb: bug 1795700: document "default" property (willkg)
e82b022: bug 1803033: add json_dump_crash_info instruction and memory_accesses (willkg)
c1ca3cf: Switch to f-strings in productlib.py (willkg)
06ca334: bug 1809238: drop nip.io (willkg)
53d1cb3: bug 1807956: truncate stacks in processor (willkg)
6e2db81: bug 1807956: remove truncation in the webapp (willkg)
4b3bb72: bug 1807956: add a processor note when truncating stacks (willkg)
523074f: bug 1809728: implement processor_history (willkg)
9fa5b65: Bug 1809847 - Add rust enum methods and others to the list of irrelevant functio (gabrielesvelto)
d574f1f: Add --date=thisweek to fetch_crashids script (willkg)

Tagged 2023.01.12:

tag 2023.01.12
Tagger: Will Kahn-Greene <willkg@mozilla.com>
Date:   Thu Jan 12 11:23:18 2023 -0500

Tag 2023.01.12 (bug #1809927)

`4f9fc2b`: bug 1791208: fix socorro to work with docker compose > 2 (willkg)
`c50f5c1`: bug 1791208: update circleci image versions (willkg)
`0e79fc7`: bug 1791208: fix docker compose build output to be less spammy (willkg)
`c1ed671`: Bump charset-normalizer from 2.0.12 to 3.0.1 (from PR #6270) (dependabot[bot])
`ac17b3e`: Bump cryptography from 37.0.4 to 38.0.4 (from PR #6271) (dependabot[bot])
`8519f42`: Bump urllib3 from 1.26.11 to 1.26.13 (from PR #6272) (dependabot[bot])
`d44124d`: Bump certifi from 2021.10.8 to 2022.12.7 (from PR #6288) (dependabot[bot])
`2e44271`: Bump wheel from 0.37.1 to 0.38.1 (from PR #6290) (dependabot[bot])
`61134ee`: Fix requirements.txt file (willkg)
`f9f194f`: Update dependencies (willkg)
`47f8c78`: Update run_verify_reqs to strip extras (willkg)
`13dce18`: Update python docker image and wheel (willkg)
`870081c`: bug 1808406: rewrite cache decorated methods in ESCrashStorage (willkg)
`d70ca04`: bug 1808406: rewrite cache decorated methods in CopyFromRawCrashRule (willkg)
`5d5e7d9`: bug 1808406: rewrite cache decorated methods in ESConnectionContext (willkg)
`5fce1b7`: bug 1808406: rewrite RawCrash.public_keys() caching (willkg)
`239062e`: bug 1808592: remove c/c/models.py:get_api_allowlist() (willkg)
`2487dbc`: bug 1808593: rewrite c/s/models.py get_api_allowlist (willkg)
`ca4e65e`: bug 1808594: remove measure_fetches (willkg)
`a9b5d4c`: bug 1808594: change default cache expiration to 5 minutes (willkg)
`3ca41e1`: bug 1808595: stop caching RawCrash and ProcessedCrash data (willkg)
`48d5e5e`: Add hash for an empty minidump to minidump_sha256_hash description (willkg)
`834c6af`: Bug 1806107 - Improve Linux shutdown hang signatures (gabrielesvelto)
`6e2e173`: bug 1806119: add nsQueryObject<T>::operator to irrelevant list (willkg)
`dd8518c`: bug 1803808: fix wrapping for field examples (willkg)
`b2aca7f`: bug 1795700: update raw crash schema docs (willkg)
`c24a657`: bug 1795700: document processed crash schema maintenance (willkg)
`5a5651c`: bug 1795700: add note about checking the data dictionary (willkg)
`fcf52da`: bug 1795700: switch to using code-block (willkg)
`5df8e73`: bug 1803558: add nickname for pattern_properties (willkg)
`1020b9a`: bug 1803558: fix example data in schemas (willkg)
`3d02358`: bug 1803558: support nested data structures in data dictionary (willkg)
`2c7ad47`: bug 1803558: switch objectfield to clearer name: objectname (willkg)
`7563d62`: bug 1803558: remove obvious comments (willkg)
`5fc30bb`: bug 1795700: document "default" property (willkg)
`e82b022`: bug 1803033: add json_dump_crash_info instruction and memory_accesses (willkg)
`c1ca3cf`: Switch to f-strings in productlib.py (willkg)
`06ca334`: bug 1809238: drop nip.io (willkg)
`53d1cb3`: bug 1807956: truncate stacks in processor (willkg)
`6e2db81`: bug 1807956: remove truncation in the webapp (willkg)
`4b3bb72`: bug 1807956: add a processor note when truncating stacks (willkg)
`523074f`: bug 1809728: implement processor_history (willkg)
`9fa5b65`: Bug 1809847 - Add rust enum methods and others to the list of irrelevant functio (gabrielesvelto)
`d574f1f`: Add --date=thisweek to fetch_crashids script (willkg)

Deploy bug #1809927
-----BEGIN PGP SIGNATURE-----

iQEzBAABCgAdFiEEzY3I6/E2Vh8o9nPoGL3RpvBm7BEFAmPAM/YACgkQGL3RpvBm
7BF++gf/U20cwGkOmUO4Smyt25dfxqiZgx/PZkfBpBrGkcbPucchH9UceYaWMs12
oPYN/0EXpciakS+zwal1cJxWmDB8t+eoQf6/4zgRjdKG6X+Vs3teHSxaIs6bQgbV
Hg38vjpD6CuZZC2cHfvrzfwFOSwr78qxKLsOwA/qF8wV8fJslHF8E8RgAxizXabN
1/Z3ttw9bErogtfJB0QXOf5ritA3vepGGhb1EQPH/y7PP1XBavIXyAKc/9EFzDj7
rrFrVLPSowFHmqH+HgRlmxcFeH+rFJ9TerG1Olz44jeG6rUtIRvqxF/PrCL3+CEl
aLgEd6sR6MwGZyaakr6Wr324ZoQvrA==
=aAHi
-----END PGP SIGNATURE-----

commit d574f1fc969a554dbaada601daf1af47d884adf1
Author: Will Kahn-Greene <willkg@mozilla.com>
Date:   Thu Jan 12 09:36:40 2023 -0500

    Add --date=thisweek to fetch_crashids script
    
    While doing this, I converted the script to use f-strings.

I checked sentry and grafana. The deploy looks good.

This makes big changes to what and how the webapp caches things to elasticache. We should keep an eye on the elasticache and webapp view timing graphs over the next few days to see what improved and what regressed.

This adds a processor rule to truncate egregious stacks. After landing this on stage, I kept track of how many crash reports were affected. In the time it was on stage, we saw:

  • total crash reports: 6,940
  • crash reports with stacks truncated: 112
Status: ASSIGNED → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED

The configuration change for bug #1560176 went out with this deploy, too.

You need to log in before you can comment on or make changes to this bug.