1177264 - [meta] Performance 2015 Q3 Sprint

Status: RESOLVED FIXED

(developer.mozilla.org Graveyard :: Code Cleanup, defect)

Description

[Luke Crouch [:groovecoder]]

Tracking bug for performance improvements.

Comment 1

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/e99e507601d639159c6fbd1a2e277a57b69febf3
bug 1177264 - use doc.get_contributors in document view

https://github.com/mozilla/kuma/commit/0e8f6a24f113f15a2ff30cf77fa7c1a6c8e6fe52
Merge pull request #3280 from groovecoder/doc-contributors-perf-1177264

bug 1177264 - use doc.get_contributors in document view

Comment 2

[MDN Team (:mdn-dev)]

Commit pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/71b38da279010a36fad65a4b7b266ed3da8de0f8
Bug 1177264 - Stop querying contributors twice.

Comment 3

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/e0fd6355839ff8034b73dbfb89c6dd5c76cb0958
bug 1177264 - combine doc get_absolute_url calls

https://github.com/mozilla/kuma/commit/78f293dd98f0c89fa7ef09cb1d26ea7f587517a1
bug 1177264 - remove extra get_contributors call

https://github.com/mozilla/kuma/commit/8795d34d3aff5eb2a51c5f442c1bf1b764b88f06
bug 1177264 - consolidate calls for other_translations

https://github.com/mozilla/kuma/commit/81a1b5fca8f2e75b0f5e6adfaa425eb7dc24f967
bug 1177264 - "dumb" wiki urls experiment

https://github.com/mozilla/kuma/commit/51cbf4c45a1791b954c675d6e7b9dfb5cb420750
Merge pull request #3284 from groovecoder/optimize-document-html-1177264

bug 1177264 - Optimize (some more) of document.html rendering

Comment 4

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/37b32064ffa5c9ffb55cacf6fcd213a6849289b4
bug 1177264 - use other_translations cache property

https://github.com/mozilla/kuma/commit/fc0a993320df81d39a8351592dccfada9a8d7a5d
Merge pull request #3298 from mozilla/optimize-document-html-1177264

bug 1177264 - use other_translations cache property

Comment 5

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/2e32120cfbd1cd1b2251a1e3af261f7cffc97c1d
Bug 1177264 - Remove un-used teamwork app.

Signed-off-by: Jannis Leidel <[e-mail]>

https://github.com/mozilla/kuma/commit/9f300d8bc61dbca979ffb8f63158b5b70c3cc7d3
Merge pull request #3305 from mozilla/optimize-document-html-1177264

Bug 1177264 - Remove un-used teamwork app.

Comment 6

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/54f08b1c910130ffa10743b40cd04e9a562e3f0f
Bug 1177264 - Simplify wiki_url template helper.

This also removes the dumb_wiki_urls waffle flag introduced in 81a1b5fca8f2e75b0f5e6adfaa425eb7dc24f967.

https://github.com/mozilla/kuma/commit/96e85d8d451aff1678dc5d6643ad37e5b953d1ed
Bug 1177264 - Use a few more get_absolute_url() calls instead of manually building the URLs.

https://github.com/mozilla/kuma/commit/a9ae8306ac83260f5dc005b3a774c266eba28c4d
Merge pull request #3323 from mozilla/bug1177264

Remove dumb_wiki_urls flag and simplify wiki_url helper.

Comment 7

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/b2ec1b4595764bd5a6d6523b80f99a46e59b08c6
Bug 1177264 - Use memcache for django-product-details.

https://github.com/mozilla/kuma/commit/93b0f664151c58e9b5495e4f2eccc636a043bfdc
Merge pull request #3324 from mozilla/bug1177264-2

Bug 1177264 - Use memcache for django-product-details.

Comment 8

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/8d707fa26935cb316d49a00013a56f85223af0f3
Revert "Bug 1177264 - Use memcache for django-product-details."

This reverts commit b2ec1b4595764bd5a6d6523b80f99a46e59b08c6.

https://github.com/mozilla/kuma/commit/ad1980505b9d68719d4156f8b2ae133401d4da7b
Merge pull request #3326 from mozilla/revert-bug1177264-2

Revert "Bug 1177264 - Use memcache for django-product-details."

Comment 9

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/b91ff23a846bb2ba481acf284be06c265528b445
Bug 1177264 - Stop LANGUAGES_DICT being populated on every request.

This should stop the intense memory/memcache usage.

This was basically code laziness gone wrong. Instead we'll populate the mapping now once per process as a global module variable and leave it there until we redeploy at which we run the product_details update management command anyway.

Also get rid of a few old and unused settings.

https://github.com/mozilla/kuma/commit/48ac924ae743e46b4a6091c0a55495677f98b69c
Merge pull request #3328 from mozilla/bug1177264-3

Bug 1177264 - Stop LANGUAGES_DICT being populated on every request.

Comment 10

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/558f23a1c9ddd653d5938573fcb220cacb724c39
bug 1177264 - waffle switch for dumb doc urls

https://github.com/mozilla/kuma/commit/1e65aad60549f0833d76946b15150e45990c88fa
Merge pull request #3331 from mozilla/optimize-document-html-1177264

bug 1177264 - waffle switch for dumb doc urls

Comment 11

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/6125c48ef38e1394529520f7b06a506754baf412
bug 1177264 - make dumb_doc_urls change permanent

https://github.com/mozilla/kuma/commit/08a22ffa0c5cd88f2f011816559df83e26ac6d05
Merge pull request #3338 from mozilla/optimize-document-html-1177264

bug 1177264 - make dumb_doc_urls change permanent

r=jezdez

Comment 12

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/93f14fda954a3603b0938e595a9574185633960e
Bug 1177264 - Cache the available search filters much longer.

That should reduce the db queries a notch.

https://github.com/mozilla/kuma/commit/b0f6ce9751d637670695caa80f5303e626ba126b
Merge pull request #3350 from mozilla/bug1177264-4

Bug 1177264 - Cache the available search filters much longer.

Comment 13

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/fda9016e96c8f0d612163c7ef4a7c072bb28c5d2
bug 1177264 - remove extra tags.exists() check

https://github.com/mozilla/kuma/commit/766e6cbaaa789aa17dc1ea8625b223a3d315e780
Merge pull request #3377 from mozilla/document-tags-exists-check-1177264

bug 1177264 - remove extra tags.exists() check (1.1% of app server time)

Comment 14

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/c470933d92e3bda0282bde9e0acec79d327c963e
bug 1177264 - remove search_filters context processor

The logic of the search_filters context processor is only needed on the home
page where search suggestions are shown.

https://github.com/mozilla/kuma/commit/bff43192fa5866402bc5e09d4fef5a0bdc6338b7
Merge pull request #3376 from mozilla/search-suggestions-home-1177264

bug 1177264 - remove search_filters context processor (12.8% of app server time)

Comment 16

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/eef61169effdf51ec799e116735d3058110d104c
bug 1177264 - optimize zone root summary display

https://github.com/mozilla/kuma/commit/9ebc11e7508edb4e0a8f22bfa86a6b5029426799
Merge pull request #3457 from mozilla/optimize-summary-1177264

bug 1177264 - optimize zone root summary display

Comment 17

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/b9825f59fcc10315d8ea1978071a7186510216db
bug 1177264 - remove dirtiness_tracking flag

https://github.com/mozilla/kuma/commit/611b278144c008072ec7750f54131888fdc1800f
bug 1177264 - remove fellowship waffle flag

https://github.com/mozilla/kuma/commit/f0f66d7f21b4ea595171e68815bf7204a0b09848
bug 1177264 - remove search_explanation flag

https://github.com/mozilla/kuma/commit/22900e5aff098f489d09db3bbcf987db7fc30f0d
bug 1177264 - remove wiki_spellcheck flag

https://github.com/mozilla/kuma/commit/d5ccd9b36354345f1170ad99890a82edd01a5706
bug 1177264 - remove top_contributors flag

https://github.com/mozilla/kuma/commit/3224ee572d7b86f07ebc4bf80496ac06864ef7e6
bug 1177264 - remove redirect_messages flag

https://github.com/mozilla/kuma/commit/074d735eaa0cb99d3a4f5ee5757c35c04e5bcba5
Merge pull request #3458 from mozilla/waffle-cleanup-1177264

bug 1177264 - waffle cleanups

Comment 18

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/06df0f554f0174c8fcc6641494ac01659acbf574
bug 1177264 - prefetch_related revision creators

bug 1177264 - prefetch docs and user bans

bug 1177264 - only query userbans for superusers

https://github.com/mozilla/kuma/commit/a4086b137dc6093b82400d13b74a9382d032c2e8
bug 1177264 - remove superfluous count query

https://github.com/mozilla/kuma/commit/f423a3a47f7a92df2caf6d891eabf3cb26d2e5ba
Merge pull request #3468 from mozilla/revisions-feed-optimization-1177264

bug 1177264 - Revision dashboard optimizations

r=jwhitlock

Comment 19

[MDN Team (:mdn-dev)]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/546d1490f30c1dbd16dd90c239d7b084e522ec33
bug 1177264 - measure dashboard pagination usage

https://github.com/mozilla/kuma/commit/750653264273e888c3ae967c53b45df38ef5117c
Merge pull request #3652 from mozilla/measure-dashboard-pagination-usage-1177264

bug 1177264 - measure dashboard pagination usage

Comment 20

[John Whitlock [:jwhitlock]]

Good work, let's call the 2015 performance sprint done.