Here is my summary of the bug discussions: Opportunity: - Improve Nightly quality (Get more people to test Nightly through the snap distribution) - Improve snap package quality (Get more people test the snap packaging) Cost: - Per comment 3 it adds another variable to testing which won't be replicated in mozregressionmore testing - Per comment 1 this would require releng work (a new build with a different configuration) Comments: - Nightly is biased towards Linux with over 7.2% of nightly population on Linux VS 4.6% of release population on Linux (https://sql.telemetry.mozilla.org/queries/68974/source#174114) - if representativity is the goal on nightly then it does not seem needed to have more Linux users compared to other OS - It's hard for me to assess value of having more people testing snap builds on Nightly without data on snap - do we have data on downloads, DAU or share of Linux users through the snap package? We're considering adding telemetry (distribution_id) for the flatpak to help understand volumes of users. Summary: The main value seems to be around improving the snap package quality although a comment referred to snap packaging issues not being frequent and we also don't seem to have data on snap usage to assess the user base that could be impacted. Without more data on snap Firefox user base I'd recommend not prioritizing this work that does not seem to provide enough value to balance the QA and releng work necessary.
Bug 1451694 Comment 8 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
Here is my summary of the bug discussions: Opportunity: - Improve Nightly quality (Get more people to test Nightly through the snap distribution) - Improve snap package quality (Get more people test the snap packaging) Cost: - Per comment 3 it adds another variable to testing which won't be replicated in mozregressionmore testing - Per comment 1 this would require releng work (a new build with a different configuration) Comments: - Nightly is biased towards Linux with over 7.2% of nightly population on Linux VS 4.6% of release population on Linux (https://sql.telemetry.mozilla.org/queries/68974/source#174114) - if representativity is the goal on nightly then it does not seem needed to have more Linux users compared to other OS - It's hard for me to assess value of having more people testing snap builds on Nightly without data on snap - do we have data on downloads, DAU or share of Linux users through the snap package? We're considering adding telemetry (distribution_id) for the flatpak to help understand volumes of users. Summary: The main value seems to be around improving the snap package quality although a comment referred to snap packaging issues not being frequent and we also don't seem to have data on snap usage to assess the user base that could be impacted. Without more data on snap Firefox user base I'd recommend not prioritizing this work that does not seem to provide enough value to balance the QA and releng work necessary.