1630391 - Update expiry of accessibility telemetry for zoom, backplate, and HCM scalars.

Morgan Reschenberg [:morgan]

Assignee

Description

•

5 years ago

Zoom should be removed from telem, and backplate and HCM theme should be "forever"ed

Morgan Reschenberg [:morgan]

Assignee

Updated

•

5 years ago

Assignee: nobody → mreschenberg

Morgan Reschenberg [:morgan]

Assignee

Comment 1

•

5 years ago

unsure if this should be in telemetry component instead but I'm just... gonna do it rn.

James Teh [:Jamie]

Comment 2

•

5 years ago

We may get pushback on "forever" for HCM, in which case we can go with whatever max they suggest.

Generally, I think bugs for telemetry probes go in the module they're associated with, even though the actual probes are configured in the telemetry module. In other words, this is the right bug component.

Morgan Reschenberg [:morgan]

Assignee

Comment 3

•

5 years ago

Attached file Backplate Telemetry Extension Request (obsolete) — Details

Attachment #9141042 - Flags: data-review?(chutten)

Morgan Reschenberg [:morgan]

Assignee

Comment 4

•

5 years ago

Attached file HCM Theme Telemetry Extension Request (obsolete) — Details

Attachment #9141043 - Flags: data-review?(chutten)

Chris H-C :chutten

Updated

•

5 years ago

Attachment #9141042 - Flags: data-review?(chutten)

Chris H-C :chutten

Comment 5

•

5 years ago

Comment on attachment 9141043 [details] HCM Theme Telemetry Extension Request Unfortunately you cannot use the short form to extend an expiry to "never" as it has no place on which to ensure that an individual is going to be responsible for the metric over its permanent lifespan. You will need to resubmit this review request using the full form. Also, it is considered best practice to include a regression test for permanent collections to ensure they don't break in their extended lifespan. [TelemetryTestUtils.jsm](https://searchfox.org/mozilla-central/source/toolkit/components/telemetry/tests/utils/TelemetryTestUtils.jsm) is a helpful module for writing such tests.

Flags: needinfo?(mreschenberg)

Attachment #9141043 - Flags: data-review?(chutten)

Morgan Reschenberg [:morgan]

Assignee

Comment 6

•

5 years ago

(In reply to Chris H-C :chutten from comment #5)

Comment on attachment 9141043 [details]
HCM Theme Telemetry Extension Request

Unfortunately you cannot use the short form to extend an expiry to "never"
as it has no place on which to ensure that an individual is going to be
responsible for the metric over its permanent lifespan. You will need to
resubmit this review request using the full form.

Also, it is considered best practice to include a regression test for
permanent collections to ensure they don't break in their extended lifespan.
[TelemetryTestUtils.jsm](https://searchfox.org/mozilla-central/source/
toolkit/components/telemetry/tests/utils/TelemetryTestUtils.jsm) is a
helpful module for writing such tests.

Can you link me to an example of a regression test for an existing permanent collection? I'm not sure I understand what the test is meant to do :(
I'll re-do those forms :)

Flags: needinfo?(mreschenberg) → needinfo?(chutten)

Chris H-C :chutten

Comment 7

•

5 years ago

Let's see, devtools has some for events: https://firefox-source-docs.mozilla.org/devtools/frontend/telemetry.html#testing-event-telemetry

And here's one that tests a Scalar: https://searchfox.org/mozilla-central/rev/3446310d6cc5c85cde16a82eccf560e9b71a3d44/browser/components/search/test/unit/test_urlTelemetry.js#180

Essentially the idea behind tests involving Telemetry is:

Perform the action that may collect data
Check using functions from TelemetryTestUtils that the data was collected properly (is/isn't present, has the expected value, etc.)

Flags: needinfo?(chutten)

Morgan Reschenberg [:morgan]

Assignee

Comment 8

•

5 years ago

Attached file Bug 1630391: Add telemetry test for backplate and a11y theme scalars. r=chutten,yzen — Details

Morgan Reschenberg [:morgan]

Assignee

Comment 9

•

5 years ago

Attached file Backplate Telemetry Request — Details

Attachment #9141042 - Attachment is obsolete: true

Attachment #9142783 - Flags: data-review?(chutten)

Morgan Reschenberg [:morgan]

Assignee

Comment 10

•

5 years ago

Attached file HCM Telemetry Request — Details

Attachment #9141043 - Attachment is obsolete: true

Attachment #9142785 - Flags: data-review?(chutten)

Morgan Reschenberg [:morgan]

Assignee

Comment 11

•

5 years ago

Comment on attachment 9142783 [details] Backplate Telemetry Request > ># Request for data collection review form (Backplate) > >1) What questions will you answer with this data? > >* This telemetry will help us measure how many users (if any) switch backplate from on to off. > >2) Why does Mozilla need to answer these questions? Are there benefits for users? Do we need this information to address product or business requirements? > >* Backplate is a large change to how Firefox does high-contrast mode, and we're interested in seeing if users would rather use our old HCM over this new version. This will help us prioritise HCM work, specifically backplate follow-up bugs. > >3) What alternative methods did you consider to answer these questions? Why were they not sufficient? > >* We have a current telemetry probe measuring our baseline number of HCM users, but this probe does not take into account the backplate change. It is not sufficient to use this existing probe because, although backpalte HCM will replace default HCM, the change is controled by a seperate preference which is not logged in the exisitng probe. This means users switching from backplate HCM to "regular" HCM would not be visible to us. > >4) Can current instrumentation answer these questions? > >* No > >5) List all proposed measurements and indicate the category of data collection for each measurement, using the Firefox [data collection categories](https://wiki.mozilla.org/Firefox/Data_Collection) on the Mozilla wiki: > ><table> > <tr> > <td>Measurement Description</td> > <td>Data Collection Category</td> > <td>Tracking Bug #</td> > </tr> > <tr> > <td>Does the user have the permitBackplate pref enabled?</td> > <td>Category 2</td> > <td>1539212</td> > </tr> ></table> > > >6) How long will this data be collected? > >* Until backplate work is finished; I want to permanently monitor this data. (Morgan Reschenberg, mreschenberg@mozilla.com) > >7) What populations will you measure? > >* Which release channels? ALL > >* Which countries? ALL > >* Which locales? ALL > >8) If this data collection is default on, what is the opt-out mechanism for users? > >* The regular Firefox telemetry opt out option. > >9) Please provide a general description of how you will analyze this data. > >* We are interested in seeing how our existing HCM user population numbers compare to our backplate HCM user population numbers gathered by this probe. Specifically: we want to know if this change causes a significant drop/spike in the number of users using HCM. >* We're also interested in seeing if users would rather use our current old HCM. > >10) Where do you intend to share the results of your analysis? > >* Within the Accessibility and Layout teams. > >11) Is there a third-party tool (i.e. not Telemetry) that you are proposing to use for this data collection? > >* No >

Chris H-C :chutten

Comment 12

•

5 years ago

Comment on attachment 9142785 [details] HCM Telemetry Request DATA COLLECTION REVIEW RESPONSE: Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate? Yes. This collection is Telemetry so is documented in its definitions file [Scalars.yaml](https://hg.mozilla.org/mozilla-central/file/tip/toolkit/components/telemetry/Scalars.yaml) and the [Probe Dictionary](https://telemetry.mozilla.org/probe-dictionary/). Is there a control mechanism that allows the user to turn the data collection on and off? Yes. This collection is Telemetry so can be controlled through Firefox's Preferences. If the request is for permanent data collection, is there someone who will monitor the data over time? Yes, Morgan Reschenberg is responsible. Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under? Category 2, Interaction. Is the data collection request for default-on or default-off? Default on for all channels. Does the instrumentation include the addition of any new identifiers? No. Is the data collection covered by the existing Firefox privacy notice? Yes. Does there need to be a check-in in the future to determine whether to renew the data? No. This collection is permanent. --- Result: datareview+

Attachment #9142785 - Flags: data-review?(chutten) → data-review+

Chris H-C :chutten

Comment 13

•

5 years ago

Comment on attachment 9142783 [details] Backplate Telemetry Request DATA COLLECTION REVIEW RESPONSE: Is there or will there be documentation that describes the schema for the ultimate data set available publicly, complete and accurate? Yes. This collection is Telemetry so is documented in its definitions file [Scalars.yaml](https://hg.mozilla.org/mozilla-central/file/tip/toolkit/components/telemetry/Scalars.yaml) and the [Probe Dictionary](https://telemetry.mozilla.org/probe-dictionary/). Is there a control mechanism that allows the user to turn the data collection on and off? Yes. This collection is Telemetry so can be controlled through Firefox's Preferences. If the request is for permanent data collection, is there someone who will monitor the data over time? Yes, Morgan Reschenberg is responsible. Using the category system of data types on the Mozilla wiki, what collection type of data do the requested measurements fall under? Category 2, Interaction. Is the data collection request for default-on or default-off? Default on for all channels. Does the instrumentation include the addition of any new identifiers? No. Is the data collection covered by the existing Firefox privacy notice? Yes. Does there need to be a check-in in the future to determine whether to renew the data? No. This collection is permanent. --- Result: datareview+

Attachment #9142783 - Flags: data-review?(chutten) → data-review+

Morgan Reschenberg [:morgan]

Assignee

Comment 14

•

5 years ago

Attached file Bug 1630391: Remove zoom telemetry, extend backplate and theme to 80. — Details

Pulsebot

Comment 15

•

5 years ago

Pushed by mreschenberg@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/613cf14725fe Remove zoom telemetry, extend backplate and theme to 80. r=yzen

Andreea Pavel [:apavel]

Comment 17

•

5 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/613cf14725fe

Status: NEW → RESOLVED

Closed: 5 years ago

status-firefox77: --- → fixed

Resolution: --- → FIXED

Target Milestone: --- → Firefox 77

Phabricator Automation

Updated

•

5 years ago

Attachment #9142780 - Attachment description: Bug 1630391: Add telemetry test for backplate and a11y theme scalars. r=chutten → Bug 1630391: Add telemetry test for backplate and a11y theme scalars. r=chutten,yzen

Pulsebot

Comment 18

•

5 years ago

Pushed by mreschenberg@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/c15ccd143f32 Add telemetry test for backplate and a11y theme scalars. r=chutten,yzen

Natalia Csoregi [:nataliaCs]

Comment 19

•

5 years ago

Backed out for failures on browser_HCM_telemetry.js

backout: https://hg.mozilla.org/integration/autoland/rev/bf91e9e8455eda80299902401c930f085e85b002

push: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&revision=c15ccd143f3267081423ac6f59e5341918e344a9&selectedTaskRun=Nx7L1zHfQ6GfdZbmY0RZug-0

tier 1 firstly appeared failure: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&revision=6700a8dfaeb1e303955acc05dabd245b9ae3c97e&test_paths=browser_hcm_telemetry.js&selectedTaskRun=dcg0dkwKSL20_jFp-7Q3yQ-0

failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=305714007&repo=autoland&lineNumber=1399

[task 2020-06-09T23:21:38.800Z] 23:21:38 INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | Overlay is visible -
[task 2020-06-09T23:21:38.800Z] 23:21:38 INFO - found chrome://browser/skin/preferences/preferences.css
[task 2020-06-09T23:21:38.800Z] 23:21:38 INFO - found chrome://global/skin/in-content/common.css
[task 2020-06-09T23:21:38.800Z] 23:21:38 INFO - found chrome://browser/skin/preferences/dialog.css
[task 2020-06-09T23:21:38.800Z] 23:21:38 INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | All expectedStyleSheetURLs should have been found -
[task 2020-06-09T23:21:38.800Z] 23:21:38 INFO - Buffered messages finished
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | HCM menulist should be set to never on startup - Got 0, expected 1
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - Stack trace:
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - chrome://mochikit/content/browser-test.js:test_is:1327
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - chrome://mochitests/content/browser/accessible/tests/browser/telemetry/browser_HCM_telemetry.js:testIsNever:59
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1064
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1104
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:927
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:918
[task 2020-06-09T23:21:38.801Z] 23:21:38 INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | a11y.theme must be recorded. - true == true -

Flags: needinfo?(mreschenberg)

Morgan Reschenberg [:morgan]

Assignee

Updated

•

5 years ago

Flags: needinfo?(mreschenberg)

Pulsebot

Comment 20

•

5 years ago

Pushed by mreschenberg@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/b1ea583f8cb8 Add telemetry test for backplate and a11y theme scalars. r=chutten,yzen

Bogdan Tara[:bogdan_tara | bogdant]

Comment 21

•

5 years ago

Backed out changeset b1ea583f8cb8 (bug 1630391) for browser_HCM_telemetry.js failures

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&selectedTaskRun=Rp8eW04OTx-Lzcwjfe6k2g-0&fromchange=b1ea583f8cb86bf703b37e0f6bbee151e9a85c1a&tochange=1a5b8a1f2abc54eddaf4ef9e9caf3c77397b7af6&searchStr=mochitest

Backout link: https://hg.mozilla.org/integration/autoland/rev/1a5b8a1f2abc54eddaf4ef9e9caf3c77397b7af6

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=305856179&repo=autoland&lineNumber=2606

[task 2020-06-10T21:24:36.612Z] 21:24:36     INFO - TEST-START | accessible/tests/browser/telemetry/browser_HCM_telemetry.js
[task 2020-06-10T21:24:36.612Z] 21:24:36     INFO - GECKO(5884) | Chrome file doesn't exist: Z:\task_1591823789\build\tests\mochitest\browser\accessible\tests\browser\telemetry\head.js
[task 2020-06-10T21:24:36.632Z] 21:24:36     INFO - GECKO(5884) | [Child 6368: Main Thread]: I/DocShellAndDOMWindowLeak ++DOCSHELL 000001CCC659DC00 == 1 [pid = 6368] [id = {2bf810e2-8f57-4a3f-a095-6d5596a9c356}]
[task 2020-06-10T21:24:36.632Z] 21:24:36     INFO - GECKO(5884) | [Child 6368: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 1 (000001CCC651B090) [pid = 6368] [serial = 1] [outer = 0000000000000000]
[task 2020-06-10T21:24:36.632Z] 21:24:36     INFO - GECKO(5884) | [Child 6368: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 2 (000001CCC7175400) [pid = 6368] [serial = 2] [outer = 000001CCC651B090]
[task 2020-06-10T21:24:36.721Z] 21:24:36     INFO - GECKO(5884) | [Child 6368: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 3 (000001CCC7175800) [pid = 6368] [serial = 3] [outer = 000001CCC651B090]
[task 2020-06-10T21:24:36.731Z] 21:24:36     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOCSHELL 000001A04545E400 == 6 [pid = 7468] [id = {e707d096-f1bf-41f0-a0c5-355b90aa5217}]
[task 2020-06-10T21:24:36.731Z] 21:24:36     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 14 (000001A03B6CF6A0) [pid = 7468] [serial = 14] [outer = 0000000000000000]
[task 2020-06-10T21:24:36.741Z] 21:24:36     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 15 (000001A045464400) [pid = 7468] [serial = 15] [outer = 000001A03B6CF6A0]
[task 2020-06-10T21:24:36.820Z] 21:24:36     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 16 (000001A04546C400) [pid = 7468] [serial = 16] [outer = 000001A03B6CF6A0]
[task 2020-06-10T21:24:36.845Z] 21:24:36     INFO - GECKO(5884) | [Parent 7468, Main Thread] WARNING: NS_ENSURE_TRUE(aIndex < Length()) failed: file /builds/worker/checkouts/gecko/docshell/shistory/nsSHistory.cpp, line 1049
[task 2020-06-10T21:24:36.870Z] 21:24:36     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 17 (000001A04546AC00) [pid = 7468] [serial = 17] [outer = 000001A03B6CF6A0]
[task 2020-06-10T21:24:37.072Z] 21:24:37     INFO - GECKO(5884) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to c:\users\task_1591823789\appdata\local\temp\tmpt4zzli.mozrunner\runtests_leaks_tab_pid6364.log
[task 2020-06-10T21:24:37.072Z] 21:24:37     INFO - GECKO(5884) | [6364, Main Thread] WARNING: XPCOM_MEM_BLOAT_LOG is set, disabling native allocations.: file /builds/worker/checkouts/gecko/tools/profiler/core/platform.cpp, line 243
[task 2020-06-10T21:24:37.192Z] 21:24:37     INFO - GECKO(5884) | [Parent 7468, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80004005 (NS_ERROR_FAILURE): file /builds/worker/checkouts/gecko/dom/base/nsContentUtils.cpp, line 3734
[task 2020-06-10T21:24:37.192Z] 21:24:37     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOCSHELL 000001A0482D3800 == 7 [pid = 7468] [id = {47638403-5b2a-4b35-b787-f9ac19e4fd8b}]
[task 2020-06-10T21:24:37.192Z] 21:24:37     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 18 (000001A03B6CFFB0) [pid = 7468] [serial = 18] [outer = 0000000000000000]
[task 2020-06-10T21:24:37.211Z] 21:24:37     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOCSHELL 000001A04996D400 == 8 [pid = 7468] [id = {11e7a522-2e13-41a1-93a6-c41e7617b4df}]
[task 2020-06-10T21:24:37.211Z] 21:24:37     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 19 (000001A03B6D0A90) [pid = 7468] [serial = 19] [outer = 0000000000000000]
[task 2020-06-10T21:24:37.485Z] 21:24:37     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 20 (000001A049A18400) [pid = 7468] [serial = 20] [outer = 000001A03B6CFFB0]
[task 2020-06-10T21:24:37.495Z] 21:24:37     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 21 (000001A045465400) [pid = 7468] [serial = 21] [outer = 000001A03B6D0A90]
[task 2020-06-10T21:24:38.510Z] 21:24:38     INFO - GECKO(5884) | [Parent 7468, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80040111 (NS_ERROR_NOT_AVAILABLE): file /builds/worker/checkouts/gecko/netwerk/cache/nsApplicationCacheService.cpp, line 180
[task 2020-06-10T21:24:38.779Z] 21:24:38     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOCSHELL 000001A04AC8C000 == 9 [pid = 7468] [id = {a1968b2c-8a3a-4f1b-ada8-bb9c6ffa7a19}]
[task 2020-06-10T21:24:38.779Z] 21:24:38     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 22 (000001A0450774D0) [pid = 7468] [serial = 22] [outer = 0000000000000000]
[task 2020-06-10T21:24:38.858Z] 21:24:38     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 23 (000001A04E9DC800) [pid = 7468] [serial = 23] [outer = 000001A0450774D0]
[task 2020-06-10T21:24:38.924Z] 21:24:38     INFO - GECKO(5884) | [Parent 7468: Main Thread]: I/DocShellAndDOMWindowLeak ++DOMWINDOW == 24 (000001A0406EBC00) [pid = 7468] [serial = 24] [outer = 000001A03B6D0A90]
[task 2020-06-10T21:24:39.045Z] 21:24:39     INFO - GECKO(5884) | [Parent 7468, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80004005 (NS_ERROR_FAILURE): file /builds/worker/checkouts/gecko/dom/base/nsContentUtils.cpp, line 3734
[task 2020-06-10T21:24:39.334Z] 21:24:39     INFO - TEST-INFO | started process screenshot
[task 2020-06-10T21:24:39.421Z] 21:24:39     INFO - TEST-INFO | screenshot: exit 0
[task 2020-06-10T21:24:39.422Z] 21:24:39     INFO - Buffered messages logged at 21:24:36
[task 2020-06-10T21:24:39.422Z] 21:24:39     INFO - Entering test bound testInit
[task 2020-06-10T21:24:39.423Z] 21:24:39     INFO - Buffered messages logged at 21:24:37
[task 2020-06-10T21:24:39.423Z] 21:24:39     INFO - Console message: [JavaScript Error: "[Exception... "Component returned failure code: 0x80520001 (NS_ERROR_FILE_UNRECOGNIZED_PATH) [nsIXPCComponents_Utils.readUTF8URI]"  nsresult: "0x80520001 (NS_ERROR_FILE_UNRECOGNIZED_PATH)"  location: "JS frame :: resource://gre/modules/L10nRegistry.jsm :: L10nRegistry.loadSync :: line 658"  data: no]"]
[task 2020-06-10T21:24:39.424Z] 21:24:39     INFO - L10nRegistry.loadSync@resource://gre/modules/L10nRegistry.jsm:658:19
[task 2020-06-10T21:24:39.424Z] 21:24:39     INFO - fetchFile@resource://gre/modules/L10nRegistry.jsm:573:31
[task 2020-06-10T21:24:39.424Z] 21:24:39     INFO - generateResourceSetSync/<@resource://gre/modules/L10nRegistry.jsm:478:19
[task 2020-06-10T21:24:39.424Z] 21:24:39     INFO - generateResourceSetSync@resource://gre/modules/L10nRegistry.jsm:473:22
[task 2020-06-10T21:24:39.424Z] 21:24:39     INFO - generateResourceSetsForLocaleSync@resource://gre/modules/L10nRegistry.jsm:415:44
[task 2020-06-10T21:24:39.425Z] 21:24:39     INFO - generateBundlesSync@resource://gre/modules/L10nRegistry.jsm:177:7
[task 2020-06-10T21:24:39.425Z] 21:24:39     INFO - touchNext@resource://gre/modules/Localization.jsm:167:37
[task 2020-06-10T21:24:39.425Z] 21:24:39     INFO - generateBundles@resource://gre/modules/Localization.jsm:473:15
[task 2020-06-10T21:24:39.425Z] 21:24:39     INFO - getLanguageDisplayNames@resource://gre/modules/mozIntl.jsm:810:19
[task 2020-06-10T21:24:39.425Z] 21:24:39     INFO - getLocaleDisplayNames/<@resource://gre/modules/mozIntl.jsm:888:14
[task 2020-06-10T21:24:39.425Z] 21:24:39     INFO - getLocaleDisplayNames@resource://gre/modules/mozIntl.jsm:867:24
[task 2020-06-10T21:24:39.425Z] 21:24:39     INFO - displayUseSystemLocale@chrome://browser/content/preferences/main.js:1382:43
[task 2020-06-10T21:24:39.425Z] 21:24:39     INFO - init@chrome://browser/content/preferences/main.js:363:10
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - init@chrome://browser/content/preferences/preferences.js:69:22
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - async*init_category_if_required@chrome://browser/content/preferences/preferences.js:46:23
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - gotoPref@chrome://browser/content/preferences/preferences.js:231:11
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - init_all@chrome://browser/content/preferences/preferences.js:113:3
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - EventListener.handleEvent*@chrome://browser/content/preferences/preferences.js:75:10
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - 
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - Console message: [JavaScript Error: "[Exception... "Component returned failure code: 0x80520001 (NS_ERROR_FILE_UNRECOGNIZED_PATH) [nsIXPCComponents_Utils.readUTF8URI]"  nsresult: "0x80520001 (NS_ERROR_FILE_UNRECOGNIZED_PATH)"  location: "JS frame :: resource://gre/modules/L10nRegistry.jsm :: L10nRegistry.loadSync :: line 658"  data: no]"]
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - L10nRegistry.loadSync@resource://gre/modules/L10nRegistry.jsm:658:19
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - fetchFile@resource://gre/modules/L10nRegistry.jsm:573:31
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - generateResourceSetSync/<@resource://gre/modules/L10nRegistry.jsm:478:19
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - generateResourceSetSync@resource://gre/modules/L10nRegistry.jsm:473:22
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - generateResourceSetsForLocaleSync@resource://gre/modules/L10nRegistry.jsm:415:44
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - generateBundlesSync@resource://gre/modules/L10nRegistry.jsm:177:7
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - touchNext@resource://gre/modules/Localization.jsm:167:37
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - generateBundles@resource://gre/modules/Localization.jsm:473:15
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - getRegionDisplayNames@resource://gre/modules/mozIntl.jsm:837:19
[task 2020-06-10T21:24:39.426Z] 21:24:39     INFO - getLocaleDisplayNames/<@resource://gre/modules/mozIntl.jsm:897:16
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - getLocaleDisplayNames@resource://gre/modules/mozIntl.jsm:867:24
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - displayUseSystemLocale@chrome://browser/content/preferences/main.js:1382:43
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - init@chrome://browser/content/preferences/main.js:363:10
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - init@chrome://browser/content/preferences/preferences.js:69:22
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - async*init_category_if_required@chrome://browser/content/preferences/preferences.js:46:23
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - gotoPref@chrome://browser/content/preferences/preferences.js:231:11
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - init_all@chrome://browser/content/preferences/preferences.js:113:3
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - EventListener.handleEvent*@chrome://browser/content/preferences/preferences.js:75:10
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - 
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - Buffered messages logged at 21:24:39
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | Check the proper URL is loaded - 
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | Element should not be null, when checking visibility - 
[task 2020-06-10T21:24:39.427Z] 21:24:39     INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | Overlay is visible - 
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - found chrome://browser/skin/preferences/preferences.css
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - found chrome://global/skin/in-content/common.css
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - found chrome://browser/skin/preferences/dialog.css
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | All expectedStyleSheetURLs should have been found - 
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | HCM menulist should be set to only with HCM theme on startup for windows - 
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - TEST-PASS | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | a11y.theme must be recorded. - true == true - 
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - Buffered messages finished
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | a11y.theme must contain the 'deafult' key. - false == true - JS frame :: resource://testing-common/TelemetryTestUtils.jsm :: assertKeyedScalar :: line 43
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - Stack trace:
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - resource://testing-common/TelemetryTestUtils.jsm:assertKeyedScalar:43
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - chrome://mochitests/content/browser/accessible/tests/browser/telemetry/browser_HCM_telemetry.js:testInit:66
[task 2020-06-10T21:24:39.428Z] 21:24:39     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1064
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1104
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:927
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:918
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - Not taking screenshot here: see the one that was previously logged
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - TEST-UNEXPECTED-FAIL | accessible/tests/browser/telemetry/browser_HCM_telemetry.js | a11y.theme['deafult'] must contain the expected value - "undefined" == false - JS frame :: resource://testing-common/TelemetryTestUtils.jsm :: assertKeyedScalar :: line 47
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - Stack trace:
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - resource://testing-common/TelemetryTestUtils.jsm:assertKeyedScalar:47
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - chrome://mochitests/content/browser/accessible/tests/browser/telemetry/browser_HCM_telemetry.js:testInit:66
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1064
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1104
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:927
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:918
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - GECKO(5884) | [Parent 7468, Main Thread] WARNING: '!inner', file /builds/worker/checkouts/gecko/dom/ipc/JSWindowActorProtocol.cpp, line 172
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - GECKO(5884) | [Parent 7468, Main Thread] WARNING: '!inner', file /builds/worker/checkouts/gecko/dom/ipc/JSWindowActorProtocol.cpp, line 172
[task 2020-06-10T21:24:39.429Z] 21:24:39     INFO - Leaving test bound testInit
...

Flags: needinfo?(mreschenberg)

Pulsebot

Comment 22

•

5 years ago

Pushed by mreschenberg@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/3fefa1d023a6 Add telemetry test for backplate and a11y theme scalars. r=chutten,yzen

Morgan Reschenberg [:morgan]

Assignee

Updated

•

5 years ago

Flags: needinfo?(mreschenberg)

Narcis Beleuzu [:NarcisB]

Comment 23

•

5 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/3fefa1d023a6

:Gijs (away/busy until Mar 10)

Updated

•

5 years ago

Depends on: 1654672

James Teh [:Jamie]

Updated

•

1 year ago

Duplicate of this bug: 1634223

Backplate Telemetry Extension Request 5 years ago Morgan Reschenberg [:morgan] 551 bytes, text/plain		Details
HCM Theme Telemetry Extension Request 5 years ago Morgan Reschenberg [:morgan] 720 bytes, text/plain		Details
Bug 1630391: Add telemetry test for backplate and a11y theme scalars. r=chutten,yzen 5 years ago Morgan Reschenberg [:morgan] 47 bytes, text/x-phabricator-request		Details \| Review
Backplate Telemetry Request 5 years ago Morgan Reschenberg [:morgan] 2.72 KB, text/plain	chutten : data-review+	Details
HCM Telemetry Request 5 years ago Morgan Reschenberg [:morgan] 2.55 KB, text/plain	chutten : data-review+	Details
Bug 1630391: Remove zoom telemetry, extend backplate and theme to 80. 5 years ago Morgan Reschenberg [:morgan] 47 bytes, text/x-phabricator-request		Details \| Review