1553572 - run test suites on windows 10 may 2019 release 1903

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: OpenCloudConfig, task)

Comment 1

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://github.com/mozilla-releng/OpenCloudConfig/commit/4c08fba

Comment 2

[Rob Thijssen [:grenade (EET/UTC+0300)]]

i was unable to disable windows defender on 1903, using the mechanism that has previously worked for us on 1803 (take ownership of the service state registry keys, set service state to disabled for wscsvc, SecurityHealthService, Sense, WdBoot, WdFilter, WdNisDrv, WdNisSvc, WinDefend). the step fails during the occ run and results in an incomplete ami.

today i have modified the iso-to-ami vhd creation process to mount the registry hive and set the services to disabled before the first windows setup boot. i am hoping that this results in an ami where windefend has been disabled before the instance first runs occ.

https://tools.taskcluster.net/groups/ADu-2wFxRZC92kXG3_xewA

Comment 3

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=b492b56&group_state=expanded

Comment 4

[Rob Thijssen [:grenade (EET/UTC+0300)]]

Attachment: unverified app warning

Q: do you know, or do you know someone who might know, how we can turn off this "unverified app" warning that shows up in tests on the 1903 win 10 release?

Comment 5

[Rob Thijssen [:grenade (EET/UTC+0300)]]

Attachment: mozilla-test-fail-screenshot_iyxii7.png

Comment 6

[Rob Thijssen [:grenade (EET/UTC+0300)]]

i tried setting registry key HKLM:\SOFTWARE\Microsoft\Windows\CurrentVersion\AppModelUnlock\AllowDevelopmentWithoutDevLicense, but the results were the same as without the setting. mochitest-e10s-1 & mochitest-e10s-4 show the same security key prompt as shown in the screenshot in comment 5.

Comment 7

[Rob Thijssen [:grenade (EET/UTC+0300)]]

attempting to disable this prompt by setting registry key: HKLM:\SOFTWARE\Policies\Microsoft\PassportForWork, value: Enabled to 0 after reading:

• https://feedback.azure.com/forums/169401-azure-active-directory/suggestions/17762902-allow-for-deactivating-windows-hello-and-set-up
• https://getadmx.com/HKLM/SOFTWARE/Policies/Microsoft/PassportForWork
• https://docs.microsoft.com/en-us/windows/client-management/mdm/passportforwork-csp

https://github.com/mozilla-releng/OpenCloudConfig/commit/75a1d3f

Comment 8

[Rob Thijssen [:grenade (EET/UTC+0300)]]

- https://treeherder.mozilla.org/#/jobs?repo=try&revision=d4c9e94&searchStr=mochitest-e10s-1
- https://treeherder.mozilla.org/#/jobs?repo=try&revision=d4c9e94&searchStr=mochitest-e10s-4

Comment 9

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

can we also install some japanese fonts (see bug 1258240):
Hmm, there is only the following document in MS:
https://docs.microsoft.com/en-US/typography/font-list/ms-pgothic

I think that you need to download it via Settings of Win10 due to the license matter.
[Settings] -> [Time & Language] -> [Language] -> [+ Add a preferred language] -> [Japanese] -> [Next] -> [Install]

But looks like that this installs CUAS (IMM emulator for TSF) into the environment too because of "Basic typing" is also installed. This means that we will not be able to test IME handlers with Win10 for non-CJK environments (it's installed only when user installs one of CJK language pack into Win10 or installs Win10 for CJK locale). However, such users' volume must be less than CJK users who see such fonts in daily use. So, I bet we should test it instead of IME test on non-CJK locale. (Anyway, our IME handler does not depend on so many things of locale difference.)

Comment 10

[Rob Thijssen [:grenade (EET/UTC+0300)]]

ok, it looks like setting HKLM:\SOFTWARE\Policies\Microsoft\PassportForWork\Enabled to 0 has worked for disabling the "making sure it's you" popup (d4c9e942811b was run against workers with the registry key set, the earlier two runs did not have the key set).

note that the tests (mochitest-e10s-1, mochitest-e10s-4) may still fail, but their respective screenshots no longer contain the Windows Security prompt to insert a security key.

EDIT: I spoke too soon. one of the tests still contains the popup: https://taskcluster-artifacts.net/Ou9W4TJvSIqHSfTzrK648A/0/public/test_info/mozilla-test-fail-screenshot_uwjerg.png

Comment 11

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=cfa4b7b8942c794a0e814f0c41b75fd66906775f

Comment 12

[Rob Thijssen [:grenade (EET/UTC+0300)]]

need to look in to clipboard issues and modify version checks that look for 10.0.17134 maybe use version >= "10.0.17134":

• https://mozilla.logbot.info/ci/20190529#c16352813-c16352840
• https://searchfox.org/mozilla-central/source/testing/web-platform/meta/dom/nodes/Document-createEvent.https.html.ini#34

Comment 13

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=ce1c39f86b91cdcc6c64b1a33604c1a9dfaffb21

Comment 14

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=c5a7ab1da229876f3d7c820a5fca3ca744edc093

Comment 15

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=288c13beb7169d8cc9c4be94b227c686b0ee6f52

Comment 16

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=68e80709d69fb4425bf50f893e7e8ffdcbfcb641

Comment 17

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=c4ed99d4f0744f60be813b6f7a3cc580eefddc1f

Comment 18

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=a62e6cd48a6b443a8dc8616bfa8728a66b10a70c

Comment 19

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=20ddf34793f94b2527a32e0fb4de498c713dff82

Comment 20

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=9e40fadef7e3421c150eb87d45321b4eec21a0cd

Comment 21

[Joel Maher ( :jmaher ) (UTC -8) (PTO back normal Nov 17)]

from win10/debug mochitest-4, I see:
https://taskcluster-artifacts.net/OLyJXCXpT-K_rffRmdHC2Q/0/public/test_info/mozilla-test-fail-screenshot_jdz24z.png

another verify this app message box.

same as bc1:
https://taskcluster-artifacts.net/Prqd7OWmRGq3GRIRNVe6rw/0/public/test_info/mozilla-test-fail-screenshot_46kn_v.png

Comment 22

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=d46d8f22b9bffde8b02dad1b4947637d7669f8b8

Comment 23

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=e45cad8128b62308ad4a7196c851e8f66ec0cd97

Comment 24

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=d51e746a3984380032e8af3d0050d1eb081501cc

Comment 25

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://github.com/mozilla-releng/OpenCloudConfig/commit/526b47cb12c2f0ca0bd7ae4d65dcc7e4bae4a752
https://treeherder.mozilla.org/#/jobs?repo=try&revision=3ac1b2ecc15ee0588afc3e7edc7430e3fa920f17

Comment 26

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://github.com/mozilla-releng/OpenCloudConfig/commit/9e7a41941dbd96b63a906848740df07ead2118b3
https://treeherder.mozilla.org/#/jobs?repo=try&revision=3e1214e0aa100be03701db6db8208c02bca77d00

Comment 27

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://github.com/mozilla-releng/OpenCloudConfig/commit/f7cce0430befa89d434a6ebf5981a4833df90fb7
https://treeherder.mozilla.org/#/jobs?repo=try&revision=197b6eae0b943e4793f0e199614d530d7d809fbf

Comment 28

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://github.com/mozilla-releng/OpenCloudConfig/commit/9d415b35eabce56bb1f6340df672044a95b2960b
https://treeherder.mozilla.org/#/jobs?repo=try&revision=8999bcde06ed62f385c2bc69dec614730cdbdb55

Comment 29

[Rob Thijssen [:grenade (EET/UTC+0300)]]

https://treeherder.mozilla.org/#/jobs?repo=try&revision=e54a1d55b10e756ac18c6fd3c7185f37c7b2ccae

Comment 30

[Rob Thijssen [:grenade (EET/UTC+0300)]]

testing a new ami with Base Filtering Engine (BFE) service disabled.
this ami is likely to be problematic because microsoft have disabled the windows start button (https://social.technet.microsoft.com/Forums/en-US/357316d7-c066-4708-9197-bf755c72ad6e/start-menu-wont-open-with-windows-firewall-service-off?forum=win10itprogeneral) when this service is not running.
the purpose of this test is to see if bfe is responsible for the popup shown in the attached png.
https://treeherder.mozilla.org/#/jobs?repo=try&revision=01db100593875e8de3a819e1d9793506ea41099e

edit:
that was a bust. bfe is not what is triggering the popup:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=01db100593875e8de3a819e1d9793506ea41099e&selectedJob=258461847&searchStr=windows%2C10%2Cx64%2Copt%2Cmochitests%2Ctest-windows10-64%2Fopt-mochitest-e10s-4%2Cm%284%29
https://queue.taskcluster.net/v1/task/KIbJkKWsR3qRh-1Q0Fl6wg/runs/0/artifacts/public/test_info/mozilla-test-fail-screenshot_gcqgvf.png

Comment 31

[Rob Thijssen [:grenade (EET/UTC+0300)]]

the microsoft advice was to enable developer mode.
the instructions for enabling developer mode through the registry are at: https://docs.microsoft.com/en-us/windows/uwp/get-started/enable-your-device-for-development
testing now...
https://github.com/mozilla-releng/OpenCloudConfig/commit/e28477b
https://tools.taskcluster.net/tasks/KTm7kSUaQ6yn3pnHTkGe1Q

Comment 32

[Rob Thijssen [:grenade (EET/UTC+0300)]]

it turns out we already had developer mode enabled on these so we can already say this doesn't solve our problem.

Comment 33

[Q]

After trying to fake federated connections to avoid this I had the thought "are we testing this feature explicitly ?". If not can we turn off the security.webauth.u2f feature ? I assume given that 1903 is the first OS to support these features officially and Firefox recently turned this on by default this is why we are seeing this popup.

Comment 34

[Rob Thijssen [:grenade (EET/UTC+0300)]]

Attachment: Bug 1553572 - deploy win10 1903 beta amis to ec2 r=jmaher

Comment 35

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/ci/ci-configuration/rev/e1f837f088bc
deploy win10 1903 beta amis to ec2 r=jmaher

Comment 36

[Rob Thijssen [:grenade (EET/UTC+0300)]]

Attachment: Bug 1553572 - test win10 v2004 on beta r=jmaher

Comment 37

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/ci/ci-configuration/rev/792e05dc25d1
test win10 v2004 on beta r=jmaher