1448748 - MinGW x64 NSS Fixes

Status: RESOLVED FIXED

(NSS :: Build, enhancement)

Description

[Tom Ritter [:tjr]]

Lots of missing functions errors; eventually fixed by the following. I know I need to prep a NSS patch for this, but looking for a go ahead with what I have attached before doing that.

Comment 1

[Tom Ritter [:tjr]]

Attachment: Bug 1448748 Disable a bunch of optimized stuff to fix the MinGW x64 Build f?franziskus

Review commit: https://reviewboard.mozilla.org/r/231086/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/231086/

Comment 2

[Franziskus Kiefer [:franziskus]]

Comment on attachment 8962240 [details]
Bug 1448748 Disable a bunch of optimized stuff to fix the MinGW x64 Build f?franziskus

https://reviewboard.mozilla.org/r/231086/#review236494

So I guess all the assembly doesn't work. But you'll probably want to keep `USE_HW_AES`.
You should also change the makefiles. I don't think anyone is using this target (gyp or make), but better to be consistent in both build systems.

::: security/nss/lib/freebl/freebl.gyp
(Diff revision 1)
>            'MP_IS_LITTLE_ENDIAN',
> -          'NSS_BEVAND_ARCFOUR',
> -          'MPI_AMD64',
> -          'MP_ASSEMBLY_MULTIPLY',
> -          'NSS_USE_COMBA',
> -          'USE_HW_AES',

Why do you want to disable hardware acceleration for AES?

Comment 3

[Tom Ritter [:tjr]]

(In reply to Franziskus Kiefer [:fkiefer or :franziskus] from comment #2)
> Comment on attachment 8962240 [details]
> Bug 1448748 Disable a bunch of optimized stuff to fix the MinGW x64 Build
> f?franziskus
> 
> https://reviewboard.mozilla.org/r/231086/#review236494
> 
> So I guess all the assembly doesn't work. But you'll probably want to keep
> `USE_HW_AES`.
> You should also change the makefiles. I don't think anyone is using this
> target (gyp or make), but better to be consistent in both build systems.
> 
> ::: security/nss/lib/freebl/freebl.gyp
> (Diff revision 1)
> >            'MP_IS_LITTLE_ENDIAN',
> > -          'NSS_BEVAND_ARCFOUR',
> > -          'MPI_AMD64',
> > -          'MP_ASSEMBLY_MULTIPLY',
> > -          'NSS_USE_COMBA',
> > -          'USE_HW_AES',
> 
> Why do you want to disable hardware acceleration for AES?

It doesn't work out of the box =/

> In file included from /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c:28:0:
> /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c: In function 'intel_AES_GCM_CreateContext':
> /builds/worker/workspace/build/src/mingw32/lib/gcc/x86_64-w64-mingw32/6.4.0/include/tmmintrin.h:136:1: error: inlining failed in call to always_inline '_mm_shuffle_epi8': target specific option mismatch
>  _mm_shuffle_epi8 (__m128i __X, __m128i __Y)
>  ^~~~~~~~~~~~~~~~
> /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c:123:5: note: called from here
>      _mm_storeu_si128((__m128i *)gcm->CTR, _mm_shuffle_epi8(_mm_add_epi32(ONE, _mm_shuffle_epi8(_mm_loadu_si128((__m128i *)gcm->CTR), BSWAP_MASK)), BSWAP_MASK));
>      ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> In file included from /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c:28:0:
> /builds/worker/workspace/build/src/mingw32/lib/gcc/x86_64-w64-mingw32/6.4.0/include/tmmintrin.h:136:1: error: inlining failed in call to always_inline '_mm_shuffle_epi8': target specific option mismatch
>  _mm_shuffle_epi8 (__m128i __X, __m128i __Y)
>  ^~~~~~~~~~~~~~~~
> /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c:123:5: note: called from here
>      _mm_storeu_si128((__m128i *)gcm->CTR, _mm_shuffle_epi8(_mm_add_epi32(ONE, _mm_shuffle_epi8(_mm_loadu_si128((__m128i *)gcm->CTR), BSWAP_MASK)), BSWAP_MASK));
>      ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> In file included from /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c:28:0:
> /builds/worker/workspace/build/src/mingw32/lib/gcc/x86_64-w64-mingw32/6.4.0/include/tmmintrin.h:136:1: error: inlining failed in call to always_inline '_mm_shuffle_epi8': target specific option mismatch
>  _mm_shuffle_epi8 (__m128i __X, __m128i __Y)
>  ^~~~~~~~~~~~~~~~
> /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c:123:5: note: called from here
>      _mm_storeu_si128((__m128i *)gcm->CTR, _mm_shuffle_epi8(_mm_add_epi32(ONE, _mm_shuffle_epi8(_mm_loadu_si128((__m128i *)gcm->CTR), BSWAP_MASK)), BSWAP_MASK));
>      ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> In file included from /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c:28:0:
> /builds/worker/workspace/build/src/mingw32/lib/gcc/x86_64-w64-mingw32/6.4.0/include/tmmintrin.h:136:1: error: inlining failed in call to always_inline '_mm_shuffle_epi8': target specific option mismatch
>  _mm_shuffle_epi8 (__m128i __X, __m128i __Y)
>  ^~~~~~~~~~~~~~~~
> /builds/worker/workspace/build/src/security/nss/lib/freebl/intel-gcm-wrap.c:123:5: note: called from here
>      _mm_storeu_si128((__m128i *)gcm->CTR, _mm_shuffle_epi8(_mm_add_epi32(ONE, _mm_shuffle_epi8(_mm_loadu_si128((__m128i *)gcm->CTR), BSWAP_MASK)), BSWAP_MASK));
>      ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Comment 4

[Franziskus Kiefer [:franziskus]]

Hm, I see. Well as I said I don't know of any mingw users so I'm fine with disabling all of this to make it build. Please add the makefile changes and upload an NSS patch.

Comment 5

[Tom Ritter [:tjr]]

I believe the Makefile already does the correct thing:

> ifdef NS_USE_GCC
> # Ideally, we should use amd64 assembly code, but it's not yet mingw-w64
> # compatible.

Comment 6

[Tom Ritter [:tjr]]

Attachment: mingw-x64-nss.patch

Comment 7

[Franziskus Kiefer [:franziskus]]

landed as https://hg.mozilla.org/projects/nss/rev/954032211d2d303bcee85f448f4db24bb8ec9a0c
Note that we don't use this anywhere, so there might be errors.

Comment 8

[Tom Ritter [:tjr]]

Can we land this in esr 60 now?

Comment 9

[Franziskus Kiefer [:franziskus]]

This landed in NSS 3.37. ESR 60 is on NSS 3.36 so we'd have make another point release for NSS 3.36. We can take this to ride along if there's another 3.36 point release.

Comment 10

[Tom Ritter [:tjr]]

Wanted to follow up on this and Bug 1389967 - has there been any movement in 3.36/esr so we can take these?  These two NSS patches are holding us back from getting both the old x64 and the new x86/x64 MinGW builds and tests running in TaskCluster...

Comment 11

[Franziskus Kiefer [:franziskus]]

There was another 3.36 point release not too long ago but this one wasn't picked up... It's on my list for the next one, which might happen soon.