1980465 - Certificate compression in selfserv / tstclnt not working on s390x (big-endian)

Status: RESOLVED FIXED

(NSS :: Tools, defect)

Description

[asosedkin]

User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:141.0) Gecko/20100101 Firefox/141.0

Steps to reproduce:

Compiled nss 3.112 certificate and found its certificate compression not interoperable with gnutls, openssl and tlsfuzzer (https://github.com/tlsfuzzer/tlsfuzzer/blob/master/scripts/test-tls13-certificate-verify.py)

Actual results:

I was handshake_failure alerts when NSS tried to compress a cert, apparently due to compression output being 0 bytes after what I believe is a problematic cast on the second parameter of zlib's compress().

Expected results:

Certificate compression should interoperate with the other implementations.

Comment 1

[asosedkin]

Attachment: Bug 1980465 - Fix a big-endian-problematic cast in zlib calls. r=fkrenzel

Comment 2

[Anna Weine]

https://hg-edge.mozilla.org/projects/nss/rev/5cd6a78cccd3e47d5097d1266bc809bb910fa019

Comment 3

[msirringhaus]

Should this be uplifted to the ESR version? Looks like the same code there.