Open Bug 1922844 Opened 4 months ago Updated 3 months ago

Izenpe: Not allowed Qualifier ID OID on Certificate Policies extension of Precertificates

Categories

(CA Program :: CA Certificate Compliance, task)

Tracking

(Not tracked)

ASSIGNED

People

(Reporter: d-fernandez, Assigned: d-fernandez)

Details

(Whiteboard: [ca-compliance])

This is a preliminary report related to bug 1921254 and 1876565. As Chris Clements has pointed in bug 1921254, there were some certificates
that were not revoked in bug 1876565.
Analyzing them, we see that these are precertificates that were not finally issued.
In bug 1876565 we failed to consider the precertificates and only focused on those which were issued.
This is the list of those precerficates that were not revoked (still alive).
All of them have been revoked today.

Issued CRT.SH link
2023/10/06 14:45 https://crt.sh/?serial=5DA99D76E49567A56520016D24DB8D5B
2023/10/06 14:46 https://crt.sh/?serial=6EAEBADF5C9E882465200189655AE0DB
2023/10/11 12:51 https://crt.sh/?serial=6B6B9611FD8B474565267E4278895116
2023/10/17 10:35 https://crt.sh/?serial=6398C1A35A5C5B04652E473A49DEB794
2023/10/17 10:36 https://crt.sh/?serial=3F00C4C7C8E460E2652E47740361234D
2023/10/17 10:36 https://crt.sh/?serial=388D64EF59B2B756652E479435143137
2023/10/17 10:38 https://crt.sh/?serial=524165AB65D08B44652E47F0943DE00C
2023/11/02 15:37 https://crt.sh/?serial=4BBC1F26090351836543A6097938C22C
2023/11/02 15:39 https://crt.sh/?serial=1D11327297CD41F96543A684B99BDEB2
2023/11/02 15:45 https://crt.sh/?serial=2CC9800C84BE4DDF6543A7F1C3940931
2023/11/02 16:55 https://crt.sh/?serial=01270FC6F7BAA14B6543B858473BCA51
2023/11/03 09:49 https://crt.sh/?serial=7E362A7966390B6544A5FA4BFFDF88
2023/11/03 12:13 https://crt.sh/?serial=022D70BEDA3610326544C7E44B616181
2023/11/03 12:14 https://crt.sh/?serial=721252C0FF40351A6544C80AD951A577
2023/11/09 10:40 https://crt.sh/?serial=2DD775800BBF929A654C9AF314994133
2023/11/14 17:29 https://crt.sh/?serial=682B688A3AC1433D6553926798F9B259
2023/11/14 17:37 https://crt.sh/?serial=6EE677C19E9825BB6553941D730B217E
2023/11/14 17:43 https://crt.sh/?serial=6142BF3676900F86655395A340293966
2023/11/15 09:40 https://crt.sh/?serial=47DDB7CCEA240AC8655475DD1960A9E5
2023/11/15 11:35 https://crt.sh/?serial=3C2B3784CF179FA4655490DD86961E8E
2023/11/15 11:40 https://crt.sh/?serial=043E9291DCB7003C655491F75600B865
2023/11/15 12:02 https://crt.sh/?serial=1DEE86D41A1FAFCC6554973AF3E35573
2023/11/17 13:09 https://crt.sh/?serial=4AAD9F9F142A2199655749EB5FEB3C16
2023/11/20 10:31 https://crt.sh/?serial=379C55E1FCFC2EA0655B197603998592
2023/11/20 12:14 https://crt.sh/?serial=3D7C1540FAD2E4AB655B3194B9062B86
2023/11/20 15:18 https://crt.sh/?serial=59D6A1EB85C21060655B5CBC597832CE
2023/11/20 17:18 https://crt.sh/?serial=68E15BDD4AC7024B655B78AA83C43E30
2023/11/20 17:19 https://crt.sh/?serial=1CC485E434CFC7A2655B78E70CD0969C
2023/11/20 17:19 https://crt.sh/?serial=654ECE716C8648F5655B791F048F7E4F
2023/11/20 17:21 https://crt.sh/?serial=4C65EBD4B680B989655B798A40271D37
2023/11/20 17:23 https://crt.sh/?serial=4D1925E9BDC96712655B79F9000AC6CF

Hi David,

I'm not sure if the above list should be considered complete.

For example, https://crt.sh/?id=10411995529&opt=pkimetal (serial=1f005a487d316f8b6507f6fb35eff354) does not appear in the above list, or https://bug1876565.bmoattachments.org/attachment.cgi?id=9376477 - but seems to present the same problematic practices as those described in Comment 9 of Bug 1921254.

Can you please describe the approach used to establish the set of affected certificates, and why the above entry was missed (and, if there are any additional entries missing)?

Thanks
Ryan

Flags: needinfo?(d-fernandez)

Incident Report

Summary

In Bug 1876565 we revoked all the certificates issued since 2023/09/15 to 2024/01/25 as they had been missued because they were including a qualifier ID on Certificate Policies extension.
In BUG 1921254, Ben Wilson pointed that some certificates from [Bug 1876565] were not still revoked. After identifying them, we revoked then, but there were some certificates that had not been revoked yet.

All the certificates that had not been included in the list of Bug 1876565 had in common that none of then were finally issued,
they were submitted to some of the CT logs but, due to a problem (misconfigured CT server, network issues, delay on receiving the answer) they were not finally issued.
As the precertificates must be considered a binding commitment by the CA as stated in CABFORUM (7.1.2.9), this a violation of the BRs and they must had been revoked when the Bug 1876565 was opened.

Impact

There has not been any impact as these certificates have never been delivered to clients.

Timeline

2024-01-25: - Bug 1876565 opened. Published the list of certificates affected by this issue.

2024-01-30: - All certificates of Bug 1876565 were revoked.

2024-10-03: - In BUG 1921254 it was pointed that some certificates, regarding Bug 1876565 were still alive and had not been revoked.

2024-10-04: - 14:16 - We found out that all the certificates that had not been revoked, were precertificates that had not been issued. We gathered the list of precertificates affected that were still alive, and revoked then.

2024-10-07: - 11:18 - In the previous list, we made a mistake, and considered only certificates issued in the last 12 months, and not 13 months as we issue them. Two more certificates came up in this review and have been updated in the list and revoked today.

Root Cause Analysis

After any certificate issuance, an internal task copies that certificate from the database to a server to be postlinted. The result of this lint is sent to an email group.

When there is a problema related to Certificate Transparency Logs (when not enoughs SCTs are gathered for whatever reason), the certificate is not issued and is not included in the published certificates table...so they are not copied to the postlint server.

So, when we have had to perform any research after a problema has been detected or re-linted the certificates, we have worked with the server were the certificates are dumped after issuance and missed those that were not issued.

Lessons Learned

What went well

The certificates were not issued and they did not cause any disruption to clients.

What didn't go well

We did not consider the precertificates in our postlinting tool and we were not copying them to the server where the postlinting jobs are executed.

Where we got lucky

There were not too many certificates.

Action Items

Action Item Kind Due Date
Move automatically precertificates to the postlinting server Prevent 2024-10-21

Appendix

Details of affected certificates

Issued CRT.SH link
2023/09/18 09:06 https://crt.sh/?serial=1F005A487D316F8B6507F6FB35EFF354
2023/09/18 09:06 https://crt.sh/?serial=2CD36AD5C06534EA6507F74B191FAE1B
Issued CRT.SH link
2023/10/06 14:45 https://crt.sh/?serial=5DA99D76E49567A56520016D24DB8D5B
2023/10/06 14:46 https://crt.sh/?serial=6EAEBADF5C9E882465200189655AE0DB
2023/10/11 12:51 https://crt.sh/?serial=6B6B9611FD8B474565267E4278895116
2023/10/17 10:35 https://crt.sh/?serial=6398C1A35A5C5B04652E473A49DEB794
2023/10/17 10:36 https://crt.sh/?serial=3F00C4C7C8E460E2652E47740361234D
2023/10/17 10:36 https://crt.sh/?serial=388D64EF59B2B756652E479435143137
2023/10/17 10:38 https://crt.sh/?serial=524165AB65D08B44652E47F0943DE00C
2023/11/02 15:37 https://crt.sh/?serial=4BBC1F26090351836543A6097938C22C
2023/11/02 15:39 https://crt.sh/?serial=1D11327297CD41F96543A684B99BDEB2
2023/11/02 15:45 https://crt.sh/?serial=2CC9800C84BE4DDF6543A7F1C3940931
2023/11/02 16:55 https://crt.sh/?serial=01270FC6F7BAA14B6543B858473BCA51
2023/11/03 09:49 https://crt.sh/?serial=7E362A7966390B6544A5FA4BFFDF88
2023/11/03 12:13 https://crt.sh/?serial=022D70BEDA3610326544C7E44B616181
2023/11/03 12:14 https://crt.sh/?serial=721252C0FF40351A6544C80AD951A577
2023/11/09 10:40 https://crt.sh/?serial=2DD775800BBF929A654C9AF314994133
2023/11/14 17:29 https://crt.sh/?serial=682B688A3AC1433D6553926798F9B259
2023/11/14 17:37 https://crt.sh/?serial=6EE677C19E9825BB6553941D730B217E
2023/11/14 17:43 https://crt.sh/?serial=6142BF3676900F86655395A340293966
2023/11/15 09:40 https://crt.sh/?serial=47DDB7CCEA240AC8655475DD1960A9E5
2023/11/15 11:35 https://crt.sh/?serial=3C2B3784CF179FA4655490DD86961E8E
2023/11/15 11:40 https://crt.sh/?serial=043E9291DCB7003C655491F75600B865
2023/11/15 12:02 https://crt.sh/?serial=1DEE86D41A1FAFCC6554973AF3E35573
2023/11/17 13:09 https://crt.sh/?serial=4AAD9F9F142A2199655749EB5FEB3C16
2023/11/20 10:31 https://crt.sh/?serial=379C55E1FCFC2EA0655B197603998592
2023/11/20 12:14 https://crt.sh/?serial=3D7C1540FAD2E4AB655B3194B9062B86
2023/11/20 15:18 https://crt.sh/?serial=59D6A1EB85C21060655B5CBC597832CE
2023/11/20 17:18 https://crt.sh/?serial=68E15BDD4AC7024B655B78AA83C43E30
2023/11/20 17:19 https://crt.sh/?serial=1CC485E434CFC7A2655B78E70CD0969C
2023/11/20 17:19 https://crt.sh/?serial=654ECE716C8648F5655B791F048F7E4F
2023/11/20 17:21 https://crt.sh/?serial=4C65EBD4B680B989655B798A40271D37
2023/11/20 17:23 https://crt.sh/?serial=4D1925E9BDC96712655B79F9000AC6CF
2024/01/30 10:50 https://crt.sh/?serial=409E87198DF84D4F65B8B864C3751BEC
2024/01/30 10:51 https://crt.sh/?serial=0E59546B12B8C81665B8B88DC2B99578
2024/01/30 10:54 https://crt.sh/?serial=09B8DF93A69AF72D65B8B959E18D6331
2024/01/30 10:56 https://crt.sh/?serial=1771372038D9C19F65B8B9CF37B191BD
2024/01/30 11:44 https://crt.sh/?serial=3E6B220A0874BE3065B8C51B35D28E7A
2024/01/30 12:59 https://crt.sh/?serial=7C2897FF9119318665B8D686C80EC359
2024/02/14 12:02 https://crt.sh/?serial=5B82AA23602EE5DC65CC8FA56B05AC10
2024/02/14 12:02 https://crt.sh/?serial=2261FE468A33422865CC8FB53FA925EE
2024/02/14 12:05 https://crt.sh/?serial=054845A36E2E026565CC9083E15B3F1F
2024/02/14 12:07 https://crt.sh/?serial=53D5EAEBF77751EF65CC90FF3A58098F
2024/02/23 13:45 https://crt.sh/?serial=221F8A223E8CF4CD65D885748EB06A5C
2024/02/23 13:46 https://crt.sh/?serial=7BA35D67C771E95865D885B21D7405D5
2024/02/23 13:47 https://crt.sh/?serial=118E8AB3C5BEF11265D885DDA5F65A76
2024/04/30 11:15 https://crt.sh/?serial=130B5F1FF4629E096630B6A3A3248840
2024/04/30 11:15 https://crt.sh/?serial=56C924E36DAC85526630B6B24BF53AEE
2024/04/30 11:17 https://crt.sh/?serial=36CC8ECFEC3053B76630B723BE00B1A3
2024/04/30 11:34 https://crt.sh/?serial=3AF10931547F82B66630BB1C2476C560
2024/05/10 14:08 https://crt.sh/?serial=4F63AFF9D02AA593663E0E4CD24EF6EC
2024/05/10 14:09 https://crt.sh/?serial=75A40BC97AF3BE78663E0E710B266290
2024/05/10 14:19 https://crt.sh/?serial=3372A7A5BBBD573B663E10E368A9F0C4
2024/06/10 10:44 https://crt.sh/?serial=6EEE3E408D5747766666BCD89A9D97FA
2024/06/25 14:25 https://crt.sh/?serial=09E0F56126DD7E09667AB733A0B9B432
2024/06/25 14:25 https://crt.sh/?serial=407561622D9EF7AE667AB751E30EE72A
2024/06/25 16:25 https://crt.sh/?serial=79941AA31A53FF5C667AD35C3E3269A0
2024/06/26 09:33 https://crt.sh/?serial=05A3C1621BAC6FBB667BC45935538BF2
2024/06/26 09:35 https://crt.sh/?serial=7C736277E261809C667BC4B260B5B44A
2024/06/26 09:44 https://crt.sh/?serial=412D766CE8EBAAF8667BC6D98BBF122B
2024/06/26 10:29 https://crt.sh/?serial=43EFA3FBA4CFC84B667BD1771295DD58
2024/06/26 10:30 https://crt.sh/?serial=082DDD903AEE4824667BD1BB4DADB12F
2024/06/26 11:19 https://crt.sh/?serial=6788369D58387E33667BDD130DED4A60
2024/06/26 15:32 https://crt.sh/?serial=7495215897288E69667C185A4C67E965
2024/06/27 09:06 https://crt.sh/?serial=2CD2B4BB9C5F1EB3667D0F902E39B2D0
2024/07/01 13:44 https://crt.sh/?serial=5F983649B3D4FD5E66829693A4BB1DFA
2024/07/02 10:01 https://crt.sh/?serial=680CA4E46F8E853D6683B3E4DA18605D
2024/07/02 14:19 https://crt.sh/?serial=1CB478D5E5904BE36683F05B06264F1E
2024/07/08 08:38 https://crt.sh/?serial=1C0D80244A7712EF668B898247DBF11E
2024/07/08 12:55 https://crt.sh/?serial=2BF5C751D54196A3668BC58EAB8CA1F9
Flags: needinfo?(d-fernandez)
Assignee: nobody → d-fernandez
Status: UNCONFIRMED → ASSIGNED
Ever confirmed: true
Whiteboard: [ca-compliance]

Hi,
we have successfully create a task that moves precertificates that have not been issued to our postlint server.
Thus, we will be notified by email if there is any problem with the precert and in case of a further revocation process, this precertificates will also be considered.
Regards,

You need to log in before you can comment on or make changes to this bug.