I think it will be fine to load earlier. This is just the extension loading at all. It doesn't mean that we need to access calendar just yet. I will check back. We do have to be aware of race conditions, though: The extension load is async and not guaranteed to happen immediately. Depending on when our addon loads, certain events like session-restore will already have fired, or not yet, so we have to consider both cases.
Bug 1771371 Comment 6 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
I think it will be fine to load earlier. This is just the extension loading at all. It doesn't mean that we need to access calendar just yet.