1070629 - Automated compatibility checker and multiple products

Status: RESOLVED INCOMPLETE

(addons.mozilla.org Graveyard :: Add-on Validation, defect, P4)

Description

[David White]

User Agent: Mozilla/5.0 (Windows NT 5.1; rv:26.0) Gecko/20100101 Firefox/26.0
Build ID: 20131205075310

Steps to reproduce:

I still occasionally get emails regarding the compatibility of my addons with new versions of Mozilla products. I am not sure why this seems inconsistent now when it used to be quite regular. But my ThunderbirdBiff addon supports both FF and TB (and Sunbird). And while I get compatibility emails (and bumps) for FF with this addon, I get nothing reported about my addon's compatibility with TB.


Actual results:

I get an email including this (last one was on 5/29/14):

Subject: Add-on compatibility with Firefox 30.*

Contents: Dear add-on author,

Good news! Our automated tests did not detect any compatibility issues with your add-on and Firefox 30.*. We've updated your add-on's compatibility to work with Firefox 30.* so that our beta and release users can begin using your add-on.

We encourage you to view the results of the compatibility test, as some compatibility issues may have been detected but without enough certainty to declare the add-on incompatible:


 • Thunderbird Biff:
   ▶ https://addons.mozilla.org/developers/addon/thunderbird-biff/validation-result/302556

This compatibility bump is server-side and we did not modify your add-on package in any way.


Thank you,
Firefox Add-ons team



Expected results:

If an addon supports multiple products, it should be tested against multiple products, emails should report findings for multiple products, and compatibility bumps should affect multiple products. As is, I do not believe I have ever had this happen for this addon with TB, only FF. My TB-only addons seem to be handled well enough.

Comment 1

[Jorge Villalobos [:jorgev] (he/him)]

Thunderbird isn't updated every 6 weeks like Firefox is. It's major release calendar aligns with ESR, every 7 cycles, if I recall correctly. Are you not receiving any compatibility emails at all, or is the problem something else?

Comment 2

[David White]

Thanks Jorge. I have several TB-only addons (ThunderPlunger, UseBccInstead, etc) and one addon that is for FF as well as TB (ThunderbirdBiff). I am getting emails regarding TB for all except ThunderbirdBiff. For example, on 8/1 I got an email regarding TB 31 for ThunderPlunger, etc. But I only seem to get FF compatibility emails for ThunderbirdBiff. They never mention TB of course. And I never see any mention of ThunderbirdBiff compatibility in the emails for the TB-only addons. I am guessing that the process which performs this process only looks at the first supported Mozilla product for each addon during its scan for qualifying addons. But I am not sure. I am only pointing out that this one addon is never mentioned in terms of TB compatibility and it seems like it should be. Cheers