1228083 - Thunderbird 38.4.0 Release Notes URL is 404

Status: VERIFIED FIXED

(www.mozilla.org :: Bedrock, defect)

Description

[Wayne Pollock]

User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:25.8) Gecko/20151116 Firefox/31.9 PaleMoon/25.8.0
Build ID: 20151116215007

Steps to reproduce:

https://www.mozilla.org/en-US/thunderbird/38.4.0/releasenotes/

(Same URL from the thunderbird page's "What's new" link).


Actual results:

404


Expected results:

display release notes

Comment 1

[Wayne Mery (:wsmwk)]

* yesterday https://www.mozilla.org/en-US/thunderbird/38.4.0/releasenotes/ was working for me as of 5pm EST Tuesday. 
* Today
  - http://live.mozillamessaging.com/thunderbird/releasenotes?locale=en-US&version=38.4.0&os=WINNT&buildid=20151119061742  only started working for me about an hour ago.
  - the various URLs work for me on some machines, for some urls, for some networks and not others, and has been changing over the past two hours.  Nor rhyme or reason as far as I can tell

In Bug 1209959 Dan reported something similar for version 38.3.0. Slyvestre had done https://viewvc.svn.mozilla.org/vc?revision=147235&view=revision

Comment 3

[Wayne Pollock]

The link https://www.mozilla.org/en-US/thunderbird/38.4.0/releasenotes/ still doesn't work;  The page I get shows this (page title is " 404: Page Not Found - Mozilla"):
Mozilla
Whoops!

Did you make a left at that last URL instead of a right? No problem. Here are some tips to get you back on your way:
...

As stated previously, the link from your site (which is the same URL) doesn't work either:
https://www.mozilla.org/en-US/thunderbird/releases/, then click on "38.4.0".

(I tried this on a different computer.)  I live in Florida.  I'm wondering if  Mozilla uses some sort of CDN, and maybe some of the replicas are out of sync?  According to WhatsMyIP.org, my public IP is 107.144.69.115.  Does that IP use a different server than people in other parts of the world?

Comment 5

[Steve Chessin]

Note that this seems to be a repeat of Bug 1166100 - "404: page not found -mozilla, wanted to view the release notes on todays(5-18-15) thunderbird update. https://www.mozilla.org/en-US/thunderbird/31.7.0/releasenotes/". 1166100 says it was fixed but apparently the problem is back.

It'd be nice if you could fix it so it would stay fixed.

Comment 7

[Sylvestre Ledru [:Sylvestre]]

I looked and the necessary changes seem ok to me?!

Comment 8

[Dan Pernokis]

The page does not work for me either (8:55 am EST) -- my IP is in Ontario, Canada (London or Toronto, depending on who's looking).

In Bug 1209959 for TB 38.3.0, the page actually did exist, but there was an issue in resolving the address from the RELEASE NOTES button to the final URL.  In *this* case, the resolution seems to work but the page genuinely can't be found.

That is, the resolution of the address goes as far as 38.3.0 did -- to a clear URL pointing at 38.4.0.  But the page is "missing":  misspelled, mis-cased, or truly not there.

Comment 9

[Wayne Mery (:wsmwk)]

You guys seeing it work at all now?

11:19 EST suddenly both work for me - at home. But only for Firefox.  For chrome it 404s
https://www.mozilla.org/en-US/thunderbird/38.4.0/releasenotes/
https://www.mozilla.org/en-US/thunderbird/38.4.0/releasenotes/?uri=/thunderbird/releasenotes/&locale=en-US&version=38.4.0&os=WINNT&buildid=20151119061742

at work it still fails.
I see it initially bouncing thorugh a few cdn urls
like mozorg.cdn.mozilla.net

Comment 10

[Dan Pernokis]

Still not working here -- not my TB's RELEASE NOTES button and neither of your links.
Tried FF and GC -- both go to Whoops page.

Quite telling is Wayne Pollock's link:
>> As stated previously, the link from your site (which is the same URL) doesn't work either:
>> https://www.mozilla.org/en-US/thunderbird/releases/, then click on "38.4.0".
Page of simple direct (correct) links -- but 38.4.0 doesn't work, which tells me page is still "missing" somehow.

Comment 11

[Wayne Mery (:wsmwk)]

It has been speculated in #moc that this problem might be related to Bug 1227868 - production bedrock database replication is broken

Comment 14

[Josh Mize [:jgmize]]

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #11)
> It has been speculated in #moc that this problem might be related to Bug
> 1227868 - production bedrock database replication is broken

This was indeed related to that issue. When the production database replication was broken, it broke the application level replication that is used to sync release notes from nucleus.mozilla.org, and it required manual intervention on my part to force the data to sync. After resolving the data issue the page is now loading.

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #9)
> You guys seeing it work at all now?
> 
> 11:19 EST suddenly both work for me - at home. But only for Firefox.  For
> chrome it 404s
[...]
> at work it still fails

This issue affected the primary deployment of www.mozilla.org in our SCL3 datacenter, which currently handles the majority of the traffic. We also have deployments in two AWS regions, neither of which were affected by this issue. Your request at home that worked happened to be resolved by one of our AWS deployments, but when you came to work your requests were resolved by the deployment in SCL3, which was still broken at the time.

Comment 15

[Dan Pernokis]

11:25 pm EST here in Canada and it now works:  my TB's RELEASE NOTES button, both of Wayne Mery's links, and the direct links page.  Also tried variations on Chrome, all OK.

Comment 16

[Wayne Pollock]

Works in Florida now too.  Thanks for taking care of this issue!

Comment 17

[Wayne Mery (:wsmwk)]

Thanks.  Crazy coincidence in timing.
Agreed it is working.

Comment 18

[Steve Chessin]

Well, the release notes now display, but the link in "Various security fixes" is to
https://www.mozilla.org/security/known-vulnerabilities/firefox-esr/#firefoxesr38.4 and not to a list of Thunderbird security fixes.

I did check
https://www.mozilla.org/en-US/security/known-vulnerabilities/thunderbird/
but it only goes as far as TB 38.2

So while this bug may be "verified fix", the release process still seems to be broken.

Comment 19

[Steve Chessin]

(In reply to Josh Mize [:jgmize] from comment #14)
> (In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment
> #11)
> > It has been speculated in #moc that this problem might be related to Bug
> > 1227868 - production bedrock database replication is broken
> 
> This was indeed related to that issue. When the production database
> replication was broken, it broke the application level replication that is
> used to sync release notes from nucleus.mozilla.org, and it required manual
> intervention on my part to force the data to sync. After resolving the data
> issue the page is now loading.

Does this mean you only took care of the symptom (meaning it'll break with the next release and manual intervention will again be needed to fix it), or has the root cause been addressed?

Comment 20

[Wayne Mery (:wsmwk)]

(In reply to Steve Chessin from comment #18)
> Well, the release notes now display, but the link in "Various security
> fixes" is to
> https://www.mozilla.org/security/known-vulnerabilities/firefox-esr/
> #firefoxesr38.4 and not to a list of Thunderbird security fixes.
> 
> I did check
> https://www.mozilla.org/en-US/security/known-vulnerabilities/thunderbird/
> but it only goes as far as TB 38.2
> 
> So while this bug may be "verified fix", the release process still seems to
> be broken.

Thanks for noting this. I'll look into it. 1. The link is obviously wrong, 2. AFAIK we had no security fixes for TB38.4.0 - so on both counts the flaw is QA for not catching it and the release notes being incorrect from the get go.

Comment 21

[Wayne Mery (:wsmwk)]

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #20)
> (In reply to Steve Chessin from comment #18)
> > Well, the release notes now display, but the link in "Various security
> > fixes" is to
> > https://www.mozilla.org/security/known-vulnerabilities/firefox-esr/
> > #firefoxesr38.4 and not to a list of Thunderbird security fixes.
> > 
> > I did check
> > https://www.mozilla.org/en-US/security/known-vulnerabilities/thunderbird/
> > but it only goes as far as TB 38.2
> > 
> > So while this bug may be "verified fix", the release process still seems to
> > be broken.
> 
> Thanks for noting this. I'll look into it. 1. The link is obviously wrong,
> 2. AFAIK we had no security fixes for TB38.4.0 - so on both counts the flaw
> is QA for not catching it and the release notes being incorrect from the get
> go.

Correction - this has subequently been clarified by abillings. Dealing with it in bug 1228895