866602 - Intl: CanonicalizeLanguageTag is incorrect for four-letter language codes

Status: RESOLVED FIXED

(Core :: JavaScript: Internationalization API, defect)

Description

[André Bargull [:anba]]

User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:20.0) Gecko/20100101 Firefox/20.0
Build ID: 20130409194949

Steps to reproduce:

Four characters subtags can either be script subtags or (future reserved) language code subtags. The latter option is not handled in CanonicalizeLanguageTag. 

Also the first if-statement in the first while-loop handles a condition which can never be fulfilled. Namely singleton subtags at the start of the input string which are not privateuse subtags. Per the comment in the file, the condition was added for irregular language tags, but those are already handled in the langTagMappings structure.

Comment 1

[Gordon P. Hemsley [:GPHemsley]]

Mass-moving existing Intl-related bugs to the new Core :: JavaScript: Internationalization API component.

If you think this bug has been moved in error, feel free to move it back to Core :: JavaScript Engine.

[Mass change filter: core-js-intl-api-move]

Comment 2

[André Bargull [:anba]]

Attachment: four-lang.patch

Very important, many use, so exciting, much impact. :-)

Comment 3

[Jeff Walden [:Waldo]]

Comment on attachment 8791740 [details] [diff] [review]
four-lang.patch

Review of attachment 8791740 [details] [diff] [review]:
-----------------------------------------------------------------

::: js/src/builtin/Intl.js
@@ +393,5 @@
>          // In the example, we break at "u".
>          if (subtag.length === 1 && (i > 0 || subtag === "x"))
>              break;
>  
> +        if (i !== 0 && subtag.length === 4) {

i !== 0 applies to both if/else here, so have

  if (i !== 0) {
    if (subtag.length === 4) {
      ...
    } else if (subtag.length === 2) {
      ...
    }
  }

::: js/src/tests/Intl/four-letter-language-codes.js
@@ +2,5 @@
> +/* This Source Code Form is subject to the terms of the Mozilla Public
> + * License, v. 2.0. If a copy of the MPL was not distributed with this
> + * file, You can obtain one at http://mozilla.org/MPL/2.0/. */
> +
> +// So many non-existent four letter language codes to pick from.

A++++ comment there

Comment 4

[André Bargull [:anba]]

Attachment: four-lang.patch

Updated patch, carrying r+ from Waldo.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/2a5bd50d8ff9
Handle four-character language codes in CanonicalizeLanguageTag. r=Waldo

Comment 6

[Phil Ringnalda (:philor)]

https://hg.mozilla.org/mozilla-central/rev/2a5bd50d8ff9