409614 - IDN with non-ASCII TLD is displayed in Punycode

Status: RESOLVED FIXED

(Core :: Networking, defect)

Description

[Tom Adams]

User-Agent:       Mozilla/5.0 (X11; U; Linux i686; ja; rv:1.9b2) Gecko/2007121016 Firefox/3.0b2
Build Identifier: Mozilla/5.0 (X11; U; Linux i686; ja; rv:1.9b2) Gecko/2007121016 Firefox/3.0b2

For any domain with a non-ASCII top-level domain name, the whole domain is displayed in Punycode. This includes those TLDs which are whitelisted.

Reproducible: Always

Steps to Reproduce:
1. Visit http://例え.テスト/ (copy/paste or by clicking a link such as http://idn.icann.org/#The_example.test_names)
Actual Results:  
The location bar now contains http://xn--r8jz45g.xn--zckzah/メインページ

Expected Results:  
The location bar should contain http://例え.テスト/メインページ

This occurs with every one of the 11 domains which is whitelisted in network.IDN.whitelist.* (which correspond to the 11 domains listed here: http://idn.icann.org/#The_example.test_names ).

Comment 1

[[e-mail]]

confirmed. this is because we don't convert (and never have converted) the TLD before looking it up in the whitelist prefs, which are all ASCII:
http://mxr.mozilla.org/mozilla/source/netwerk/dns/src/nsIDNService.cpp#336

should we fix this? i know next to zero about IDN specs.

it seems like we'd need a duplicate spec for every ASCII TLD in UTF8.

Comment 2

[[e-mail]]

see bug 397803, which added some punycoded whitelist prefs as part of an ICANN test of IDN TLD's, which apparently is what this bug is about.

so it looks like there's no need to add punycode or UTF8 whitelist prefs yet, we just need to make nsIIDNService do punycode TLD lookups correctly.

-> me

Comment 3

[Daniel Veditz [:dveditz]]

Seems like it'd be simple enough for nsIDNService::isInWhitelist() to simply convert non-ascii TLD to ACE.

Comment 4

[[e-mail]]

Attachment: v1

pretty simple, includes unit test. passes tests and fixes bug.

Comment 5

[[e-mail]]

Comment on attachment 294472 [details] [diff] [review]
v1

kicking to biesi - tiny patch, easy to review - name your (canadian) drink of choice!

Comment 6

[[e-mail]]

Comment on attachment 294472 [details] [diff] [review]
v1

seeking approval - pretty low-risk patch here!

Comment 7

[Damon Sicore (:damons)]

Comment on attachment 294472 [details] [diff] [review]
v1

a1.9+=damons

Comment 8

[[e-mail]]

Checking in netwerk/dns/src/nsIDNService.cpp;
/cvsroot/mozilla/netwerk/dns/src/nsIDNService.cpp,v  <--  nsIDNService.cpp
new revision: 1.37; previous revision: 1.36
done
Checking in netwerk/test/unit/test_idnservice.js;
/cvsroot/mozilla/netwerk/test/unit/test_idnservice.js,v  <--  test_idnservice.js
new revision: 1.3; previous revision: 1.2
done