1237285 - Many broken links on IDN-enabled TLDs page

Status: NEW

(www.mozilla.org :: Pages & Content, defect)

Description

[Alex Gibson [:agibson]]

URL        `http://www.domini.cat/normativa/en_normativa_registre.html'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 187, col 9
Real URL   http://www.domini.cat/normativa/en_normativa_registre.html
Check time 0.530 seconds
Size       406B
Result     Error: 404 Not Found

URL        `http://www.switch.ch/id/'
Name       `Registry'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 192, col 9
Real URL   http://www.switch.ch/id/
Check time 0.530 seconds
Size       1KB
Result     Error: 404 Not Found

URL        `http://www.switch.ch/id/terms/agb.html#anhang1'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 193, col 9
Real URL   http://www.switch.ch/id/terms/agb.html#anhang1
Check time 0.943 seconds
Size       1KB
Result     Error: 404 Not Found

URL        `http://verisigninc.com/en_US/products-and-services/domain-name-services/domain-information-center/idn-code-points/registration-rules/index.xhtml'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 211, col 9
Real URL   http://www.verisign.com/en_US/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml
Check time 1.077 seconds
Size       54.32KB
Info       Redirected to
           `http://www.verisign.com/en_US/products-and-services/domain-name-services/domain-information-center/idn-code-points/registration-rules/index.xhtml?inc=verisigninc.com'.
           Redirected to
           `http://www.verisign.com/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml'.
           Redirected to
           `http://www.verisign.com/en_US/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml'.
Result     Error: 404 Not Found

URL        `https://www.nic.es/'
Name       `Registry'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 228, col 9
Real URL   https://www.nic.es/
Check time 1.174 seconds
Result     Error: SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:581)
 4 threads active,  8154 links queued, 96972 links in 12898 URLs checked, runtime 50 minutes, 46 seconds

URL        `https://www.nic.es/media/2008-12/1228818323935.pdf'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 229, col 9
Real URL   https://www.nic.es/media/2008-12/1228818323935.pdf
Check time 0.760 seconds
Result     Error: SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:581)

URL        `https://grweb.ics.forth.gr/english/index.html'
Name       `Registry'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 240, col 9
Real URL   https://grweb.ics.forth.gr/english/index.html
Check time 1.645 seconds
Size       520B
Result     Error: 404 Not Found

URL        `https://grweb.ics.forth.gr/english/ENCharacterTable1.jsp'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 241, col 9
Real URL   https://grweb.ics.forth.gr/english/ENCharacterTable1.jsp
Check time 1.884 seconds
Size       520B
Result     Error: 404 Not Found
 4 threads active,  8136 links queued, 96990 links in 12920 URLs checked, runtime 50 minutes, 51 seconds

URL        `http://www.switch.ch/id/'
Name       `Registry'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 294, col 9
Real URL   http://www.switch.ch/id/
Check time 0.530 seconds
Size       1KB
Result     Error: 404 Not Found

URL        `http://www.switch.ch/id/terms/agb.html#anhang1'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 295, col 9
Real URL   http://www.switch.ch/id/terms/agb.html#anhang1
Check time 0.943 seconds
Size       1KB
Result     Error: 404 Not Found

URL        `http://verisigninc.com/en_US/products-and-services/domain-name-services/domain-information-center/idn-code-points/registration-rules/index.xhtml'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 325, col 9
Real URL   http://www.verisign.com/en_US/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml
Check time 1.077 seconds
Size       54.32KB
Info       Redirected to
           `http://www.verisign.com/en_US/products-and-services/domain-name-services/domain-information-center/idn-code-points/registration-rules/index.xhtml?inc=verisigninc.com'.
           Redirected to
           `http://www.verisign.com/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml'.
           Redirected to
           `http://www.verisign.com/en_US/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml'.
Result     Error: 404 Not Found

URL        `http://verisigninc.com/en_US/products-and-services/domain-name-services/domain-information-center/idn-code-points/registration-rules/index.xhtml'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 331, col 9
Real URL   http://www.verisign.com/en_US/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml
Check time 1.077 seconds
Size       54.32KB
Info       Redirected to
           `http://www.verisign.com/en_US/products-and-services/domain-name-services/domain-information-center/idn-code-points/registration-rules/index.xhtml?inc=verisigninc.com'.
           Redirected to
           `http://www.verisign.com/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml'.
           Redirected to
           `http://www.verisign.com/en_US/products-and-services/domain-name-services/value-added-products/idn-domain-names/idn-code-points/registration-rules/index.xhtml'.
Result     Error: 404 Not Found
 4 threads active,  8112 links queued, 97014 links in 12936 URLs checked, runtime 50 minutes, 56 seconds

URL        `http://dnc.org.nz/content/rmc.html'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 349, col 9
Real URL   http://dnc.org.nz/content/rmc.html
Check time 0.524 seconds
Result     Error: 404 Not Found
 4 threads active,  8104 links queued, 97022 links in 12947 URLs checked, runtime 51 minutes, 1 seconds

URL        `http://pir.org/PDFs/ORG-Extended-Characters-22-Jan-07.pdf'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 355, col 9
Real URL   http://pir.org/PDFs/ORG-Extended-Characters-22-Jan-07.pdf
Check time 0.831 seconds
Result     Error: 404 Not Found

URL        `http://www.norid.no/domeneregistrering/veiviser.en.html'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 337, col 9
Real URL   https://www.norid.no/en/domeneregistrering/veiviser
Check time 5.707 seconds
Info       Redirected to
           `https://www.norid.no/domeneregistrering/veiviser.en.html'.
           Redirected to
           `https://www.norid.no/en/domeneregistrering/veiviser'.
Result     Error: 404 Not Found

URL        `https://www.nic.pr/idn_rules.asp'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 367, col 9
Real URL   https://www.nic.pr/idn_rules.asp
Check time 0.933 seconds
Result     Error: SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:581)

URL        `https://www.nic.pr/'
Name       `Registry'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 366, col 9
Real URL   https://www.nic.pr/
Check time 1.600 seconds
Result     Error: SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:581)

URL        `http://www.telnic.org/policies.html'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 385, col 9
Real URL   http://www.telnic.org/policies.html
Check time 0.319 seconds
Size       3KB
Result     Error: 404 Not Found
 4 threads active,  8081 links queued, 97045 links in 12973 URLs checked, runtime 51 minutes, 6 seconds

URL        `http://www.vnnic.vn/english/5-6-300-2-2-04-20071115.htm'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 415, col 9
Real URL   http://www.vnnic.vn/english/5-6-300-2-2-04-20071115.htm
Check time 1.482 seconds
Size       12.03KB
Result     Error: 404 Not Found

URL        `http://nic.net.sa/adn-en.php'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 436, col 9
Real URL   http://nic.net.sa/adn-en.php
Check time 0.969 seconds
Size       3KB
Result     Error: 404 Not Found
 4 threads active,  8066 links queued, 97060 links in 12988 URLs checked, runtime 51 minutes, 11 seconds


********** Oops, I did it again. *************

You have found an internal error in LinkChecker. Please write a bug report
at https://github.com/wummel/linkchecker/issues
and include the following information:
- the URL or file you are testing
- the system information below

When using the commandline client:
- your commandline arguments and any custom configuration files.
- the output of a debug run with option "-Dall"

Not disclosing some of the information above due to privacy reasons is ok.
I will try to help you nonetheless, but you have to give me something
I can work with ;) .

Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/director/checker.py", line 104, in check_url
    line: self.check_url_data(url_data)
    locals:
      self = <local> <Checker(CheckThread-https://www2.hkirc.hk/, started 140577702147840)>
      self.check_url_data = <local> <bound method Checker.check_url_data of <Checker(CheckThread-https://www2.hkirc.hk/, started 140577702147840)>>
      url_data = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/director/checker.py", line 120, in check_url_data
    line: check_url(url_data, self.logger)
    locals:
      check_url = <global> <function check_url at 0x7fdada6e9410>
      url_data = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
      self = <local> <Checker(CheckThread-https://www2.hkirc.hk/, started 140577702147840)>
      self.logger = <local> <linkcheck.director.logger.Logger object at 0x7fdada007190>
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/director/checker.py", line 52, in check_url
    line: url_data.check()
    locals:
      url_data = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
      url_data.check = <local> <bound method HttpUrl.check of <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', a...
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/checker/urlbase.py", line 424, in check
    line: self.local_check()
    locals:
      self = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
      self.local_check = <local> <bound method HttpUrl.local_check of <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Regist...
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/checker/urlbase.py", line 442, in local_check
    line: self.check_connection()
    locals:
      self = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
      self.check_connection = <local> <bound method HttpUrl.check_connection of <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'R...
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/checker/httpurl.py", line 135, in check_connection
    line: self.send_request(request)
    locals:
      self = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
      self.send_request = <local> <bound method HttpUrl.send_request of <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Regis...
      request = <local> <PreparedRequest [GET]>
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/checker/httpurl.py", line 165, in send_request
    line: self._send_request(request, **kwargs)
    locals:
      self = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
      self._send_request = <local> <bound method HttpUrl._send_request of <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Regi...
      request = <local> <PreparedRequest [GET]>
      kwargs = <local> {'timeout': 60, 'stream': True, 'allow_redirects': False, 'verify': True}
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/checker/httpurl.py", line 172, in _send_request
    line: self._add_ssl_info()
    locals:
      self = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
      self._add_ssl_info = <local> <bound method HttpUrl._add_ssl_info of <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Regi...
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/checker/httpurl.py", line 193, in _add_ssl_info
    line: sock = self._get_ssl_sock()
    locals:
      sock = <not found>
      self = <local> <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Registry', anchor=u'', cache_url=https://ww...
      self._get_ssl_sock = <local> <bound method HttpUrl._get_ssl_sock of <https link, base_url=u'https://www2.hkirc.hk/', parent_url=u'https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/', base_ref=None, recursion_level=6, url_connection=None, line=459, column=9, page=0, name=u'Regi...
  File "/usr/local/lib/python2.7/dist-packages/linkcheck/checker/httpurl.py", line 187, in _get_ssl_sock
    line: raw_connection.connect()
    locals:
      raw_connection = <local> <urllib3.connection.VerifiedHTTPSConnection object at 0x7fdad87d8b10>
      raw_connection.connect = <local> <bound method VerifiedHTTPSConnection.connect of <urllib3.connection.VerifiedHTTPSConnection object at 0x7fdad87d8b10>>
  File "/usr/lib/python2.7/dist-packages/urllib3/connection.py", line 245, in connect
    line: self.assert_hostname or hostname)
    locals:
      self = <local> <urllib3.connection.VerifiedHTTPSConnection object at 0x7fdad87d8b10>
      self.assert_hostname = <local> None
      hostname = <local> 'www2.hkirc.hk', len = 13
  File "/usr/lib/python2.7/ssl.py", line 273, in match_hostname
    line: % (hostname, dnsnames[0]))
    locals:
      hostname = <local> 'www2.hkirc.hk', len = 13
      dnsnames = <local> ['www.hkirc.hk'], _[0]: {len = 12}
CertificateError: hostname 'www2.hkirc.hk' doesn't match 'www.hkirc.hk'
System info:
LinkChecker 9.3
Released on: 16.7.2014
Python 2.7.9 (default, Mar  1 2015, 12:57:24) 
[GCC 4.9.2] on linux2
Requests: 2.4.3
Modules: Sqlite
Local time: 2016-01-05 18:30:26+000
sys.argv: ['/usr/local/bin/linkchecker', '-F', 'html/utf8//results/linkchecker-out.html', '-t', '4', '-r', '-1', '--check-extern', 'https://bedrock-prod-deis.us-west.moz.works']
Default locale: ('C', 'ascii')

 ******** LinkChecker internal error, over and out ********
WARNING 2016-01-05 18:30:26,461 CheckThread-https://www2.hkirc.hk/ internal error occurred
WARNING 2016-01-05 18:30:26,461 CheckThread-https://www2.hkirc.hk/ internal error occurred

URL        `http://www.nic.lk'
Name       `Registry'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 475, col 9
Real URL   http://www.nic.lk
Check time 0.851 seconds
Result     Error: ConnectionError: ('Connection aborted.', error(113, 'No route to host'))

URL        `http://www.nic.lk/index.php/en/idn-policy'
Name       `Policy'
Parent URL https://bedrock-prod-deis.us-west.moz.works/en-US/about/governance/policies/security-group/tld-idn/, line 476, col 9
Real URL   http://www.nic.lk/index.php/en/idn-policy
Check time 0.557 seconds
Result     Error: ConnectionError: ('Connection aborted.', error(113, 'No route to host'))