489277 - Search queries can have inconsistent encodings

Status: VERIFIED FIXED

(support.mozilla.org :: Knowledge Base Software, task)

Description

[E. Cooper [:ecooper]]

Searches in languages that aren't strictly ASCII seem to run into encoding problems, leading to no results for that search.

STR:
1. Visit https://support-stage.mozilla.org/tiki-newsearch.php?locale=ja&q=%E3%81%93%E3%81%AE&where=d&sa=&filter_lang=1&l=ar&en_too=1&lastmodif=0&type=0&author=

この should return a lot of Japanese articles, but it doesn't return any. Most likely, it's because of an encoding issue.

Comment 1

[E. Cooper [:ecooper]]

Attachment: v1

This forces UTF-8 for the query without double-encoding it (also a problem with the current code).

This problem also affects more popular locales like de:

https://support-stage.mozilla.org/tiki-newsearch.php?locale=de&q=enth%C3%A4lt&where=d&sa=&filter_lang=1&l=he&en_too=1&lastmodif=0&type=0&author=

Comment 2

[E. Cooper [:ecooper]]

Attachment: pre-patch screenshot of comment 1 url

r24691/r24692

URLs like the ones in the description and comment 1 can be used to see if this is fixed. Essentially, any language using characters beyond regular old ASCII.

The screenshot is for reference of what the pre-patch results looked like for the url in comment 1.

Comment 3

[Stephen Donner [:stephend] Not actively reading bugmail]

Verified FIXED on https://support-stage.mozilla.org/tiki-newsearch.php?locale=ja&q=%E3%81%93%E3%81%AE&where=d&sa=&filter_lang=1&l=ar&en_too=1&lastmodif=0&type=0&author and https://support-stage.mozilla.org/tiki-newsearch.php?locale=de&q=enth%C3%A4lt&where=d&sa=&filter_lang=1&l=he&en_too=1&lastmodif=0&type=0&author