1050161 - The android talos remote-tp4m_nochrome (tpn) pageset makes external connections

Status: RESOLVED FIXED

(Testing :: Talos, defect)

Description

[Ed Morley [:emorley]]

Broken out from bug 1026970 comment 35.

The pageset was just updated in bug 1048448, however there appear to be some more non-local connections being made.

I've pushed a tpn run to try again, this time just warning on non-local access, rather than crashing - so we can see all failures at once:
https://tbpl.mozilla.org/?tree=Try&rev=b1be1d4916c1
https://tbpl.mozilla.org/php/getParsedLog.php?id=45403073&full=1&branch=try

Grepping for "connection attempt to" gives:
01:47:23     INFO -  08-07 01:44:41.609 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to g-ecx.images-amazon.com (54.230.119.37) was made.
01:47:23     INFO -  08-07 01:44:41.632 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to z-ecx.images-amazon.com (23.61.194.179) was made.
01:47:23     INFO -  08-07 01:44:47.476 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to ai.yimg.jp (124.83.248.123) was made.
01:47:23     INFO -  08-07 01:44:47.515 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to ai.yimg.jp (124.83.248.123) was made.
01:47:23     INFO -  08-07 01:44:48.109 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to b9.yahoo.co.jp (182.22.41.237) was made.
01:47:23     INFO -  08-07 01:44:50.875 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to b4.yahoo.co.jp (182.22.68.62) was made.
01:47:23     INFO -  08-07 01:44:55.015 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to b.scorecardresearch.com (23.61.194.241) was made.
01:47:23     INFO -  08-07 01:44:55.015 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to www.google-analytics.com (173.194.33.135) was made.
01:47:23     INFO -  08-07 01:44:55.078 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to core.ringleaderdigital.com (192.64.147.230) was made.
01:47:23     INFO -  08-07 01:44:59.976 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to hw.baidu.com (123.125.114.100) was made.
01:47:23     INFO -  08-07 01:45:00.671 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to wap.baidu.com (61.135.185.17) was made.
01:47:23     INFO -  08-07 01:45:08.679 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to awaps.yandex.ru (77.88.21.131) was made.
01:47:23     INFO -  08-07 01:45:09.992 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to mc.yandex.ru (93.158.134.119) was made.
01:47:23     INFO -  08-07 01:45:10.218 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to kiks.yandex.ru (213.180.193.143) was made.
01:47:23     INFO -  08-07 01:45:25.554 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to www.gstatic.com (173.194.33.159) was made.
01:47:23     INFO -  08-07 01:45:39.554 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to ai.yimg.jp (124.83.248.123) was made.
01:47:23     INFO -  08-07 01:45:39.898 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to b9.yahoo.co.jp (182.22.41.237) was made.
01:47:23     INFO -  08-07 01:45:42.523 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to ai.yimg.jp (124.83.248.123) was made.
01:47:23     INFO -  08-07 01:45:42.828 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to b4.yahoo.co.jp (182.22.68.62) was made.
01:47:23     INFO -  08-07 01:45:46.781 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to core.ringleaderdigital.com (192.64.147.230) was made.
01:47:23     INFO -  08-07 01:45:51.015 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to wap.baidu.com (61.135.185.17) was made.
01:47:23     INFO -  08-07 01:45:57.898 I/Gecko   ( 2194): FATAL ERR_R: Non-local network connections are disabled and a connection attempt to kiks.yandex.ru (213.180.193.143) was made.

Comment 1

[Ed Morley [:emorley]]

With dupes removed & sorted alphabetically, this is:

ai.yimg.jp
awaps.yandex.ru
b.scorecardresearch.com
b4.yahoo.co.jp
b9.yahoo.co.jp
core.ringleaderdigital.com
g-ecx.images-amazon.com
hw.baidu.com
kiks.yandex.ru
mc.yandex.ru
wap.baidu.com
www.google-analytics.com
www.gstatic.com
z-ecx.images-amazon.com

I'll look in the latest pageset (http://people.mozilla.org/~jmaher/taloszips/zips/mobile_tp4.zip) and attach a patch shortly.

Comment 2

[Ed Morley [:emorley]]

Attachment: Remove more external connections from mobile_tp4

This patch contains unicode in some of the diff context, so I'd be careful what tools you use to handle it (seem to recall qimportbz struggles).

Think I've got everything - could you apply the diff and create a new zip from it, for me? :-)

Comment 3

[Ed Morley [:emorley]]

The diff is probably best viewed using something that can support partial line colouring btw, since many of the files are minified.

Comment 4

[Ed Morley [:emorley]]

Many of these were quite hard to find, even with regex searches, without getting swamped in false positives (ie: URIs already converted to local, or <a href>s that don't get used) - particularly due to SSL handling logic or use of obfuscated libraries.

eg a search for "b.scorecardresearch.com" didn't find:
> var src = (document.location.protocol == "https:" ? "https://sb" : "http://b") + ".scorecardresearch.com/mobile.js",

Whilst a search for "https?://mc.yandex.ru" doesn't find:
> src="//mc.yandex.ru

...so I'm hopeful, but not entirely sure I found everything in this pass & can understand how these were missed the first time around :-)

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8469295 [details] [diff] [review]
Remove more external connections from mobile_tp4

Review of attachment 8469295 [details] [diff] [review]:
-----------------------------------------------------------------

yay for edmorley!