1547491 - [raptor-tp6m-espn-fenix-cold] fails to load when using live site

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P3)

Description

[Robert Wood [:rwood]]

Causing raptor-tp6m-cold-13.ini to fail in production (it's try only) i.e.:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=80aa51ef4f2448afa5574716a9e9f884a9702ecc

Every browser cycle fails.

Comment 1

[Robert Wood [:rwood]]

Note: This is using live_sites = true; check and see if this also happens with a regular run using the mitmproxy playback recording.

Comment 2

[Robert Wood [:rwood]]

Try push non-live site:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=12ef7de4f807fb5b370ae22cc7002b159feb28f8

Comment 3

[Robert Wood [:rwood]]

(In reply to Robert Wood [:rwood] from comment #2)

Try push non-live site:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=12ef7de4f807fb5b370ae22cc7002b159feb28f8

Yep this failure happens only when using the live site, the mitmproxy recording works.

Comment 4

[Marian Raiciof [:marauder]]

Push to try:

• added use_live_sites = true to raptor-tp6m-13-cold.ini and raptor-tp6m-26-cold.ini
• the tests are always green, they don't depend on the whitelist_live_site_tests modifications, as seen below
• in other words, if i add the tests to whitelist_live_site_tests or not, they will run successfully:
  /testing/raptor/raptor/manifest.py
  whitelist_live_site_tests = [
  "raptor-youtube-playback",
  +"raptor-tp6m-13-cold",
  +"raptor-tp6m-26-cold",
  ]

https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=9c44db9f5b519be0a5fbac449f094a73fcc11dd1
https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=139f7c1048677faa9c4a5a8a8bbcd4a7dd56f2b6
https://treeherder.mozilla.org/#/jobs?repo=try&revision=90b6b78c29deafaaa4f546e8fdbc1ba9e0c4d331&group_state=expanded
https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=1427743d60340af3fc9757ecdcb2a2e9af9b700e

• without live sites option:
  https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=3d07d01efbc110772ec53fb596c9a150a9582723

All tests are green, closing this bug as fixed.