1311335 - Investigate recent increase in Other ping size + count

Status: RESOLVED FIXED

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

Description

[Mark Reid [:mreid]]

Looks like there has been a marked increase in pings other than "main" and "saved-session". 

Currently the increase is reflected on nightly and aurora channels, we should figure out the cause and whether it will be a concern on release.

Comment 1

[Mark Reid [:mreid]]

This appears to be primarily due to an increase in the number and size of "testpilottest" pings.

Next up: identify which test is sending them.

Comment 2

[Mark Reid [:mreid]]

From yesterday, 2016-10-18
Ping counts:
[(u'[e-mail]', 1244),
 (u'[e-mail]', 8537),
 (u'[e-mail]', 24138),
 (u'[e-mail]', 205051),
 (u'@min-vid', 36904166)]

Ping sizes (bytes):
[(u'[e-mail]', 14815681.0),
 (u'[e-mail]', 113386766.0),
 (u'[e-mail]', 301701394.0),
 (u'[e-mail]', 2581420071.0),
 (u'@min-vid', 423394728170.0)]

Comment 3

[Mark Reid [:mreid]]

Here's a (rough) notebook with more details:
https://gist.github.com/mreid-moz/17a7cde29cb8270e317d12b68ec51dc1

The takeaway is that it appears to be the min-vid testpilot test, which is sending quite a lot of data from version 0.3.1.

In the grand scheme, it's not a huge deal, but it's enough data that it might be impacting client experience to send in such volume.

Comment 4

[Mark Reid [:mreid]]

Cory and Jared - are these min-vid submission volumes expected? Is there anything else you'd like to clarify?

If this is considered normal, it's not a problem, I just want to make sure it's not something going haywire.

Comment 5

[Cory Price [:ckprice] (bugmail disabled, NI me!)]

+dave, wil

Comment 6

[Wil Clouser [:clouserw]]

Being investigated at https://github.com/meandavejustice/min-vid/issues/457

Comment 7

[Mark Reid [:mreid]]

(In reply to Wil Clouser [:clouserw] from comment #6)
> Being investigated at https://github.com/meandavejustice/min-vid/issues/457

Cool. I'm going to close this one as "investigation complete". If you need more info, feel free to reopen or file a new bug.