Pull app stats out of metrics

RESOLVED FIXED

Status

Marketplace
Statistics
P2
normal
RESOLVED FIXED
6 years ago
6 years ago

People

(Reporter: Andy McKay, Assigned: xstevens)

Tracking

x86
Mac OS X
Points:
---
Dependency tree / graph

Details

(Reporter)

Description

6 years ago
Now that stats for the marketplace are going into metrics, we need to pull them back out again.

We'll need to create the appropriate tables in marketplace and have metrics write into them. Based on the spec:

"the  number of new installations of a particular app per day over time, and  should include information on the device and source that was used to  acquire it, e.g. Mozilla Market App’s Search on Android Ice Cream Sandwich."

How about:

webapp_stats_date
- app
- date
- count

webapp_stats_device
- webapp_stats_id
- device_type
- count

webapp_stats_source
- webapp_stats_id
- source
- count
Blocks: 695236
No longer blocks: 752013
Component: Developer Pages → Statistics
QA Contact: developer-pages → statistics
Priority: -- → P2
(Assignee)

Comment 1

6 years ago
Andy, Here's a data example of one of the items we received yesterday:

{"app-domain": "enjoy.your-clock.com", "locale": "ja", "src": "", "app-id": 372921, "user-agent": "Mozilla/5.0 (Windows NT 5.1; rv:12.0) Gecko/20100101 Firefox/12.0"}
(Reporter)

Comment 2

6 years ago
As per meeting yesterday, first step is to produce some text files of the output, we'll write a script to pull that data off the site and place it into the marketplace database.

So filing this to @xstevens for that first part, then we'll file bugs to get the next part done.
Assignee: nobody → xstevens
(Reporter)

Updated

6 years ago
Blocks: 761798
Would you like for us on the Marketplace to do some sniffing so we can guess on which device the app was installed and send that along? (Right now with our JS detection we can make a pretty good guess of whether you're on a phone vs. tablet vs. desktop.) Knowing on which device an app is being used - that's blocked by AITC - but this seems like a good first step.
(Reporter)

Comment 4

6 years ago
I was thinking it might be to do that at the metrics cluster since we'll need to repeat the same code for all data going into metrics, be it pings from marketplace, AITC or reading web logs.

However I think if we can get as much information into metrics, it can't hurt. So any additional information (touch, screen res, etc.) could be helpful in conjunction with the user-agent.
(Assignee)

Comment 5

6 years ago
Andy, Here's some examples from my runs: https://metrics.mozilla.com/protected/marketplace/
(Reporter)

Comment 6

6 years ago
Looks good. 

Could we get app-id on this one, so we can correlate:

https://metrics.mozilla.com/protected/marketplace/webapp_stats_date-2012-06-03.txt

Is it possible to add in device type to:

https://metrics.mozilla.com/protected/marketplace/webapp_stats_device-2012-06-03.txt

I think we need to provide you regexes for that?
(Assignee)

Comment 7

6 years ago
Shouldn't be a problem to add app-id.

And yes I think you were going to provide some regex code or some sort of specification for what the device type should be. I'm descent at regex but I need to know what you want.
(Assignee)

Comment 8

6 years ago
Updated the webapp_stats_date with appid included.
(Reporter)

Comment 9

6 years ago
Thanks xstevens, until we can figure out device types, want to start that going nightly?

Anything else you want @ngoke, @cvan?
(Assignee)

Comment 10

6 years ago
All set to run nightly and I'm running the backfill right now. Should be done in the next half hour or so. Files are currently located in the same directory as Comment 6.

Should I close this out and you can open up a new ticket when the device stuff is ready?
(Reporter)

Comment 11

6 years ago
Sounds good, thanks Xavier.
(In reply to Xavier Stevens [:xstevens] from comment #10)
> All set to run nightly and I'm running the backfill right now. Should be
> done in the next half hour or so. Files are currently located in the same
> directory as Comment 6.
> 
> Should I close this out and you can open up a new ticket when the device
> stuff is ready?

Yes, please do. Thanks for working on this!
(Assignee)

Comment 13

6 years ago
Resolving this for now. New adjustments and issues can be filed separately.
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.