integrate webtrends with bugzilla.mozilla.org

RESOLVED FIXED

Status

()

bugzilla.mozilla.org
Extensions: Other
--
enhancement
RESOLVED FIXED
6 years ago
6 years ago

People

(Reporter: glob, Assigned: glob)

Tracking

Production
Dependency tree / graph

Details

Attachments

(1 attachment, 1 obsolete attachment)

(Assignee)

Description

6 years ago
is there a facility which provides a breakdown on the web traffic bmo is serving?

i'm after information like visitor counts, browser information, .. all the usual data which most web server log analyzers generate.

eg. the sort of reports which piwik generates.

Updated

6 years ago
Assignee: server-ops → nobody
Group: metrics-private
Component: Server Operations → Data/Backend Reports
Product: mozilla.org → Mozilla Metrics
QA Contact: cshields → data-reports
Version: other → unspecified
(Assignee)

Comment 1

6 years ago
in my intranet travels i stumbled across webtrends, which may be suitable.
i'm waiting for a webtrends account so i can evaluate it.
(In reply to Byron Jones ‹:glob› from comment #1)
> in my intranet travels i stumbled across webtrends, which may be suitable.
> i'm waiting for a webtrends account so i can evaluate it.

Link to creating a new account for myself as well?

dkl
(Assignee)

Comment 3

6 years ago
webtrends is definitely what i had in mind, morphing bug.
Group: metrics-private
Component: Data/Backend Reports → Extensions: Other
Depends on: 698329, 698330
Product: Mozilla Metrics → bugzilla.mozilla.org
QA Contact: data-reports → extensions
Summary: traffic stats for bmo → integrate webtrends with bugzilla.mozilla.org
Version: unspecified → Current
piwik uses JS or image tagging which is the same as what Webtrends supplies.  In order to get webtrends integrated, changes would have to be made to the bugzilla webapp templates.

Metrics maintains a small instance of awstats which provides simple weblog only based metrics.  It does include visitor, session, entry/exit, and browser info.  Would you like to explore that rather than going the route of webtrends integration?
(Assignee)

Comment 5

6 years ago
(In reply to Daniel Einspanjer :dre [:deinspanjer] from comment #4)
> piwik uses JS or image tagging which is the same as what Webtrends supplies.
> In order to get webtrends integrated, changes would have to be made to the
> bugzilla webapp templates.

yup, that's what this bug is now about :)  i've generated sample code for another site and it looks trivial to deploy.

> Metrics maintains a small instance of awstats which provides simple weblog
> only based metrics.  It does include visitor, session, entry/exit, and
> browser info.  Would you like to explore that rather than going the route of
> webtrends integration?

thanks... the preference at this stage is to use webtrends; let's consider awstats a fallback :)
Created attachment 570758 [details]
Pentaho Data Integration script to map names from AMO hosted add-ons

Can only be run with PDI.  Here just for safe keeping
Comment on attachment 570758 [details]
Pentaho Data Integration script to map names from AMO hosted add-ons

D'oh!  Attached to the wrong bug.  Please disregard.
(Assignee)

Updated

6 years ago
Attachment #570758 - Attachment is obsolete: true
(Assignee)

Comment 8

6 years ago
bmo has been added to webtrends \o/

we need to add the tracking code to the footer.  the sample code provided (bug 698329 comment 2) doesn't use https to deliver the script, which triggers 'mixed content' warnings in firefox (ensure security.warn_viewing_mixed is enabled).  unfortunately the certification on mozcom-cdn isn't valid for our domain so we can't simply use https.

the simple fix is to keep a local mirror of the script and serve it from bmo.
Assignee: nobody → glob
(Assignee)

Comment 9

6 years ago
Created attachment 573096 [details] [diff] [review]
patch v1

this adds webtrends as per dkl's original patch, with the following differences:
  - the webtrends javascript is being served from bmo rather than cdn
  - enable webtrends on the production site only

in order to keep our mirror up to date, i've scheduled a simple notification script on my dev box (http://glob.pastebin.mozilla.org/1377786).
Attachment #573096 - Flags: review?(dkl)
Comment on attachment 573096 [details] [diff] [review]
patch v1

Review of attachment 573096 [details] [diff] [review]:
-----------------------------------------------------------------

Thanks for catching the errors with my previous commit. This looks better and works as expected. r=dkl
Attachment #573096 - Flags: review?(dkl) → review+
(Assignee)

Comment 11

6 years ago
Committing to: bzr+ssh://bjones%40mozilla.com@bzr.mozilla.org/bmo/4.0/
added extensions/BMO/template/en/default/hook/global/footer-end.html.tmpl
added extensions/BMO/web/js/webtrends.js
Committed revision 7935.
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
This got cleared with infrasec/privacy, right?  Anything that provides additional tracking of users needs to get cleared before it's deployed.
(Assignee)

Comment 13

6 years ago
(In reply to Dave Miller [:justdave] from comment #12)
> This got cleared with infrasec/privacy, right?  Anything that provides
> additional tracking of users needs to get cleared before it's deployed.

no; you're the first person to make me aware of this requirement.  i'll follow this up.
(Assignee)

Comment 14

6 years ago
backed out:

Committing to: bzr+ssh://bjones%40mozilla.com@bzr.mozilla.org/bmo/4.0/
deleted extensions/BMO/template/en/default/hook/global/footer-end.html.tmpl
Committed revision 7937.

i have emailed the privacy team.

mcoates has said there's no need for a security review for this:
<glob> mcoates, i didn't think a sec review was required as we're not adding any code that isn't already in use (it's just the standard webtrends javascript thing)
(discussion snipped)
<mcoates> glob: you are correct. just touch base with privacy
Status: RESOLVED → REOPENED
Resolution: FIXED → ---

Comment 15

6 years ago
No privacy concerns with this. Since bugzilla uses the Mozilla privacy policy, there's no privacy blocker here.
Cool So I assume glob can put this back in now then and we can go live with this feature.

dkl
(Assignee)

Comment 17

6 years ago
thanks tom :)

Committing to: bzr+ssh://bjones%40mozilla.com@bzr.mozilla.org/bmo/4.0/
added extensions/BMO/template/en/default/hook/global/footer-end.html.tmpl
Committed revision 7956.
Status: REOPENED → RESOLVED
Last Resolved: 6 years ago6 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.