HTTP Referer not set when clicking articles

VERIFIED FIXED in Firefox 66

Status

()

defect
P1
normal
VERIFIED FIXED
6 months ago
2 months ago

People

(Reporter: Mardak, Assigned: Mardak)

Tracking

(Blocks 1 bug, {github-merged})

unspecified
Firefox 67
Points:
---
Dependency tree / graph
Bug Flags:
qe-verify +

Firefox Tracking Flags

(firefox66+ fixed, firefox67 verified)

Details

User Story

https://github.com/mozilla/activity-stream/commit/c2cb83a9fef67c95ab184952be414a819ddc4e3a

Attachments

(6 attachments)

pdahiya noticed "while working on <jsm> changes to support context menu options, I realise we need site_referrer thats in default activity stream coming from prefs https://searchfox.org/mozilla-central/search?q=stories_referrer"

This means discovery stream isn't attributing link clicks to pocket where topstories would use the value set in the pref browser.newtabpage.activity-stream.feeds.section.topstories.options

… "stories_referrer":"https://getpocket.com/recommendations" …

Probably pretty straightforward fix, please request uplift once you land a patch.

Assignee: nobody → edilee
Priority: -- → P1
Iteration: --- → 67.3 - Feb 25 - Mar 10
User Story: (updated)
Keywords: github-merged
Posted image QA steps result

QA steps:

  1. open up Browser Console (Tools -> Web Developer -> Browser Console)
  2. make sure [Requests] is selected
  3. open up new tab page (with discovery stream enabled)
  4. click on an article
  5. find the first request for the article (should match the url on the link)
  6. expand request with default Headers tab selected
  7. make sure "Referer" is set in the Request headers section (under Response headers; can filter for "refer")

step 7 should look like attached. (Alternatively, if you know of easier ways to inspect request headers, do that! :))

Comment on attachment 9048965 [details]
Bug 1533089 - HTTP Referer not set when clicking articles

Beta/Release Uplift Approval Request

  • Feature/Bug causing the regression: Bug 1512725
  • User impact if declined: 66 experiment users' visits to articles don't get attributed to coming from pocket, so publishers might think they're getting less pocket recommendation traffic and be less inclined to have relationships with mozilla
  • Is this code covered by automated tests?: No
  • Has the fix been verified in Nightly?: No
  • Needs manual test from QE?: Yes
  • If yes, steps to reproduce: comment 4
  • List of other uplifts needed: None
  • Risk to taking this patch: Medium
  • Why is the change risky/not risky? (and alternatives if risky): Not a trivial fix as it changes how clicking links work, which is a core feature, but the implementation mostly reuses link-clicking-with-referrer functionality that has been in use in firefox for many releases now
  • String changes made/needed: none
Attachment #9048965 - Flags: approval-mozilla-beta?

Uplift note: unlike other uplifts that needed separate phabricator patches specially for mozilla-beta, this one for mozilla-central (which hasn't landed yet as of this comment) applies cleanly to mozilla-beta so the mozilla-central commit can be used directly

Pushed by elee@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/61f7f4614016
HTTP Referer not set when clicking articles r=k88hudson
Blocks: 1533170
Status: NEW → RESOLVED
Closed: 6 months ago
Resolution: --- → FIXED
Target Milestone: --- → Firefox 67
Flags: qe-verify+

Brahmini can you take a look at the QA steps for this?

Flags: needinfo?(bnagabandi)

(In reply to Ed Lee :Mardak from comment #4)

Created attachment 9048966 [details]
QA steps result

QA steps:

  1. open up Browser Console (Tools -> Web Developer -> Browser Console)
  2. make sure [Requests] is selected
  3. open up new tab page (with discovery stream enabled)
  4. click on an article
  5. find the first request for the article (should match the url on the link)
  6. expand request with default Headers tab selected
  7. make sure "Referer" is set in the Request headers section (under Response headers; can filter for "refer")

step 7 should look like attached. (Alternatively, if you know of easier ways to inspect request headers, do that! :))

QA Results:

Tested on :

FF Nightly version : 67.0a1 (2019-03-07)
OS : Mac and Windows 10 Pro

[Prerequisites]:

  • The browser.newtabpage.activity-stream.discoverystream.config pref is set to default
  • Discovery Stream is also set to Enabled

Works as expected.

NOTE:

  • On Mac OS, FF Nightly shows googleapis as the first request, and then the article request.
  • On Windows OS - article request is the first request.

Below are attached results for both OS.

Status: RESOLVED → VERIFIED
Flags: needinfo?(bnagabandi)

Comment on attachment 9048965 [details]
Bug 1533089 - HTTP Referer not set when clicking articles

Last minute fix for pocket/new tab issue, verified in nightly.
OK to uplift for the RC next monday.

Attachment #9048965 - Flags: approval-mozilla-beta? → approval-mozilla-beta+
QA Whiteboard: [qa-triaged]
Blocks: 1533832
Status: VERIFIED → RESOLVED
Closed: 6 months ago5 months ago
Status: RESOLVED → VERIFIED
Component: Activity Streams: Newtab → New Tab Page
You need to log in before you can comment on or make changes to this bug.