1891083 - (skylight-clarify-prod-msgs-hdr) make Skylight "Production Messages (Release Channel)" clearer

Status: RESOLVED FIXED

(Firefox :: Messaging System, enhancement, P1)

Description

[Dan Mosedale (:dmosedale, :dmose)]

As an unfamiliar messaging dashboard viewer (leader, pm, or engineer), I'd like to instantly understand the main point of the top table, so that I know what I'm looking at on my first experience.

Right now, the top table is titled "Production Messages - Release Channel (*). Arguably every word except "messages" is jargon. For now this is aimed at engineers & PMs, but still.

For those who understand what the release channel is, it would be good to communicate that.
For those who understand that these are in-tree, it would be ideal to communicate that, but I'm not sure how important this is, since to most users they would be equivalent to Nimbus rollouts (which we don't yet display)
Since the experiments don't currently display above the fold, it would ideal to communicate that these are not experiments (I suspect we're going to want to adjust the UI in others to make that clear eventually).

For now, one possibility could be:

Live Messages
(Release Channel) * <- smaller font

We could also consider making the top line

Live Non-Experimental Messages
(Release Channel) * <- smaller font

Thoughts, Tina?

Comment 1

[tvaamonde]

(In reply to Dan Mosedale (:dmosedale, :dmose) from comment #0)

As an unfamiliar messaging dashboard viewer (leader, pm, or engineer), I'd like to instantly understand the main point of the top table, so that I know what I'm looking at on my first experience.

Right now, the top table is titled "Production Messages - Release Channel (*). Arguably every word except "messages" is jargon. For now this is aimed at engineers & PMs, but still.

For those who understand what the release channel is, it would be good to communicate that.
For those who understand that these are in-tree, it would be ideal to communicate that, but I'm not sure how important this is, since to most users they would be equivalent to Nimbus rollouts (which we don't yet display)
Since the experiments don't currently display above the fold, it would ideal to communicate that these are not experiments (I suspect we're going to want to adjust the UI in others to make that clear eventually).

For now, one possibility could be:

Live Messages
(Release Channel) * <- smaller font

We could also consider making the top line

Live Non-Experimental Messages
(Release Channel) * <- smaller font

Thoughts, Tina?

Hi Dan,
Working on this now. I have a few questions so I can verify if what I have in my notes is accurate. That'll help me think of the most clear labeling for the table header.

• Are these messages all currently live? My understanding is that they've been live on Firefox at one time, but may not currently be running. True?
• Is it true that all messages here are not part of experiments? Could some of them have started out as experiments and then winners may have been rolled live?

Comment 2

[Dan Mosedale (:dmosedale, :dmose)]

(In reply to tvaamonde from comment #1)

• Is it true that all messages here are not part of experiments?

That is not necessarily true, although much/most of the time it should be correct. I've just filed https://bugzilla.mozilla.org/show_bug.cgi?id=1894313 to track this.

Could some of them have started out as experiments and then winners may have been rolled live?

This is quite likely. That same bug captures this issue as well.

Does that answer your questions sufficiently?

Comment 3

[Dan Mosedale (:dmosedale, :dmose)]

Missed answering this one:

• Are these messages all currently live? My understanding is that they've been live on Firefox at one time, but may not currently be running. True?

That is correct. At the moment, we've got one message showing there that has been shown twice in the last month. We already have a bug filed to audit and remove old messages, but there is a question about what we do in cases like this. I've filed https://bugzilla.mozilla.org/show_bug.cgi?id=1894361 to decide the next steps here.

Comment 4

[tvaamonde]

Hi Dan,

For the headline, I think this might work and then you could put Partial List in parentheses below for now:

Messages Released on Firefox
(Partial List)

Based on your comments in my content doc, I think this string might be the most accurate to explain this table. I'm not sure of the best way to show this string. Maybe it comes up when you hover over an info icon?

All messages listed in this table are in the release channel and are either currently live or have been live on Firefox at one time.

To create more clarification between the two tables/headlines, I am wondering if it makes sense to you to change
Live Message Experiments: 11 total
to
Current Message Experiments
Total: 11

I think the word "live" makes it more difficult to distinguish between the two lists. But let me know what you think!

Comment 5

[Dan Mosedale (:dmosedale, :dmose)]

(In reply to tvaamonde from comment #4)

Hi Dan,

For the headline, I think this might work and then you could put Partial List in parentheses below for now:

Messages Released on Firefox
(Partial List)

This sounds great.

Based on your comments in my content doc, I think this string might be the most accurate to explain this table. I'm not sure of the best way to show this string. Maybe it comes up when you hover over an info icon?

All messages listed in this table are in the release channel and are either currently live or have been live on Firefox at one time.

Doing this as a tooltip seems reasonable.

To create more clarification between the two tables/headlines, I am wondering if it makes sense to you to change
Live Message Experiments: 11 total
to
Current Message Experiments
Total: 11

I think the word "live" makes it more difficult to distinguish between the two lists. But let me know what you think!

The nice thing about "live" is that that's the terminology that experimenter uses. That said, I think current does make it clearer, so let's go with that.

Comment 6

[Dan Mosedale (:dmosedale, :dmose)]

(Thanks, Tina!)