Closed Bug 646572 Opened 13 years ago Closed 12 years ago

Significant drop in user counts on GetPersonas.com

Categories

(Mozilla Metrics :: Frontend Reports, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED
Critical/Firefight

People

(Reporter: deb, Assigned: pmartins)

References

()

Details

One of our contributors reported that all of her user counts on GetPersonas.com dropped by about 10% overnight, and a quick check of our most popular Personas appears to show the same.
Apparently this cleared up on April 1st but has happened again today (Apr 7).  Any ideas what might be happening to cause major changes in user counts like this?
Severity: critical → normal
I'll check with Nelson tomorrow and make sure we get an answer back to you in the morning.
Deb, is it possible to meet a few minutes today and discuss this?
Could you give us a detailed workflow on how the numbers we insert into tm-sfx-master01 go into the getpersonas website? What time it runs, what's the cache time to live, etc?

We just ran the job again and the numbers are ok.  It could be that sometimes our data extraction jobs finish later than usual and data is exported incomplete, but we need further investigation in order to reach to a conclusion
They are immediatly updated in the database, but the web server may cache the numbers. IIRC a few forced refreshes made the new numbers appear
The numbers are still jumping around somewhat randomly.  Would a caching issue cause the displayed user numbers to drop (often as much as 15%) if the actual numbers haven't dropped?
Thanks for the heads up. I'll look into it and try to determine where the problem lies. I'll post back in a couple hours at most.
ok, the problem is identified and we're working on a definitive fix.

I'm re-running the numbers, they should update within 1 hour.
The numbers are now up to date.

The problem is related to timezone settings. The job queries for a specific date range and the date range is defined by today's date. The problem is that today on pacific time (which is the time returned by the server when the jobs asks for it) and today on UTC (which is how we refer to data) are not the same thing. The incomplete numbers were displaying everytime the job was run manually after midnight Pacific time. Which explains why it took so long to find out.

It's being fixed and now the job will determine the correct UTC date to use in the query so that it won't happen again.
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
Designers are still reporting unusual user count numbers on their Personas.  I'm not sure if the lower numbers are the correct numbers, or whether there's still an issue with the system.

The forum thread where these are being reported is here: https://forums.mozilla.org/addons/viewtopic.php?f=30&t=2808
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Sorry, I linked to the wrong thread in comment 10.  Correct thread is here:

https://forums.mozilla.org/addons/viewtopic.php?f=30&t=2860
apparentely the fix I put in place didn't prevent the same thing from occurring. I re-ran the numbers they're ok now. Until a definitive fix (and some kind of warning mechanism) is in place we'll have to manually run the numbers everytime the data sync occurs after midnight PDT. It's scheduled to run everyday at 8:30p, but if the automatic process fails we need to run it manually, which typically occurs between 10a and 12p western europe time (hence, 2a to 4a Pacific).

For the record, what happens is that popularity of a persona is defined as the average of the past 7 days, in order to prevent weekly fluctuations. "last seven days" means "today and 6 days before", but "today" doesn't have data if we run the job after midnight pacific time. Hence the ~15% drop when it happens.
Status: REOPENED → RESOLVED
Closed: 13 years ago13 years ago
Resolution: --- → FIXED
A bit more info on the matter.

There is a slight decrease in the overall number of Personas users for the past 4 days straight. Here are the numbers for April:

Dates	7DayAverage	d/d-1
2011-04-01	25,549,449	.20 %
2011-04-02	25,513,741	-.14 %
2011-04-03	25,560,619	.18 %
2011-04-04	25,578,077	.07 %
2011-04-05	25,589,612	.05 %
2011-04-06	25,593,722	.02 %
2011-04-07	25,582,292	-.04 %
2011-04-08	25,586,582	.02 %
2011-04-09	25,606,096	.08 %
2011-04-10	25,581,846	-.09 %
2011-04-11	25,548,756	-.13 %
2011-04-12	25,532,830	-.06 %
2011-04-13	25,513,935	-.07 %
2011-04-14	25,487,575	-.10 %

7DayAverage = average over previous days of total number of personas users
d/d-1 = variation of 7DayAverage from previous day.

The same query but only for the top Persona, Sunset Over Water, returns

Dates	7DayAverage	d/d-1
2011-04-01	823,809	-.13 %
2011-04-02	819,513	-.52 %
2011-04-03	818,574	-.11 %
2011-04-04	817,075	-.18 %
2011-04-05	815,507	-.19 %
2011-04-06	812,992	-.31 %
2011-04-07	809,733	-.40 %
2011-04-08	807,432	-.28 %
2011-04-09	806,538	-.11 %
2011-04-10	803,899	-.33 %
2011-04-11	801,047	-.35 %
2011-04-12	799,627	-.18 %
2011-04-13	798,824	-.10 %
2011-04-14	797,890	-.12 %

The current values are indeed lower than used to, but it seems to be more a trend. Although, having dropped under 800k users, the effect is more noticeable.


I took the liberty of checking manually ColliSmile's personas and they all look ok. In fact, Marshmallow Plush Bunnies went up to 110 users :)
Not sure whether I should open a new bug or not for this, but the designers are reporting that user counts appear to be off by 10% or so again.

If you could take a look, I'd appreciate it.  I will file a new bug if you prefer as well.  Thanks!
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
reopening this bug is just fine. You may also reach me through IRC (nelson_), I'm always at the #metrics channel.

Apparentely there's a day with incomplete data, July 9th, that went under the radar. We'll look into it next monday. Its effect won't be noticeable anymore starting tomorrow, as popularity takes the average of the previous 7 days, but those numbers need to get fixed.
Assignee: nobody → nelson.sousa
Ah awesome.  Thanks Nelson :)
Designers are still concerned about the user count numbers which appear to still be incorrect -- also, it's been reported that the user counts haven't changed at all in 2 days which would be unusual.

Is everything OK with the metrics on getpersonas?
Running the script manually now, should update in a couple of hours.

We have been running into some connection issues while attempting to update the numbers as part of our daily data processing job, I'll file an IT ticket to sort that out.
numbers are updated on the db, getpersonas.com should update once the cache expires.
getpersonas.com with up to date numbers. closing, reopen if needed.
Status: REOPENED → RESOLVED
Closed: 13 years ago13 years ago
Resolution: --- → FIXED
I have one question about this bug being resolved fixed.  I do show a nice upswing on some of my newest Personas, which is great. But my top Persona still shows the 200 user drop that I noticed when I first reported the user drop. There are some others in my top 16 or so that I think are too low also. What I want to know is, was ALL of the User Date used and accounted for, especially the data of July the 9th? I know that some drop is normal after a Persona has peaked, but 200 users short on my top one seems a bit too low to me. Thanks for checking this out. CollieSmile
What's the % drop we're talking about? In the summer there is less usage of the browser as a whole, I would expect personas to display the same behaviour.

Could you tell me the name of one or two of your Personas? (from that I'll get your author id and audit the numbers for all your personas for the past few months and cross reference with Firefox usage to see if there's any abnormality).
Hi! You got back with me very quickly-- thanks! :D

I am especially interested in Butterfly Chain-My first Persona, which had 12,000+ users on it before the drop, and now is at 10,000 something. Also Cotton Candy Swirl, which is 2nd in my gallery. I am also interested in Never Give Up. which had at least 50 users and is still down to 42.

Incidentally, my website is listed on the Forum under my CollieSmile name, and you can also access my gallery by typing CollieSmile in the search bar, as I put it in some of my description fields. I guess I should have mentioned that.

As I stated, I expected some sort of drop, especially on Butterfly Chain as it peaked quite some time ago, but I'm surprised that it didn't seem to recover any users at all with the Resolve Fixed conclusion.

I really appreciate your willingness to check out my gallery, Thank you so much!
Collie  :)
I looked it up and didn't notice anything unusual, data seems ok and data collection too. Indeed your numbers are droping a bit, but that's somewhat expected in the summer, overall Personas usage is slightly down as well.

Both Butterfly Chain and Never Give Up were manually checked and cross-referencing the db totals with the raw logs and the numbers match. Due to the size of the data involved here an automatic check on all of your personas (which are almost 200, kudos to you!) is not feasible.

Sorry I couldn't give you better news, but it seems your persona's usage is down a bit.
Hey, thanks for checking it out for me. Are you sure that you don't want to run the data on my other 198? lol

Honestly, I really appreciate that you double checked them for me. It is so nice to know that the User Count is working as it should again. I know that all of the other designers are happy about that too.

Thank you very much for taking the time to run those Personas.:)

CollieSmile
(In reply to comment #18)
> Running the script manually now, should update in a couple of hours.
> 
> We have been running into some connection issues while attempting to update
> the numbers as part of our daily data processing job, I'll file an IT ticket
> to sort that out.

Hi Nelson. About this connection issue problem... Is it anything like the 9 to 15 minute one that I reported on this thread?  CollieSmile

https://forums.mozilla.org/addons/viewtopic.php?f=30&t=3455
no, it's a technical networking issue. it's being followed by IT. Thanks for your interest.
(In reply to comment #27)
> no, it's a technical networking issue. it's being followed by IT. Thanks for
> your interest.

Oh My Gosh!!! I didn't think the Connections comment I made had even been recorded here! For some reason, I wasn't required to log in when I made it. When I didn't see it show in the report, I didn't it had worked. So I decided to ask a friend of mine on the Forum if there was a more appropriate way that I might get in touch with you. (I will edit that post as soon as I finish writing this.)

I only joined Bugzilla a couple of weeks ago. I freely admit that I am a total newbie. I was wondering if it is even Proper to Make comments on a Bug that is Resolved Fixed, if they don't directly relate to the Bug itself. Please let me know. I don't want to break or mess up rules or anything... I could use some guidance here.

Thank you so much for answering my question. Trust me, I was Very Surprised to get an answer!!! CollieSmile
you probably had an active login on that browser. There's no rule against commenting on closed bugs, comments are here to ask for information and discuss the issues, regardless of bug status.

If you want to contact me directly you can use the bugzilla email listed above or via irc (nelson_  on the #metrics channel)
September 21, 2011

As of September 20th, the user count started malfunctioning again. I have statistics to prove it. They are on this thread in the Personas Forum: https://forums.mozilla.org/addons/viewtopic.php?f=30&t=3949

I am still a Bugzilla Newbie. I realize that this comment is probably not an official re-opening of this bug, but I am hoping that this comment, perhaps with a "second" from Deb, will get this bug reactivated.

I really appreciate all that Deb has done for Personas. She mentioned to me that they are still trying to find a person to oversee Personas full time. Deb has gone above and beyond acting as Personas Manager with all of the other hats that she is wearing!

I am sounding the alarm to hopefully, save her some work. I am also sounding the alarm in the firm belief that this problem will get worse if it isn't addressed soon. Personas numbers have dropped for two days in a row now.   

One other thing also: I don't know exactly when the AMO merge is going to happen, but I know it can't be far off. There will probably be a lot of changes that will be hard to get used to. I am sure that having the user count correct and up to date when the merge happens will prevent some major headaches.

Sincerely,

CollieSmile
Thanks for the heads up. Yesterday's processing finished with errors and we needed to backprocess some data. Unfortunately it's still running. We hope to have the correct numbers within a couple of hours.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
FYI, re-opening a bug is perfectly acceptable. If the issue comes up again, either file a new bug or if you know the number of a bug where the same issue was addressed, commenting on it and changing the status to reopened is the way to go.
please check now. If numbers are correct close the bug, otherwise we'll investigate further.
Hi Nelson.  It is good to know that bug reports can be reopened by relevant comments!  

As far as writing new bug reports, I personally don't have enough knowledge to do that as of yet.(Is there a Bug Report Primer 101 available?)

The User Counts look like they are correct now except that MaDonna's sunset may be a little low. I am going to send her a note and ask her to post on the thread that I mentioned in Comment 30. I am also going to ask 3 other designers I know.

Hopefully things are fixed now, however. Thank you very much!  CollieSmile
Ok, closing the bug. Reopen it if needed (use the selectors down there and change the status to reopened). Yes, Madonna's sunset is a bit low, but the data seems to be correct. It's been decreasing slightly for the past few months.

Bugzilla 101:

To file a new bug about this, use the "new bug" link on top of the page; on product selection go to "Other products" and select "Mozilla Metrics" as product and Frontend reports as component. File in the blanks (leave everything that doesn't seem to apply as default - things like platform, etc). 

People in the metrics team are notified of the new bug and someone will get to it.
Status: REOPENED → RESOLVED
Closed: 13 years ago13 years ago
Resolution: --- → FIXED
I might be jumping the gun here, but I noticed that there has been no change in the user count over night like there usually is. I have checked MaDonna's sunset, several Personas in my own gallery, and another friend's gallery also.

Is this a problem that would lead to a user drop?

CollieSmile
Tuesday November 22, 2011

I think it is quite possible that there has been a User Count Drop again. I thought that I noticed it yesterday.

I have been able to spend very little time on line due to very severe back problems. Therefore I can't supply statistics like I usually do. If the metrics team would check this out, I'd really appreciate it, and I'm sure that other designers would be also.  

Thank you very much for looking into this.

CollieSmile
Shortly after I asked the Metrics team if they could check the User Count, I noticed that MaDonna's Sunset, as well as several of my own Personas went sharply upward in their numbers. :)

Thank you, Metrics Team! I wanted to comment on this good news sooner but it has been difficult for me. With my back problems, I can only sit at my computer for 15 minutes at a time, a few times each day.

CollieSmile

PS. I know that you probably are from all over the place, and don't celebrate the American holiday of Thanksgiving. Nevertheless, I thought you might want to see this Forum link, since I mention you in it. Thanks again for fixing the count!

https://forums.mozilla.org/addons/viewtopic.php?f=30&t=4333
Thanks a lot! 


We has a few network issues on the day you reported a bug that affected several of our systems. Glad it's fixed!


ps: we're indeed from all over the place but we appreciate your words in the post regardless of our origin :) Thanks!
There has definitely been a User Count drop again. I just did some checking around, and I've made the following observations.

1. MaDonna's Sunset is below 500,000 users. Although it's numbers are dropping, it should not be that low.
2. In the Up & Coming Section, Page 1, There are 3 Personas with 81, 89, and 99 users respectively. To be in Up & Coming, a Persona must have at least 100 users.
3. All of the gallery Personas from November 30th through the present have 0 active users. That is the dividing line-- Personas on November 29th do show active users.

It looks like another mystery is afoot for the Metrics Team Detectives.

CollieSmile :)
We had some system issues this last 2 days, that caused us to reprocess the data manually.

But points 2 and 3 actually helped us identify a bug in our reprocess - Fixed :)

About point 1, it's currently over 500k but on the 29th was lower (don't forget that it was thanksgiving week, so global usage drops a bit)
Hey, I am glad I was able to help!

Thanks for getting to the problem so fast!:D That means a lot to Designers, especially at this time of year when we are putting a lot of Christmas Personas through.

CollieSmile :)
A New User Count Drop Dec 30, 2011

Late yesterday, I noticed a drop in user counts on my New Years Personas. Then I realized that the user count drop ran across my entire gallery. I woke up this morning, checked, and found the situation unchanged.

I don't suppose that there is any *good* time for a User Count Drop, but the timing on this one is especially problematic. Many designers who've created New Years Personas are hoping for significant increases in their users. The demand for this type of Persona will drop off abruptly after the 1st of the year.

I am sure that I speak for many. if not all designers when I say that we'll all appreciate this drop in the count being checked out. 

CollieSmile :)
Reprocessing! Tomorrow all should be back to normal!
That is great news!  Thanks a lot for letting me know that, Pedro.

CollieSmile :D
And, done! 


Happy new year!!
Thank you so much again. for getting the User Count accurate! Happy New Year to you all!

I couldn't resist talking you up on a Forum Post again...

https://forums.mozilla.org/addons/viewtopic.php?f=30&t=4533

CollieSmile :D
7 hours ago, I noticed a drop in the User Count again. I didn't have time to report it until now.

There is a drop in all of my Personas. I noticed that on the 1st page of Up & Coming, there are 4 Personas with less than 100 users, similar to what I mentioned in Comment 40.

I didn't get to check the Just Added Gallery very closely, but I know that there's at least one Persona with a user from Jan 02, 2012- it's one of mine (Rainbowed Space Saver.) I don't know if any from Jan 03 have users or not.

People are still choosing New Years Personas. I have one that had almost 100 users until this drop. Thanks in advance for coming to the rescue!

CollieSmile :)
Hi Collie.

The numbers should be good now.
Can you check again, please?

Thanks.
Hi Paula,

The numbers look fine now. I notice that a lot of New Years Personas have gotten pulled into Up & Coming that were not there previously, including one of mine.

Thank you for getting on this problem so quickly. The Metrics Team Rocks!

CollieSmile :D
I have just noticed a very large User Count Drop, one of about 20 percent. (One of my Personas that had 50+ users is down to 40 now.)

I noticed the drop throughout my gallery. If you look at Page One in the Scenery Category, you will see 5 Personas that are below 100 users.

It looks like it's time for some Metrics Team Magic!


CollieSmile:)
Hi Collie,
This should be fixed now.

Now, looking at https://www.getpersonas.com/en-US/gallery/Scenery , I don't see any Personas below 100 users.

Can you check, please?

Thanks.
Everything looks like it is back the way it should be. Thank you for coming to the rescue once again!

CollieSmile :D
Yesterday, I noticed an overall drop, especially in many of my older Personas that have held steady in their numbers for many months.

I didn't report this yesterday because I wanted to see if there were more changes, today. The drop in my older Personas remains the same, and my newer Personas have gained some users.

Was some User Data missed yesterday, or is there some explanation for this? (I noticed these changes on the 1st page of my gallery.)

https://www.getpersonas.com/en-US/gallery/Designer/CollieSmile

CollieSmile :)
Hi Collie,

I've been checking our database and I couldn't find nothing that indicate a loss of data.
The overall figures in the last days are similar to the ​​previous days.

If you continue to see strange values​​, please give us the name of some personas, so we can look in more detail.

Thank you.
Wow! What a drop! I suspected there was one for a few days now, but now there is no doubt!

My Marshmallow Plush Bunnies Persona was at 858 on March 24th, then the next day 839, then 832 early today. Now it registers at 703 users!
https://www.getpersonas.com/en-US/persona/377783

Another one I was keeping an eye on was my Star Swirl Persona. On the same days as my Persona above, it registered 856, 843,and 842 earlier today. Now it registers at 715 users. 
https://www.getpersonas.com/en-US/persona/248254

In addition to these there is a very noticeable drop in users throughout my entire gallery.

CollieSmile :)
Hi, it is me again. I just checked out the Yahoo Persona at the top of the Popular gallery. It had over 1 million users earlier today. now it has 929,112.

https://www.getpersonas.com/en-US/persona/340931

I would have added this data to Comment 56, but I don't see a way to edit comments.

Collie
Hi Collie,

Reprocessing! 
Tomorrow all should be back to normal!

Thanks for letting us know.
Hi Collie,

This should be fixed now.
Can you check, please?

Thanks.
Wow! Already?

Everything looks good on getpersonas.com now. at ;east as far as I can tell. Thank you!!! :D

Collie

PS. I couldn't resist taking one peak at the new Add-ons Website. I noticed that the numbers on the Yahoo Persona are down.   https://addons.mozilla.org/en-US/firefox/personas/  I'm sure, however that you know about that already and it has something to do with data that hasn't been transferred yet.

Again, thank you very much. You rock!
Hello, Metrics Team! Here we go again...

A short while ago, I started noticing another User Count Drop on getpersonas.com. I've had a pretty good look around this time.

The Yahoo! Persona on page one of Popular is under 1 million users. There is a significant drop in users throughout my gallery. My Marshmallow Plush Bunnies Persona is down by at least 128 users from about 857. (There is a link to that Persona in Comment 56.)

On page one of both Holiday Personas and Nature Personas, there are Personas (2 per page) below 100 users, which of course, is not normal.

CollieSmile :)
I just got on line, and all of the counts look good again!!!

I am assuming that it is Metrics Team Magic at work again. Thank you for your dedicated work, and have a Happy Easter!!!!

CollieSmile :)
Hi Metrics Team!

For the first time in a long time, someone noticed an Active User Count problem before I did. More power to them! :D Their name is Moyra1, and I believe they might live in France. Here is their post on the Forum that led me to check out the User Count.

https://forums.mozilla.org/addons/viewtopic.php?p=20012#p20012

There are no big User Count Drops registering at this time. But there are several pages of Just Addeds that show No user count gains whatsoever.

The first Persona with a User on it is this one: dated April 16th. https://www.getpersonas.com/en-US/persona/466524

I know that getpersonnas was down last night for maintenance issues. Perhaps this was one of the issues...(?)

As always, I look forward to you working your magic!

CollieSmile :D
Hi Collie,

Last week we moved our machines to another place, and we are still finishing the "moving process".

Tomorrow, the Personas numbers already should be updated.

Sorry for that.
A number update tomorrow sounds good! I have a question though.

Amy Tsay reported that some data had been lost. I think she means data for the active user count, but I am not certain about that. Here is the link.

https://forums.mozilla.org/addons/viewtopic.php?p=20194#p20194

If this report IS about the Persona active user count--will the updated numbers average out correctly? Or will a drop some sort of drop show up?

Collie
There is definitely confusion about whether the Active User Count is working again or not. I don't think it's been fixed, and neither do many other people.
But Amy Tsay apparently thought that it was working once again.

Can you clarify what is going on with it?  Here is our confusion in a nutshell, on this Forum thread: https://forums.mozilla.org/addons/viewtopic.php?p=20821#p20821

Thanks a lot!

CollieSmile :)
CollieSmile, there are issues indeed. We moved servers last week and it's still a chaos here. We're on top of this!
Assignee: nelson.sousa → pmartins
The personas server has also moved and we need access to it from the new data center. Being tracked here: https://bugzilla.mozilla.org/show_bug.cgi?id=749689
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
It is great to know that all of this is being worked on! Thankyou! :D

The only thing is that I've tried to check the new bug track listed in Comment 68, and I was denied access. Is that a mistake, or is it for security purposes?

Curiously,

Collie
I made that bug confidential by mistake, as I wasn't sure :P. Anyway, the access to the new server is now granted and we'll try to resume the processing of the data asap.
Hi Metrics Team and other Active User Count Battlers:

I was wondering what progress you have been able to make on this bug lately. There are many sad designers waiting for news  

https://forums.mozilla.org/addons/viewtopic.php?p=20946#p20946

Submissions have been way down the past few days. I suspect that many designers have decided not to upload any more Personas until the User Count has been fixed.

Any update you can give would be much appreciated.

CollieSmile :)
Lemme ping IT again. I'll update this bug before EOD
gaaah, there was a server move. We're on it, we'll need more time to fix this
Hi again Metrics Team and all other Active User Count Battlers,

I was stuck offline for a couple of days. Just got telephones and internet back an hour ago. It is great to be back on!

I may be stating the obvious here, but here goes anyway--

All of the active User counts at getpersonas.com are zeroed out now. But I notice that the AMO data that has been static since April 21st is still intact.

I checked the Counts out because of this post here, and the cheerier one beneath it.

https://forums.mozilla.org/addons/viewtopic.php?p=21177#p21177

I hope you can recover the User Data or at least the data on AMO.

Hang in there everybody! We are rooting for you!

CollieSmile :)

PS. I'm sure learning how inconvenient server problems can be. My graphic arts program was messed up for days because of server problems.
We're on top of this, high priority. Data was not loss and we'll recover it early next week. May take some time cause there's tons of users (fortunately) but we'll get there!


Sorry for the inconvenience everyone!
Collie Smile...I believe the only reason the user counts at AMO still appear to be intact is because of the 24-48 hour delay we experience between the user count numbers there and what we have in real-time at the getpersonas.com sites. Either today or tomorrow I'm sure we'll be seeing the zero user counts for all the personas in all the galleries there too.  Of course this newest problem has effected the Up & Coming pages and the Popular pages. 
Question for Pedro. The last time we experienced something similar before yesterday's melt down was back in December of 2010. Once the problem was rectified all of the personas with a zero count had to be HAND counted. This then took a couple more weeks for the situation to be back to normal. Please tell me another system has been put in place since then so that the lost user counts won't have to be HAND counted. If that's the case we might not be back to normal for 6-8 months at getpersonas.com or AMO. 
I'm cheering you and your team on! A very concerned user, designer and reviewer, Lisa
Hand counted? No, in a universe of about 20 million personas users daily that concept doesnt even make sense. We'd be talking about 8 decades, not 8 months :-)


We need time cause the information we need to process is huge, purely cpu power
Whew! That's good to know, Pedro! It does seem antiquated that in this day and age the lost personas had to be hand counted.  Deb Richardson can verify that fact. :)
Thanks to the team fixers! Best wishes to succeed and i cross my fingers.
Have a nice day! :)
Hi Metrics Team & Other User Count fixer Heroes...

I know that you are spread pretty thin right now, and may not have had time to work on this bug lately. 

I just wanted you to know that I have made a tough but necessary decision. I am leaving Firefox and Personas altogether, and Bugzilla also. At least I think I'm leaving Bugzilla--- I tried to change my votes and I'm not sure if it worked or not. Maybe once you are a bug, you are always a bug... lol

My decision has nothing to do with the numerous Persona bugs that are going on right now. In fact, I bragged you all up in my final forum post, and you all deserve every word of it.

https://forums.mozilla.org/addons/viewtopic.php?f=30&t=9885

I know I'm leaving this bug in good hands. I am sure that Lisa, Moyrat, BrianZ, and other designers will be right on top of things. Bless you all-- and keep on doing a great job!

It has been a pleasure to interact with all of you. Hang in there!

CollieSmile :D
oh, that's a shame to hear, I do hope you return / change your mind. on our side we're working tirelessly trying to get this fixed, but it's not easy...
Hey, thanks Pedro. That's really nice of you to say-- and I know that you have quite a battle on your hands getting things working right again. 

I have been deleting bookmarks and trying to wrap things up, and I've been designing wallpaper for Nexus today. I'm planning to move off the browser in one week. I'll be switching to Google Chrome.

If Mozilla Firefox & Personas ever move back to being a more family friendly site, I'll seriously think about coming back, but at this point in time, I don't think that is going to happen.

Again, I wish all of you the best. I Know you will beat this bug, like you have done many times before. :D
Finally, the comment that I waited for so long to post here!


The backprocess is complete (at a rate of 3h of backprocessing per day). Took ages, mostly cause we have a great amount of users, which is cause by a thrilling amount of great designers.


The numbers are up to date, and will keep being updated normally from now on. I appologise for all this inconvinience. Now I'll get some sleep! :)


If anyone makes a persona of a metrics guy banging his head on the wall on frustration, I'll use that one, but all is good now :)
 

- Mozilla metrics team
Status: REOPENED → RESOLVED
Closed: 13 years ago12 years ago
Resolution: --- → FIXED
Thank you Pedro and Mozilla Metrics Team for getting the persona user counter fixed! YAY! You've made many designers very happy.  :)  Lisa
Hello Metrics Team,
Yesterday we experienced a drop in user count numbers. I know in the past when
this happened Collie Smile would alert you. My question to you is, is that necessary to do or will the problem correct itself within a 24 hour cycle next
time new user numbers show up? If it's the latter then I won't notify you if
the problem arises in the future.
Many thanks, Lisa
Hello Lisa,

I just took a look at the "Lightweight themes" cube and, if there was a problem, it seems like the problem has solved itself with the last ETL autorun. If you continue seeing something out of normal, please let us know, but 24h seems like a safe waiting period before triggering an alarm :)

Thank you for being on top of this,
Pedro Martins
Hi Pedro,
Checking my persona gallery this morning it appears the user count for personas is not functioning and those personas submitted from July 6 til now remain at "0". This is very similar to the last problem that occurred back in April. 
I don't know if this will help but this is a link to a persona of mine that was
submitted on the 6th of July and remains at 0. 
https://www.getpersonas.com/en-US/persona/474704 
Eight other new personas of mine that were submitted July 6th and 7th also remain at zero count and that is not normal. I want to catch this problem now before it gets out of hand like it did in April.
Many thanks, Lisa
The problem seems to not have gone away. I believe the Up & Coming section is affected by active user count, and currently the page is showing personas from 2008: https://www.getpersonas.com/en-US/gallery/All/Movers

By comparison, the page on AMO seems to be functioning correctly: https://addons.mozilla.org/en-US/firefox/personas/?sort=up-and-coming
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Hello there,

We have detected today that problem and it will be solved in the next 24h. We had a server misconfiguration and are reprocessing the logs.

If you don't see this solved in the next ~24h, let us know.
Thanks,
Pedro
Just checking in with you, Pedro.
Had a look at my persona gallery and the user
numbers are now showing up for those personas
submitted July 6th and forward. Excellent!
Thanks for handling this glitch so quickly.
Lisa
G'morning Pedro,
It appears we celebrated too soon. Newly
submitted personas from July 11 are still
at zero count.  That shouldn't be.  It tells
me that there is another server misconfiguration.
Please look into it before the weekend is
upon us. Here is a link to a new persona that
was submitted on Wednesday has has a 0 count.
https://www.getpersonas.com/en-US/persona/475121
TGIF! :)  Lisa
We already have somebody on it, this was detected before. We'll update this, hopefully today.
Seriously, TGIF :)
Hello Pedro,
I have good news...and bad news. Good news first. There are numbers attached to
personas submitted after July 11th now.  Bad news, the user count numbers have
dropped by 75% across the board.
I started keeping track of my own persona numbers do I could be of more assistance
to you if this problem occurred. I'll supply you with a persona link of mine which
was at 4805 yesterday and now at 1214 this AM.
https://www.getpersonas.com/en-US/persona/471438
I realize this might have to wait until Monday but wanted to keep you up-to-date.
Lisa
Additional information regarding persona link above.  On July 12 and 13 the user number count stayed static at 4805. That is abnormal. Then this AM it crashed to 1214.  Lisa
Hello Pedro,
This problem seems more involved than originally thought. Is it possible to get
an update from you and an estimate of how much longer before the user counter is back on track?  The user numbers have gone up but my calculations show the count is 40%+ off the numbers they should be. The persona link I supplied on July 14th has a current user count of 3622 but still has a ways to go before it will be at it's accurate number.
Thanks, Lisa
Hi Lisa,

The numbers are not yet fixed, the problem proved indeed to be more difficult to fix. We are checking the logs for personas and reprocessing the data for some past days, to make sure that everything is fine. This is happening today and tomorrow and I hope to give you an update here before the end of this week. Apologies for not bringing you feedback before, but there's not really much that I can say atm.

Thanks,
Pedro
Pedro...I truly appreciate you taking the time from your busy schedule to drop us a line on the progress made so far and what lays ahead before the counter is fixed. Speaking for other persona designers, we are cheering you and your team on and eagerly awaiting for the thumbs up from you. I'll be posting your newest comment at the forum for others to read.  Many thanks.  Lisa
Hi Lisa,

A few days have passed and I think that the data is now ok. Can you please confirm?
Status: REOPENED → RESOLVED
Closed: 12 years ago12 years ago
Resolution: --- → FIXED
Hi,

In the Up & Coming Section, Page 1 (Film and TV), There are Personas with 79, 78, and 89 users. To be in Up & Coming, a Persona must have at least 100 users.

https://www.getpersonas.com/en-US/gallery/Film+and+TV
Working on this
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
If we need to evaluate changing filter thresholds, that should be opened as a new bug.  As I understand, there isn't any outstanding problems with the processing at this point in time, so re-closing.

If we do have future problems around processing, please make sure to open a new bug rather than reopening this one.
Status: REOPENED → RESOLVED
Closed: 12 years ago12 years ago
Resolution: --- → FIXED
Target Milestone: Unreviewed → Critical/Firefight
You need to log in before you can comment on or make changes to this bug.