Keyword cache not updated on keyword rename/delete (remove the keyword cache)

RESOLVED FIXED in Bugzilla 4.0

Status

()

Bugzilla
Administration
P1
major
RESOLVED FIXED
16 years ago
6 years ago

People

(Reporter: CodeMachine, Assigned: Frédéric Buclin)

Tracking

unspecified
Bugzilla 4.0
Dependency tree / graph
Bug Flags:
approval +

Details

Attachments

(1 attachment)

13.96 KB, patch
Max Kanat-Alexander
: review+
Details | Diff | Splinter Review
(Reporter)

Description

16 years ago
I noticed this morning this from mozilla.org sanitycheck.cgi:

Checking cached keywords 

Bug(s) found with incorrect keyword cache: 46700, 47682, 48303, 50670, 50810,
50875, 51067, 51316, 51574, 51748,
51768, 52134, 52141, 52451, 52457, 52527, 52528, 52530, 52558, 52654, 52887,
52971, 53085, 53087, 53482, 54327,
54328, 55091, 55502, 55667, 56114, 56218, 56379, 56568, 57676, 58951, 58954,
59122, 59480, 59613, 59928, 59964,
61830, 63764, 64139, 64151, 65076, 8388607 

At least the first one, probably most of these were due to a keyword rename.  It
turns out editkeywords.cgi does not update the version cache of bugs when it
renames a keyword.

As far as I can tell, show_bug doesn't use the version cache, so it's not
terrible, but I presume queries use it.

I'm still looking at the last, illegal bug number.
(Reporter)

Comment 1

16 years ago
Err, keywords cache, not version cache.
(Reporter)

Comment 2

16 years ago
All of these bug numbers except for the last one are due to a rename of newmod
to modern.  The last one is not, and is covered at bug #69629.

Comment 3

16 years ago
I think this is most likely a direct effect of bug 64760.
Depends on: 64760
(Reporter)

Comment 4

16 years ago
It looks like it's similar if not the same.  It's not suprising that if the
keyword cache got out of date process_bug might try to fix it and give
permission errors.

IMO this is major problem since I think it can result in bugs not being on
queries.
(Reporter)

Comment 5

16 years ago
OK, neither the rename nor the delete code path update the keywords cache of
affected bugs.  This could probably be resolved best with code that applies to
both, so one should probably be marked as dupe.  I'd be more inclined to leave
this here since I think it's more on the money.

I am certainly disheartened to learn the seriousness of this was known as far
back as December (bug #62893).  Your report was the only Bugzilla bug report
filed on it that I can see, but it didn't really explain the true seriousness of
the problem.
Summary: Keyword cache not updated on keyword rename. → Keyword cache not updated on keyword rename/delete.
(Reporter)

Comment 6

16 years ago
There seems to be a consensus we should try to get this done for 2.12 due to 
its serious nature.
Whiteboard: 2.12

Comment 7

16 years ago
How long does it take to run sanitycheck.cgi on mozilla.org's installation?

I recommend fixing this in two parts:

1) The stupid way. After editing or removing a keyword, notify the administrator 
that they have to run sanitycheck.cgi and rebuild the keyword cache.

2) Later on, the right way. Break out keyword cache rebuilding from 
sanitycheck.cgi and call that routine anytime an edit or delete operation is 
performed.

(Reporter)

Comment 8

16 years ago
sanitycheck.cgi takes about 20 minutes on mozilla.org, and I don't know how much
it loads the machine down.

I'm not sure, are you're implying here that we should rebuild the keyword caches
of all bugs, as opposed to just the ones with the keyword on it?

Comment 9

16 years ago
No, we should just be rebuilding the cache's on those bugs that are effected by 
a keyword remove or rename.

Comment 10

16 years ago
Okay, I have implemented the stupid fix, namely, that editing or deleting a 
keyword pops up extra html that reminds the user to rebuild the keyword cache 
using sanitycheck.cgi.  I am checking this in, and then moving this bug to 2.16 
for a more 'proper' fix.

Whiteboard: 2.12 → 2.16
moving to real milestones...
Target Milestone: --- → Bugzilla 2.16

Comment 12

16 years ago
*** Bug 64760 has been marked as a duplicate of this bug. ***
*** Bug 75222 has been marked as a duplicate of this bug. ***
(Reporter)

Comment 14

16 years ago
This happened again the other day when someone forgot to update the caches
despite the message.

I very strongly suggest that the fix to this should write changes on
bugs_activity and send out notifications.
Priority: -- → P1
*** Bug 52993 has been marked as a duplicate of this bug. ***

Updated

16 years ago
Component: Bugzilla → Administration
Product: Webtools → Bugzilla
Whiteboard: 2.16
Version: other → unspecified

Comment 16

16 years ago
-> New Bugzilla Product

Comment 17

16 years ago
Oops... forgot to click "Reassign"
Assignee: tara → justdave
This is now on the "we really want this for 2.16, but won't hold the release for
it if it's not done by then" list.
No patch yet, not a release blocker, 2.16 is now it freeze mode.

-> 2.18
Target Milestone: Bugzilla 2.16 → Bugzilla 2.18

Comment 20

15 years ago
So is there a workaround for this? At the moment, I am unable to add a comment
to Bug 68985. Is there a way to get sanitycheck.cgi run?

Comment 21

15 years ago
So why isn't this a release blocker? This makes affected bugs un-editable by us
peons... Also, there doesn't seem to be any way to get someone to fix a bug that
is exhibiting symptoms of this. For example, when I try to add myself to the CC
list for Bug 68985, I get:
Only the owner or submitter of the bug, or a sufficiently empowered user, may
make that change to the keywords field.
Old value: helpwanted, nsbranch, vtrunk
New value: helpwanted, nsbranch

I've been looking for somebody to help me fix that for a month, now.
(Reporter)

Comment 22

15 years ago
File bugs on product mozilla.org component bugzilla: other moz.org issues
I've 'fixed' bug 68985.
*** Bug 159948 has been marked as a duplicate of this bug. ***

Comment 25

14 years ago
I don't think this should depend on a bug which was marked as a duplicate of
this one, so removing dependency on bug#64760
No longer depends on: 64760

Comment 26

13 years ago
Unloved bugs targetted for 2.18 but untouched since 9-15-2003 are being
retargeted to 2.20
If you plan to act on one immediately, go ahead and pull it back to 2.18.
Target Milestone: Bugzilla 2.18 → Bugzilla 2.20

Comment 27

13 years ago
Can anyone see a reason the keyword cache exists at all?   Why are we not
killing it?
(Reporter)

Comment 28

13 years ago
Joel the caches exist so they can be output on buglist.cgi.

Comment 29

12 years ago
This bug has not been touched by its owner in over six months, even though it is
targeted to 2.20, for which the freeze is 10 days away. Unsetting the target
milestone, on the assumption that nobody is actually working on it or has any
plans to soon.

If you are the owner, and you plan to work on the bug, please give it a real
target milestone. If you are the owner, and you do *not* plan to work on it,
please reassign it to nobody@bugzilla.org or a .bugs component owner. If you are
*anybody*, and you get this comment, and *you* plan to work on the bug, please
reassign it to yourself if you have the ability.
Target Milestone: Bugzilla 2.20 → ---
Reassigning bugs that I'm not actively working on to the default component owner
in order to try to make some sanity out of my personal buglist.  This doesn't
mean the bug isn't being dealt with, just that I'm not the one doing it.  If you
are dealing with this bug, please assign it to yourself.
Assignee: justdave → administration
QA Contact: mattyt-bugzilla → default-qa
Blocks: 314786
(Assignee)

Updated

8 years ago
Depends on: 509497
Target Milestone: --- → Bugzilla 3.6
(Assignee)

Updated

8 years ago
Blocks: 93670
(Assignee)

Updated

8 years ago
Depends on: 101164
(Assignee)

Comment 31

8 years ago
We no longer accept new features for Bugzilla 3.6. Retargetting to 3.8.
Target Milestone: Bugzilla 3.6 → Bugzilla 3.8
(Assignee)

Comment 32

7 years ago
It shouldn't be hard to do now that we have sql_group_concat().
(Assignee)

Comment 33

7 years ago
Created attachment 437610 [details] [diff] [review]
patch, v1

Tested on PostgreSQL, and works like a charm.
Assignee: administration → LpSolit
Status: NEW → ASSIGNED
Attachment #437610 - Flags: review?(mkanat)

Comment 34

7 years ago
Comment on attachment 437610 [details] [diff] [review]
patch, v1

  This is awesome.
Attachment #437610 - Flags: review?(mkanat) → review+

Updated

7 years ago
Flags: approval+
(Assignee)

Comment 35

7 years ago
Committing to: bzr+ssh://lpsolit%40gmail.com@bzr.mozilla.org/bugzilla/trunk/
modified sanitycheck.cgi
modified Bugzilla/Bug.pm
modified Bugzilla/Search.pm
modified Bugzilla/DB/Schema.pm
modified Bugzilla/Install/DB.pm
modified template/en/default/admin/sanitycheck/messages.html.tmpl
modified template/en/default/global/messages.html.tmpl
Committed revision 7121.
Status: ASSIGNED → RESOLVED
Last Resolved: 7 years ago
Keywords: relnote
Resolution: --- → FIXED
Summary: Keyword cache not updated on keyword rename/delete. → Keyword cache not updated on keyword rename/delete (remove the keyword cache)
(Assignee)

Updated

7 years ago
Blocks: 101164
No longer depends on: 101164
(Assignee)

Updated

7 years ago
Duplicate of this bug: 93670
I'm getting the follow error after submitting the a new bug:

Invalid Parameter

keywords is not a valid parameter for the Bugzilla::Bug::create function.
Blocks: 558318

Comment 38

7 years ago
Added to the release notes in bug 604256.
Keywords: relnote
(Assignee)

Updated

6 years ago
Blocks: 657707
You need to log in before you can comment on or make changes to this bug.