Faster metadata management

NEW
Assigned to

Status

a year ago
5 months ago

People

(Reporter: ekyle, Assigned: ekyle)

Tracking

(Blocks: 1 bug)

Trunk
Points:
---

Firefox Tracking Flags

(Not tracked)

Details

(Assignee)

Description

a year ago
The amount of metadata in the cluster makes iterating through it too slow in python.  Furthermore, multiple web service processes means each process must collect its own metadata; which is also slow.

Store the metadata in sqlite; queries will be faster, and data can be shared across processes.
(Assignee)

Comment 1

9 months ago
This is still a problem
(Assignee)

Comment 2

5 months ago
The metadata manager has been built, but it is too demanding on the cluster. In the meantime, a few explicit columns are managed, that's all.
You need to log in before you can comment on or make changes to this bug.