564803 - Directory needs better caching with per-plugin invalidation

Status: NEW

(Websites :: plugins.mozilla.org, defect)

Description

[Les Orchard [:lorchard]]

Currently, the directory caches all API search results for up to an hour.

A better approach would be to cache all results indefinitely, but invalidate stale cached data if it contains a plugin that's been updated since the data was cached.

Here's a possible approach:

* Maintain last-modified by PFS ID in memcache, updated whenever a plugin's metadata or any releases are modified.

* Maintain last-modified for each cached API result.

* When an API search results in a cache hit, iterate through all the PFS IDs included in the result.

* If any of the PFS ID last-modified timestamps are newer than the overall cache hit timestamp, discard the cached result and perform a new lookup.