457474 - Create a searchable public repo of add-ons that allow source viewing

Status: RESOLVED INCOMPLETE

(addons.mozilla.org Graveyard :: Developer Pages, enhancement, P1)

Description

[Basil Hashem [:baz]]

In the above URL is a proposed functional specification for how AMO should host a searchable repository (svn + mxr?) of add-on source.

See also bug 358591 for a similar discussion around all add-ons, not just ones with the "source viewable online" checkbox.

Comment 1

[Wil Clouser [:clouserw]]

Our goals:
- Allow text searching of all add-on content
- Allow text tags to be added to content, optionally down to the line
- Respect the author's choice to opt-out of this system (this is already a part of AMO)

The plan:
Phase 1:
- Write a cron script to explode the contents of unindexed add-ons, convert the contents to a parsable json blob, and send the contents to the elastic search indexer
- Write a simple web page that accepts search terms, talks to elastic search, and prints out the results.  Results are a highlighted term and a couple lines of context.
- Actual display of the files can be built on the pre-existing file browser

Phase 2:
- Add tagging:
	- Ability to search by tag
	- Displaying tags on lines in the file browser
- Tagging will be mostly done in JS to let us continue to cache the file viewer pages as much as possible
- The tag <-> line number relationship will be handled in the database (not elastic search)

There is no concept of top level browsing in either phase.  Breadcrumbs will essentially be:

  AMO >> Search in Code >> Search for "database" >> Threadbubble >> /dir1/dir2/somefile.js


I've filed the phase 1 bugs for this project.  Once we see success in that phase, we can file bugs for phase 2.  See https://bugzil.la/[t:tulip] for the bug list.

Closing this as INCOMPLETE since we have other bugs filed now.