Closed Bug 1055302 Opened 8 years ago Closed 8 years ago

Serve most hg traffic via HTTP/CDNs(lookaside?)

Categories

(Developer Services :: Mercurial: hg.mozilla.org, defect)

x86_64
Windows 8.1
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 1041173

People

(Reporter: taras.mozilla, Unassigned)

References

()

Details

(Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1526] )

hg should be only concerned with telling the client what files to download over http to become up to date. It should not be serving bundles directly
Current thinking:
hg should keep a rolling log of bundles
eg <stuff from 1 week ago><stuff from day-7><day-6>...<today>
stick that into an index
which client would apply by oldest->newest entry before contacting hg to ask for tip

This will be easy to optimize via CDNs, etc. This is different from existing bundle approaches in that it keeps bundles around longer before replacing them to maximize cache locality and supports intermediate(eg bundle data that's a few hours/days old) bundles to reduce hg access further.
Product: Release Engineering → Developer Services
Whiteboard: [kanban:engops:https://kanbanize.com/ctrl_board/6/133]
Whiteboard: [kanban:engops:https://kanbanize.com/ctrl_board/6/133] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1512] [kanban:engops:https://kanbanize.com/ctrl_board/6/133]
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1512] [kanban:engops:https://kanbanize.com/ctrl_board/6/133] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1513] [kanban:engops:https://kanbanize.com/ctrl_board/6/133]
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1513] [kanban:engops:https://kanbanize.com/ctrl_board/6/133] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1519] [kanban:engops:https://kanbanize.com/ctrl_board/6/133]
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1519] [kanban:engops:https://kanbanize.com/ctrl_board/6/133] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1520] [kanban:engops:https://kanbanize.com/ctrl_board/6/133]
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1520] [kanban:engops:https://kanbanize.com/ctrl_board/6/133] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1526] [kanban:engops:https://kanbanize.com/ctrl_board/6/133]
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1526] [kanban:engops:https://kanbanize.com/ctrl_board/6/133] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1526]
We did this in bug 1041173 by deploying bundleclone.
Status: NEW → RESOLVED
Closed: 8 years ago
No longer depends on: 1055298
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.