All users were logged out of Bugzilla on October 13th, 2018

[Air Mozilla] ElasticSearch cluster for airmozilla dev, stage and prod

RESOLVED FIXED

Status

RESOLVED FIXED
3 years ago
3 years ago

People

(Reporter: peterbe, Assigned: cliang)

Tracking

Details

(Whiteboard: [kanban:https://webops.kanbanize.com/ctrl_board/2/1406] )

(Reporter)

Description

3 years ago
In Q3 we're going to need to use ElasticSearch on Air Mozilla. 
I think all I need is a URL to be configured for dev, stage and prod in some secure fashion. 

My intern is actively working on a new feature to do ES queries. Her work will be possible to merge to master and being preffed off but it would be nice if she can see her work for realz before she finishes.

Updated

3 years ago
Whiteboard: [kanban:https://webops.kanbanize.com/ctrl_board/2/1406]
(Assignee)

Comment 1

3 years ago
@peterbe:  Do you have some time this upcoming week to have a quick chat about this?  Mostly, what we're looking for is some sense of what your storage / performance / backup needs will be for this data, so we can get things set up properly.
(Reporter)

Comment 2

3 years ago
(In reply to C. Liang [:cyliang] from comment #1)
> @peterbe:  Do you have some time this upcoming week to have a quick chat
> about this?  Mostly, what we're looking for is some sense of what your
> storage / performance / backup needs will be for this data, so we can get
> things set up properly.

Yes please! My calendar is pretty up to date if you want to book me into something.
(Assignee)

Updated

3 years ago
Depends on: 1184731
(Assignee)

Comment 3

3 years ago
Based on today's discussion, it makes the most sense to spin up a small ES cluster just for AirMo.  I've filed a bug requesting VMs for this cluster and have modified the title of this bug.
Summary: [Air Mozilla] ElasticSearch URL to use for airmozilla dev, stage and prod → [Air Mozilla] ElasticSearch cluster for airmozilla dev, stage and prod
(Assignee)

Updated

3 years ago
Assignee: server-ops-webops → cliang
(Assignee)

Updated

3 years ago
Depends on: 1185774
(Assignee)

Comment 4

3 years ago
I've set up an Elasticsearch cluster at http://airmo-elasticsearch-zlb.webapp.scl3.mozilla.com:9200.  Access to that cluster is currently limited to the generic cluster.  If, during the proto-typing phase, we need to allow access from a different server, please let me know.  (We generally have tight restrictions on Elasticsearch access due to the history of Elasticsearch vulnerabilities. >_< )
(Reporter)

Comment 5

3 years ago
(In reply to C. Liang [:cyliang] from comment #4)
> I've set up an Elasticsearch cluster at
> http://airmo-elasticsearch-zlb.webapp.scl3.mozilla.com:9200.  Access to that
> cluster is currently limited to the generic cluster.  If, during the
> proto-typing phase, we need to allow access from a different server, please
> let me know.  (We generally have tight restrictions on Elasticsearch access
> due to the history of Elasticsearch vulnerabilities. >_< )

Cool. I'll have to make sure the dev, stage and prod servers have different prefixes on the index name. 

I gather that :ericz is working on trying to move the airmozilla dev server to the new python 2.7 based cluster. So I guess we ought to give access from that one too.
(Assignee)

Updated

3 years ago
Depends on: 1187493
(Assignee)

Comment 6

3 years ago
I see that data has landed in the Air Mozilla ES cluster. =)
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.