Move cloud-init to a custom repository

RESOLVED FIXED

Status

Infrastructure & Operations
RelOps: Puppet
RESOLVED FIXED
3 years ago
3 years ago

People

(Reporter: dustin, Assigned: dustin)

Tracking

Details

(Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1619] )

Attachments

(1 attachment)

(Assignee)

Description

3 years ago
As part of deprecating the EPEL repository

Updated

3 years ago
Whiteboard: [kanban:engops:https://kanbanize.com/ctrl_board/6/596]

Updated

3 years ago
Whiteboard: [kanban:engops:https://kanbanize.com/ctrl_board/6/596] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1607] [kanban:engops:https://kanbanize.com/ctrl_board/6/596]

Updated

3 years ago
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1607] [kanban:engops:https://kanbanize.com/ctrl_board/6/596] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1609] [kanban:engops:https://kanbanize.com/ctrl_board/6/596]

Updated

3 years ago
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1609] [kanban:engops:https://kanbanize.com/ctrl_board/6/596] [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1615] [kanban:engops:https://kanbanize.com/ctrl_board/6/596] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1615] [kanban:engops:https://kanbanize.com/ctrl_board/6/596] [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1616] [kanban:engops:https://kanbanize.com/ctrl_board/6/596]

Updated

3 years ago
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1616] [kanban:engops:https://kanbanize.com/ctrl_board/6/596] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1619] [kanban:engops:https://kanbanize.com/ctrl_board/6/596]
Whiteboard: [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1619] [kanban:engops:https://kanbanize.com/ctrl_board/6/596] → [kanban:engops:https://mozilla.kanbanize.com/ctrl_board/6/1619]
(Assignee)

Comment 1

3 years ago
Looks like this needs some additional cloud-*, specifically cloud-utils-growpart per bug 1001714.

http://mxr.mozilla.org/build/source/cloud-tools/ami_configs/releng-public.repo is the config that will need to be updated to point to the new repo.  Rail, how would I go about testing that change?
Flags: needinfo?(rail)
I can test that by regenerating golden AMIs.
Flags: needinfo?(rail)
(Assignee)

Comment 3

3 years ago
It looks like cloud-utils-growpart isn't used anymore, so just cloud-init.  Installing that on a buildmaster gives the following EPEL packages to be installed:

cloud-init                                                                         
PyYAML                                                                             
libyaml                                                                            
python-argparse                                                                    
python-backports                                                                   
python-backports-ssl_match_hostname                                                
python-boto                                                                        
python-chardet                                                                     
python-jsonpatch                                                                   
python-jsonpointer                                                                 
python-ordereddict                                                                 
python-prettytable                                                                 
python-requests                                                                    
python-six                                                                         
python-urllib3                                                                     

so that's what I'll include in the mirror.
(Assignee)

Comment 4

3 years ago
I wrote this script, which is in the root of the custom repo, to generate the repos:

#! /bin/bash

# This repository is used during AWS golden image creation, and not directly by Puppet.
# See https://bugzilla.mozilla.org/show_bug.cgi?id=1090231

set -e

# this list of packages comes from a test install of 'cloud-init' against the EPEL repo
# as of 2014-05-06, filtering out only packages yum lists as coming from epel.
PACKAGES='
        cloud-init
        PyYAML
        libyaml
        python-argparse
        python-backports
        python-backports-ssl_match_hostname
        python-boto
        python-chardet
        python-jsonpatch
        python-jsonpointer
        python-ordereddict
        python-prettytable
        python-requests
        python-six
        python-urllib3
'
# To get this from a newer EPEL, mirror the thing down to a temporary directory and
# point this at it.  Or make the script smart enough to find and download the packages.
MIRROR_SOURCE=/data/repos/yum/mirrors/epel/6/2014-05-06

cd /data/repos/yum/custom/cloud-init/

for arch in x86_64 i386; do
        mkdir -p $arch
        for pkg in $PACKAGES; do
                cp $MIRROR_SOURCE/$arch/$pkg*.rpm $arch/
        done
        (cd $arch; createrepo --update .)
done
(Assignee)

Comment 5

3 years ago
Created attachment 8528604 [details] [diff] [review]
bug1090231.patch

I can see two things going wrong here:
 * install of cloud-init fails; or
 * install of something else early in the golden-image process fails due to missing EPEL
Attachment #8528604 - Flags: review?(rail)
Comment on attachment 8528604 [details] [diff] [review]
bug1090231.patch

Let me know when you land it, I'll verify by creating another golden AMI.
Attachment #8528604 - Flags: review?(rail) → review+
(Assignee)

Comment 7

3 years ago
Comment on attachment 8528604 [details] [diff] [review]
bug1090231.patch

remote:   https://hg.mozilla.org/build/cloud-tools/rev/89b9084f8b6a

Want to try a new golden image?
Flags: needinfo?(rail)
Attachment #8528604 - Flags: checked-in+
Worked fine
Flags: needinfo?(rail)
(Assignee)

Updated

3 years ago
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.