1211374 - delivery: support for b2g uploads currently going to stage.m.o

Status: RESOLVED FIXED

(Cloud Services :: Operations: Miscellaneous, task)

Description

[Nick Thomas [:nthomas] (UTC+12)]

I've discovered some uploads which write into stage.m.o:/pub/mozilla.org/b2g. We could either
* allow upload.ffxbld.* to write to /pub/b2g
* set up upload.b2gbld.* to write there

Don't really mind which, as we're using a mixture of ssh keys at the moment. The first is maybe quicker ? In terms of load we've got many nightly builds twice a day, and some small text files all day long. Should be fairly small compared to firefox desktop traffic.

This is all separate from the pvtbuilds uploads.

Comment 1

[Jeremy Orem [:oremj]]

I think it would be good to set up a host for b2gbld, unless it's going to cause a headache. Right now I have the following keys on file. Can you confirm them before I set up the hosts?

ssh-dss AAAAB3NzaC1kc3MAAACBAN3pnKEugFbJsyE79F8NieS9WqlOPZpHFYPzsTR6MnRE1iqE4DAai9gqfJ3/KJbcxX3DmFEEAqC6yojVUkJT6odxYuk+Eyea9WZYGrRo9Ng5SXyUP5PHpHY5t/u9m1rMI8+fcaJP8/yxa9trBz9qAsFj4N9lJatreKYLDAt0RSnXAAAAFQCQucM0IcIN2SW6ZN5rgSp3R0QHfQAAAIEAyIEpEQ0EyQcr9RFFFkzrGbWiEHOoRllHHU9cNttQ4H36jkQuaEmTF1yFzUUR4U5B7vk7AWZV+/LPKoPmYjQTvhb9ZFtFKSptwoFLw2q7AbD3W5awSoLQe4PUhY3EjNNwmYYwJMcULD7qP9/igPrbqQaGK6dDYVGDpphjo4AS36wAAACAMj9pfkbmtFjrY/J8awx2w85t3ZbrJtrIId8a+1i0jgA4qBgnmHCCU8i+9pGuSeqyvV+zMj/vqHiw1SenEho8tYYlT1krUyFXfia3HVzuUfroPBwuHftGoOtHXiYM027x/bYg08/qQ1FXBmq+ZSXl7LmCtZos+YG879hqAr8JXtg= b2gbld_gen_3
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeGcQBxp3aHoafxVDLu7rFa54VenhbCU/rZR27lgGhzaV1wGiYbYGaZIjYUAN8OJ9KCat08AcYOALH3YdLEGyAbE3CL5cApECGESUFhTC9igMgUiqNX42XQTaBMzESn/EsxLEKsNDgLjGhNdZKKusm5Qj1X2QO3j0hAqMeUtsN7XfIdKjo2HR3CPFVU42MWUKWPDIkqt1xhptOlgD4oVrxFiO7OmlYextqmdJcOgEBAeJ0uGg2RryNKOYQnwN1FJGKDtOPcDQ/6ebS/1EJBkYI9M9HZvYqm9TOBdDX0ItOKR2dz7hKYcTsVuuiLfBIOnoMzq+2r2Vx2bhFWMU3Uuid b2gbld_gen_4
ssh-dss AAAAB3NzaC1kc3MAAACBAJOLAUqBZHbBUVNvX3dRjKjB0PoXpS5zS/kWQwRIwKWAb/uxyNoHRn/dH0ykvvinFZjHI98G9bX8P6H2TYwOEtXTtctdpC7cTg2PRIRyCOgq7cZjraoVA4bk40Xvo7avRqPS8PHBj1eznrI5UL/d6EXDvURS0RZU4gJLTSvdhm5vAAAAFQCFucQBVA25bLtx5Sg61M8M/RbDTwAAAIBeeoQvBCVzhrjNVQ8dMTznqBsJXZ9CNBJkWQVHwj79p5WJH+B8tXmUUM3E2ibjX7g9Whlyk2LNG1gMnTa1FLDupG3RIDgYMqMsSPO+8ZHRsMX3Ze+Q/TyISfbXeUB1MY2FeF2l/F1W1KQ4TtKbhPF+PnK+LWqYSvvTq06QJySGVgAAAIAYnduFJOnHiixvD+fnxhA415S7ltxYr908iUSg/rjMXiyId5dwTgwRCwBmYwSviH6LBSyjcxiGoYrNDISpLllPbU0bZ8VKI76kyocl7H4Aq9OROPntb45MatTCRceqro0MMV0O+hZK7jx3GpWJgb6AnhyMeFtzZ9m4GGFrer+AIw== b2gbld_gen_1
ssh-dss AAAAB3NzaC1kc3MAAACBAN3pnKEugFbJsyE79F8NieS9WqlOPZpHFYPzsTR6MnRE1iqE4DAai9gqfJ3/KJbcxX3DmFEEAqC6yojVUkJT6odxYuk+Eyea9WZYGrRo9Ng5SXyUP5PHpHY5t/u9m1rMI8+fcaJP8/yxa9trBz9qAsFj4N9lJatreKYLDAt0RSnXAAAAFQCQucM0IcIN2SW6ZN5rgSp3R0QHfQAAAIEAyIEpEQ0EyQcr9RFFFkzrGbWiEHOoRllHHU9cNttQ4H36jkQuaEmTF1yFzUUR4U5B7vk7AWZV+/LPKoPmYjQTvhb9ZFtFKSptwoFLw2q7AbD3W5awSoLQe4PUhY3EjNNwmYYwJMcULD7qP9/igPrbqQaGK6dDYVGDpphjo4AS36wAAACAMj9pfkbmtFjrY/J8awx2w85t3ZbrJtrIId8a+1i0jgA4qBgnmHCCU8i+9pGuSeqyvV+zMj/vqHiw1SenEho8tYYlT1krUyFXfia3HVzuUfroPBwuHftGoOtHXiYM027x/bYg08/qQ1FXBmq+ZSXl7LmCtZos+YG879hqAr8JXtg= b2gbld_gen_2
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeGcQBxp3aHoafxVDLu7rFa54VenhbCU/rZR27lgGhzaV1wGiYbYGaZIjYUAN8OJ9KCat08AcYOALH3YdLEGyAbE3CL5cApECGESUFhTC9igMgUiqNX42XQTaBMzESn/EsxLEKsNDgLjGhNdZKKusm5Qj1X2QO3j0hAqMeUtsN7XfIdKjo2HR3CPFVU42MWUKWPDIkqt1xhptOlgD4oVrxFiO7OmlYextqmdJcOgEBAeJ0uGg2RryNKOYQnwN1FJGKDtOPcDQ/6ebS/1EJBkYI9M9HZvYqm9TOBdDX0ItOKR2dz7hKYcTsVuuiLfBIOnoMzq+2r2Vx2bhFWMU3Uuid b2gbld_gen_5

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

The top-level dirs in b2g currently use accounts like this:
  manifests          b2gbld
  nightly            ffxbld
  tinderbox-builds   ffxbld
  try-builds         trybld

I'm going to have to do redo manifests for other reasons, we have upload hosts for the other three, so at this point I'd rather go with the existing upload hosts. They'd need to be allowed to write to parts of b2g they touch, so post_upload can do its thing. OK with you ?

Comment 3

[Jeremy Orem [:oremj]]

So skip the b2g hosts and just allow ffxbld to upload to /pub/b2g/*?

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

Almost. ffxbld to be able to write to /pub/b2g/tinderbox-builds and /pub/b2g/nightly; trybld to write to /pub/b2g/try-builds. And the whole prod vs staging split.

Could we also grant the accounts from bug 1190309 and bug 1210333 access to /pub/b2g/manifests, same set of permissions they have now, so I can put things there directly using the API. My account (but 1219607) should already have access I think.

Comment 5

[Nick Thomas [:nthomas] (UTC+12)]

oremj set up the access last week and it has been working fine.