865438 - Some applications on PaaS cannot be started

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Matt Basta [:basta]]

See flue.paas.allizom.org

(fireplace)bash-3.2$ s update
Updating application 'flue'...
Application Url: flue.paas.allizom.org
Create services to bind to 'flue' ?  [yN]: 
Uploading Application [flue]:
  Checking for bad links: 9 OK 
  Copying to temp space: 8 OK 
  Checking for available resources: 22393 OK
  Packing application: OK
  Uploading (10K): 100% OK
Push Status: OK
Note that [flue] was not automatically started because it was STOPPED before the update.
You can start it manually using `s start flue`
(fireplace)bash-3.2$ s start flue
stackato.stager: Staging application 'flue'


At this point, the application hangs and never starts.

Comment 1

[Chris Turra [:cturra]]

have you tried recreating the app?

 $ stackato delete <app_name>
 $ stackato push

Comment 2

[Matt Basta [:basta]]

It's still getting stuck at "Staging application 'flue'"

Comment 3

[Chris Turra [:cturra]]

looks like some on the stager processes on the droplet execution agents (DEA) were stuck in a starting state. i have restarted these and everything looks to be functioning correctly once again. can you please give your application a test for me?

Comment 4

[Matt Basta [:basta]]

It's still hanging during `s start foo` at the same point as in comment #2.

It also seems like running applications are spontaneously shutting down. Flue, for instance, will work, then start returning the default 404s after a few minutes of running.

Comment 5

[Chris Turra [:cturra]]

i believe i have tracked down the root cause. there appears to be a firewall setting that is causing a bridge interface (br0) not to come up. i am sorting out how to resolve this and will report back.

Comment 6

[Chris Turra [:cturra]]

i have sorted out the bridge interface business that was going on and have successfully deployed a test application and seen other push applications. calling this r/fixed.