If a builder is busy doing (say) reftest and you go Stop build then it moves on to crashtest, kill it again to get mochitest etc. Not the end of the world but a bit of a pain.
Annoying but not the end of the world. Also, we split out unittests and run each suite separately, the need for this may go away? Triaging to Future for now.
Is the problem that we don't have haltOnFailure=True for these steps?
Yeah. But I agree with comment #1; once we split all unit test suites out to their own builder, we can haltOnFailure with no unwanted consequences. Otherwise a failure in an early test will prevent us from running the rest of the tests.
I think in general, we don't want haltOnFailure set for tests. It means that a build that fails in one suite won't run the rest in places where we're running more than one suite, like the 'everythingelse' build. The proper way to fix this is in buildbot, where if 'Stop Build' is pressed, it prevents subsequent steps from being run instead of just sending SIGINT to the current step.
Mass move of bugs from Release Engineering:Future -> Release Engineering. See http://coop.deadsquid.com/2010/02/kiss-the-future-goodbye/ for more details.
This will get fixed when we roll out buildbot 0.8.0
Now that the primary build and test masters are on 0.8.0, I'm going to call this fixed.