The text that appears in the final step of submitting an add-on is a little confusing, as explained in an email Heather sent to the amo-editors list. It seems to be static regardless of the final status of the submission, and always gives the impression that the add-on will be reviewed: "Your new version has been created and is currently marked as In Sandbox. The new version will be available to the public as soon as an editor is able to review it. There are currently 152 other add-ons in the queue. Want to be reviewed faster? Consider becoming an editor <https://wiki.mozilla.org/Update:Editors>. View your new version in the Versions and Files page <https://addons.mozilla.org/en-US/developers/versions/13954>, check out your add-on's current status <https://addons.mozilla.org/en-US/developers/addon/status/13954>, or *add release notes* by clicking the button below (highly recommended)." There is also some information I'd like to add there in order to make us more "transparent" (bug 435273).
Moving to 5.8
Moving to 5.9. This should be fixed along with bug 552450.
Bumping to 5.10.
This is already covered by bug 541221 and bug 552450, as far as I can tell.
Reclassifying editor bugs and changing to a new whiteboard flag. Spam, spam, spam, spam...