Created attachment 8441563 [details] Hamachi Screenshot 2014-06-17 at 11.19.50 AM.png There is a mismatch between the FxOS apps reporting results for FxOS' startup_>_moz-* tests on Flame vs. Hamachi running Gaia's master branch. Flame shows results for 5 apps while Hamachi only shows two. See the attached screenshots for details. NOTE: These results are generated by make test-perf tests. The rationale and work to support these tests is covered by bug 996038.
I believe this is bug 1020557, though Hubert may want to clarify.
It is because hamachi has more failures, which mean that it get less results.... (the apps in question systematically fail, see bug 1020557)
Per discussion with the automation team, we won't be supporting hamachis anymore, so closing as WONTFIX.