Bug open to track this issue and the findings about it in order to try to get it fixed. This would need some investigation since master Buid is failing in BB since March 21st once this commit landed: https://github.com/mozilla-mobile/firefox-ios/commit/0fe9935790ce5bf606b3a0e35084608734f6cc3e But it has been reviewed and in theory it does not make any change in regards to the tests so that they start to fail randomly. Anyway there should be something happening in there so that all builds do not finish successfully since then. Due to that commit, it looks like the build is stuck when running the performance tests. Test testInsertPerformance started 2799 Oops! Looks like your build is stuck running the current step. Terminating build. 2800 An internal error has occurred. The buddybuild team has been notified and will investigate. 2801 2802 Please contact us over Intercom or at firstname.lastname@example.org if this is time critical for you. But also the build is stopped when running other tests like: Test testLoginSuccess started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d1cc90f8f90b0001b83ff9#logs) Test testAboutUrls started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d3696c5cacd90001416059#logs) Even with the same commit(7d9cd673), the build fails in different tests on different days: Test testRemoteValueOnlyChange started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d5c110333fac0001f3bfc7#logs) Test testAdvanceFromEngagedAfterVerified started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d712953e6e2d0001968eee#logs)
Some updates here... Another test that is failing: Test testRandomThreading2 started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d909cf1eb24a00016b365d#logs) But seems that from yesterday there are two successful builds for FennecEntrerprise in which the Unit/Performance tests are passing: https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d95a021379b10001ec9c45#logs https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d95a021379b10001ec9c45#logs Lets see if they pass also with Nightly schema
The build passed also on Nightly: https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58da1ceae22d4200019329a5#logs But the branch was not updated with master. After rebasing the branch with latest master, it failed again being stuck on test: testRemoteValueOnlyChange https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58da315bd08a7e0001a3f7cc#logs It is strange because the Fennec scheme it is not failing on that test in the latest successful builds
With this commit 7f52d8fb5335c6627675011f459dda23b8ff8dd5 where LivePushClientTests have been disabled builds are green again on master for Fennec but NOT for Nightly, should we deactivate those tests there too or why are they not disabled there? Thanks!
Disabling those tests in Nightly make the build finally pass. The failures seen now are due to bug 1349154 but the build finishes and is not blocked
So the solution was to disable these unit tests LivePushClientTests in both schemes, Fennec and Nightly. These are the commits where that happens: Fennec PR https://github.com/mozilla-mobile/firefox-ios/pull/2555 Nightly PR https://github.com/mozilla-mobile/firefox-ios/pull/2520