1350889 - Build process fails due to timeout (it stucks randomly in different tests) in BB

Status: RESOLVED FIXED

(Firefox for iOS :: Build & Test, defect)

Description

[Isabel Rios[:isabel_rios]]

Bug open to track this issue and the findings about it in order to try to get it fixed. 

This would need some investigation since master Buid is failing in BB since March 21st once this commit landed:
https://github.com/mozilla-mobile/firefox-ios/commit/0fe9935790ce5bf606b3a0e35084608734f6cc3e

But it has been reviewed and in theory it does not make any change in regards to the tests so that they start to fail randomly. Anyway there should be something happening in there so that all builds do not finish successfully since then. 

Due to that commit, it looks like the build is stuck when running the performance tests.

Test testInsertPerformance started
2799
    Oops! Looks like your build is stuck running the current step. Terminating build.
2800
    An internal error has occurred. The buddybuild team has been notified and will investigate.
2801
2802
    Please contact us over Intercom or at [e-mail] if this is time critical for you.

But also the build is stopped when running other tests like:
Test testLoginSuccess started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d1cc90f8f90b0001b83ff9#logs)

Test testAboutUrls started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d3696c5cacd90001416059#logs)

Even with the same commit(7d9cd673), the build fails in different tests on different days: 
Test testRemoteValueOnlyChange started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d5c110333fac0001f3bfc7#logs)

Test testAdvanceFromEngagedAfterVerified started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d712953e6e2d0001968eee#logs)

Comment 1

[Isabel Rios[:isabel_rios]]

Some updates here...
Another test that is failing:
Test testRandomThreading2 started (https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d909cf1eb24a00016b365d#logs)

But seems that from yesterday there are two successful builds for FennecEntrerprise in which the Unit/Performance tests are passing:
https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d95a021379b10001ec9c45#logs

https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58d95a021379b10001ec9c45#logs

Lets see if they pass also with Nightly schema

Comment 2

[Isabel Rios[:isabel_rios]]

The build passed also on Nightly:

https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58da1ceae22d4200019329a5#logs

But the branch was not updated with master. After rebasing the branch with latest master, it failed again being stuck on test: testRemoteValueOnlyChange
https://dashboard.buddybuild.com/apps/57bf25c0f096bc01001e21e0/build/58da315bd08a7e0001a3f7cc#logs

It is strange because the Fennec scheme it is not failing on that test in the latest successful builds

Comment 3

[Isabel Rios[:isabel_rios]]

With this commit 7f52d8fb5335c6627675011f459dda23b8ff8dd5 where LivePushClientTests have been disabled builds are green again on master for Fennec but NOT for Nightly, should we deactivate those tests there too or why are they not disabled there?
Thanks!

Comment 4

[Isabel Rios[:isabel_rios]]

Disabling those tests in Nightly make the build finally pass. The failures seen now are due to bug 1349154 but the build finishes and is not blocked

Comment 5

[Isabel Rios[:isabel_rios]]

So the solution was to disable these unit tests LivePushClientTests in both schemes, Fennec and Nightly. These are the commits where that happens: 
Fennec PR https://github.com/mozilla-mobile/firefox-ios/pull/2555
Nightly PR https://github.com/mozilla-mobile/firefox-ios/pull/2520