1111576 - Test not available for a version

Status: RESOLVED WONTFIX

(Mozilla QA Graveyard :: MozTrap, defect)

Description

[Ioana Chiorean]

1. I've created Android 5.0 like a month ago - set is for all Mozilla Firefox Mobile version/ runs etc. 

2. Creating a test run with Review Smoke v2.0 and trying to run it for 5.0 will display only 19 out of 41 tests. 

3. I've checked manual all 45 testcases and Added manually to all of them 5.0 ( some did missed it). After this still I do not see them all in the test run. 

Questions:
- Creating a new versions should be defaulted to all test cases ? should we parse manually them? Suites can add to all tests in them the env?
- Can we hard coded this so we get all tests?

I did check all in disable mode, re-enabled them after.

Comment 1

[Cameron Dawson [:camd]]

Hi Ioana - I'm taking a look at this now.  When I try to run this run with 5.0, I get 39 cases:
https://moztrap.mozilla.org/runtests/run/6047/env/27933/

Checking the env settings for the cases now.  I suspect some of the cases just don't get Android 5.0, like you say, by default.  They should unless they were intentionally set to be specific to only certain environments.

still looking...

Comment 2

[Cameron Dawson [:camd]]

ok, so 39 cases looks right for that run since 3 cases are disabled:
https://moztrap.mozilla.org/manage/cases/?&pagenumber=1&pagesize=50&sortfield=created_on&sortdirection=desc&filter-status=disabled&filter-productversion=227&filter-suite=516

I'm looking at Mobile Firefox 37 only right now (I chose it out of the many).  The suite of Review Smoke v2.0 has 43 total cases.  But 3 are disabled, so when you run it, you should get 39 cases.  That's correct for the test run in comment 1.

However, your earlier issue of not all the cases getting the new environment is definitely a bug.  I think this bug is caused by bug 1021634.

Ioana - is there a different test run that is still missing cases?  Please let me know which Product version/run combo is still having problems.

Comment 3

[Ioana Chiorean]

Camd - try Mobile Firefox -> 35 tablet -> Smoke - I only get 19 for 5.0 
Links:
- https://moztrap.mozilla.org/runtests/environment/6032/
- https://moztrap.mozilla.org/runtests/environment/6015/

Comment 4

[Stephen Donner [:stephend] Not actively reading bugmail]

Mass-closing remaining MozTrap bugs as WONTFIX, due to 1) the Mozilla-hosted instance being decommissioned (see https://wiki.mozilla.org/TestEngineering/Testrail), and, for now, 2) the still-up code archived at its GitHub page: https://github.com/mozilla/moztrap (we'll decide what's next for that, in the near future).

See also the history and more-detailed discussion which led us here, at https://groups.google.com/forum/#!topic/mozilla.dev.quality/Sa75hV8Ywvk

(If you'd like, you should be able to filter these notification emails using at least the unique string of "Sa75hV8Ywvk" in the message body.

Thanks!