Test not available for a version

RESOLVED WONTFIX

Status

Mozilla QA
MozTrap
--
blocker
RESOLVED WONTFIX
3 years ago
a year ago

People

(Reporter: Ioana Chiorean, Unassigned)

Tracking

Version 3
x86_64
Linux

Details

(Reporter)

Description

3 years ago
1. I've created Android 5.0 like a month ago - set is for all Mozilla Firefox Mobile version/ runs etc. 

2. Creating a test run with Review Smoke v2.0 and trying to run it for 5.0 will display only 19 out of 41 tests. 

3. I've checked manual all 45 testcases and Added manually to all of them 5.0 ( some did missed it). After this still I do not see them all in the test run. 

Questions:
- Creating a new versions should be defaulted to all test cases ? should we parse manually them? Suites can add to all tests in them the env?
- Can we hard coded this so we get all tests?

I did check all in disable mode, re-enabled them after.
Flags: needinfo?(cdawson)
Hi Ioana - I'm taking a look at this now.  When I try to run this run with 5.0, I get 39 cases:
https://moztrap.mozilla.org/runtests/run/6047/env/27933/

Checking the env settings for the cases now.  I suspect some of the cases just don't get Android 5.0, like you say, by default.  They should unless they were intentionally set to be specific to only certain environments.

still looking...
Flags: needinfo?(cdawson)
ok, so 39 cases looks right for that run since 3 cases are disabled:
https://moztrap.mozilla.org/manage/cases/?&pagenumber=1&pagesize=50&sortfield=created_on&sortdirection=desc&filter-status=disabled&filter-productversion=227&filter-suite=516

I'm looking at Mobile Firefox 37 only right now (I chose it out of the many).  The suite of Review Smoke v2.0 has 43 total cases.  But 3 are disabled, so when you run it, you should get 39 cases.  That's correct for the test run in comment 1.

However, your earlier issue of not all the cases getting the new environment is definitely a bug.  I think this bug is caused by bug 1021634.

Ioana - is there a different test run that is still missing cases?  Please let me know which Product version/run combo is still having problems.

Updated

3 years ago
Depends on: 1021634
(Reporter)

Comment 3

3 years ago
Camd - try Mobile Firefox -> 35 tablet -> Smoke - I only get 19 for 5.0 
Links:
- https://moztrap.mozilla.org/runtests/environment/6032/
- https://moztrap.mozilla.org/runtests/environment/6015/
Mass-closing remaining MozTrap bugs as WONTFIX, due to 1) the Mozilla-hosted instance being decommissioned (see https://wiki.mozilla.org/TestEngineering/Testrail), and, for now, 2) the still-up code archived at its GitHub page: https://github.com/mozilla/moztrap (we'll decide what's next for that, in the near future).

See also the history and more-detailed discussion which led us here, at https://groups.google.com/forum/#!topic/mozilla.dev.quality/Sa75hV8Ywvk

(If you'd like, you should be able to filter these notification emails using at least the unique string of "Sa75hV8Ywvk" in the message body.

Thanks!
Status: NEW → RESOLVED
Last Resolved: a year ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.