Closed Bug 1218401 Opened 10 years ago Closed 8 years ago

[META] Moving test scripts from GIP to GIJ

Categories

(Firefox OS Graveyard :: General, defect)

Product:
Firefox OS Graveyard
Component:
General
Platform:
ARM
Gonk (Firefox OS)
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(feature-b2g:2.6+)

Status:
RESOLVED WONTFIX
Project Flags:
feature-b2g 2.6+

People

(Reporter: atsai, Unassigned)

References

Details

(Whiteboard: [gip-to-gij])

User Story

As part of the Quality initiative planned for the May 2016 release, Engineering managers are committed to increasing automation coverage for integration tests.
(refer to David's email sent last week)

They will work with their engineers to create automation tests that run on mulet and device. Starting November 2, after 2.5 is RA, they will be working on this initiative.

We (QA) have to provide them with:
1) a list of GIP tests that can be converted to GIJ.
2) List of smoke tests that we run
3) List of dogfood tests that are run (after build passes smoke tests)

We will file a bug for each test; so it can be assigned to an owner.

Here is a file with the list of GIP to GIJ. (Check tab Raw data)
We will have similar list for smoke test and dogfood tests. (we are working on that)

https://docs.google.com/spreadsheets/d/19Cl5OaLSiynwW5NItjPuOQYpKbEKG_2eneiuwqm3Gew/edit#gid=0

We need your help to get these tests filed as defects in bugzilla.
Filing each defect manually will take us a long time.

Is it possible to create a small program to pick from the spreadsheet and file defect in bugzilla? Maybe you already have something like this?

The defect should have:

Summary: Implement *this_test* as an integration test in JavaScript
Whiteboard: [gip-to-gij]
Product: Firefox OS
Component: *depends_on_the_test* -- (column A)
Description: *github_link_to_the_gip_equivalent* Like  https://github.com/mozilla-b2g/gaia/blob/master/tests/python/gaia-ui-tests/gaiatest/tests/functional/messages/test_sms_to_dialer.py

Attachments

(1 file)

GIP_to_GIJ with Component and Link.csv
21.42 KB, text/csv
Details
This is a meta bug for migrating test scripts from GIP to GIJ
User Story: (updated)
Given the fact that github link in GIP are not available in raw data now. We might need Devs' help on searching the link manually.
(In reply to Al Tsai [:atsai] from comment #1) > Given the fact that github link in GIP are not available in raw data now. We > might need Devs' help on searching the link manually. Also, Component is not in correct format, which means there will be some efforts on correcting those fields.
Depends on: 1219620
Depends on: 1219627
Depends on: 1219628
Depends on: 1219629
Depends on: 1219630
Depends on: 1219631
Depends on: 1219632
Depends on: 1219633
Depends on: 1219634
Depends on: 1219635
Depends on: 1219636
Depends on: 1219640
Depends on: 1219641
Depends on: 1219643
Depends on: 1219644
Depends on: 1219645
Depends on: 1219649
Depends on: 1219650
Depends on: 1219651
Depends on: 1219653
Depends on: 1219654
Depends on: 1219655
Depends on: 1219656
Depends on: 1219657
Depends on: 1219658
Depends on: 1219659
Depends on: 1219660
Depends on: 1219661
Depends on: 1219662
Depends on: 1219663
Depends on: 1219665
Depends on: 1219666
Depends on: 1219667
Depends on: 1219668
Depends on: 1219670
Depends on: 1219671
Depends on: 1219674
Depends on: 1219675
Depends on: 1219676
Depends on: 1219677
Depends on: 1219678
Depends on: 1219679
Depends on: 1219680
Depends on: 1219681
Depends on: 1219682
Depends on: 1219683
Depends on: 1219684
Depends on: 1219685
Depends on: 1219686
Depends on: 1219687
Depends on: 1219688
Depends on: 1219689
Depends on: 1219690
Depends on: 1219691
Depends on: 1219692
Depends on: 1219693
Depends on: 1219694
Depends on: 1219695
Depends on: 1219696
Depends on: 1219697
Depends on: 1219698
Depends on: 1219699
Depends on: 1219700
Depends on: 1219701
Depends on: 1219702
Depends on: 1219703
Depends on: 1219704
Some questions/remarks: - Despite the name, Gip tests are acceptance style tests, not integration type tests, so moving them over to an integration type of test that is run after every check-in, might prove difficult due to stability issues of the test. - I see you've filed tons of bugs, named "Implement *test_* as an integration test in JavaScript", which means converting them to MarionetteJS (on device if possible), right? Shouldn't those bugs be filed in the MarionetteJS component, if there is one? Firefox OS->Gaia UI Tests is currently used for Python Gaia UI tests. Using it for MarionetteJS might be confusing, but I guess since we're moving that way anyhow, it might be ok.
Flags: needinfo?(whsu)
Depends on: 1219705
Depends on: 1219706
(In reply to Martijn Wargers [:mwargers] (QA) from comment #3) > Some questions/remarks: > - Despite the name, Gip tests are acceptance style tests, not integration > type tests, so moving them over to an integration type of test that is run > after every check-in, might prove difficult due to stability issues of the > test. > - I see you've filed tons of bugs, named "Implement *test_* as an > integration test in JavaScript", which means converting them to MarionetteJS > (on device if possible), right? Shouldn't those bugs be filed in the > MarionetteJS component, if there is one? Firefox OS->Gaia UI Tests is > currently used for Python Gaia UI tests. Using it for MarionetteJS might be > confusing, but I guess since we're moving that way anyhow, it might be ok. Hi, Martijn, Thanks for the heads-up! I have moved those bugs into corresponding components. :)
Flags: needinfo?(whsu)
Assignee: atsai → nobody
feature-b2g: --- → 2.6+
(In reply to Al Tsai [:atsai] from comment #2) > (In reply to Al Tsai [:atsai] from comment #1) > > Given the fact that github link in GIP are not available in raw data now. We > > might need Devs' help on searching the link manually. > > Also, Component is not in correct format, which means there will be some > efforts on correcting those fields. Put the data with right component and link here.
Depends on: 1222975
Depends on: 1232280
Depends on: 1232281
Assignee: nobody → manel.rhaiem92
Assignee: manel.rhaiem92 → nobody
It seems to me this bug can be closed, right?
Firefox OS is not being worked on
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: