1006675 - TPS should have an option to let users select the staging or production servers

Status: RESOLVED FIXED

(Testing Graveyard :: TPS, defect)

Description

[James Bonacci [:jbonacci]]

We want to be able to run the TPS suite for FxA/Sync on either Production or Stage environments. Right now the tests default (hard coded?) to Production.
So, we have to add config params here:
https://github.com/mozilla/gecko-dev/blob/master/testing/tps/tps/testrunner.py
and rebuild/reinstall in order to hit Stage

It would be more helpful to have some sort of option or switch like
env={stage,prod} to save editing that Python file, etc...

Comment 1

[Edwin Wong [:edwong]]

here are the prefs that need to be set: 
https://gist.github.com/edmoz/9626492

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Edwin, it's always better to add information to bugs and not to reference external resources. So as given the following preferences would have to be set, right?

user_pref("identity.fxaccounts.auth.uri", "https://api-accounts.stage.mozaws.net/v1");
user_pref("identity.fxaccounts.remote.force_auth.uri", "https://accounts.stage.mozaws.net/force_auth?service=sync&context=fx_desktop_v1");
user_pref("identity.fxaccounts.remote.signin.uri", "https://accounts.stage.mozaws.net/signin?service=sync&context=fx_desktop_v1");
user_pref("identity.fxaccounts.remote.signup.uri", "https://accounts.stage.mozaws.net/signup?service=sync&context=fx_desktop_v1");
user_pref("identity.fxaccounts.settings.uri", "https://accounts.stage.mozaws.net/settings");
user_pref("services.sync.tokenServerURI", "https://token.stage.mozaws.net/1.0/sync/1.5");

That said the following different URIs are present:

https://api-accounts.stage.mozaws.net/v1
https://accounts.stage.mozaws.net/force_auth?service=sync&context=fx_desktop_v1
https://accounts.stage.mozaws.net/signin?service=sync&context=fx_desktop_v1
https://accounts.stage.mozaws.net/signup?service=sync&context=fx_desktop_v1
https://accounts.stage.mozaws.net/settings
https://token.stage.mozaws.net/1.0/sync/1.5

And the following 3 different servers:

api-accounts.stage.mozaws.net
accounts.stage.mozaws.net
token.stage.mozaws.net

Formerly we had a single server setup in the config file. Looks like we have to add three different parameters now.

Edwin or James, what would be good names for them? Here my proposal:

* api-accounts-server
* accounts-server
* token-server

Then we can add an --environment option to testrunner CLI, which will set the correct servers. Please let me know if that sounds good.

Comment 3

[James Bonacci [:jbonacci]]

Henrik, thanks for all the changes and additional information, including the move to the correct bug category (sorry, I could not find TPS/Testing)...
Those config params look right to me.
The server names look good to me.

Comment 4

[Karl Thiessen [:kthiessen, he/him]]

See bug 1305578 -- this is taken care of now.