Merge lp:~canonical-platform-qa/snappy-ecosystem-tests/register-snap-tests into lp:snappy-ecosystem-tests

[Heber Parrucci]

Automate scenarios:
* Successfully register a package name in snap store via snapcraft register command and check with RESTful API
* Successfully register a private package name in snap store via snapcraft and check with RESTful API
* Snapcraft lists a new snap registered via RESTful API
* Snapcraft lists a new private snap registered via RESTful API

This change includes 4 automated scenarios:
Automate:

Successfully register a package name in snap store via snapcraft register command and check with RESTful API

Successfully register a private package name in snap store via snapcraft and check with RESTful API

Snapcraft lists a new snap registered via RESTful API

Snapcraft lists a new private snap registered via RESTful API

For details refer to:

https://prod.practitest.com/p/2505/tests/781190/edit
https://prod.practitest.com/p/2505/tests/781173/edit
https://prod.practitest.com/p/2505/tests/781174/edit
https://prod.practitest.com/p/2505/tests/781201/edit

Note: we should include as part of cleanUp process the 'un-register' snap name. But currently there is not API for doing it. Therefore, every time you run the tests a new random name will be registered.

To run the tests:
./run_system_tests snappy_ecosystem_tests/tests/test_register_snap.py

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:18
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/65/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1652/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/65/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:19
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/66/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1653/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/66/rebuild

review: Approve (continuous-integration)

[I Ahmad (iahmad)]

minor inline comment about test name otherwise LGTM

review: Approve

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:20
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/80/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1667/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/80/rebuild

review: Approve (continuous-integration)

[Heber Parrucci (heber013)]

> minor inline comment about test name otherwise LGTM

Thanks for reviewing. Names were updated. Also, I added generic filters mechanism and 2 new tests. Feel free to review it again.

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:20
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/81/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1668/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/81/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:21
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/82/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1669/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/82/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:23
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/85/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1672/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/85/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:25
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/92/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1681/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/92/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:26
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/93/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1682/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/93/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/96/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1685/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/96/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/98/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1709/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/98/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/102/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1717/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/102/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/105/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1721/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/105/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/108/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1724/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/108/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/111/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1727/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/111/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/115/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1731/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/115/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/119/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1735/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/119/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/123/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1739/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/123/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/127/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1743/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/127/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/131/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1747/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/131/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/135/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1751/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/135/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/139/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1755/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/139/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/143/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1759/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/143/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/147/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1763/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/147/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/151/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1767/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/151/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/155/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1771/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/155/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/159/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1775/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/159/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/163/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1779/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/163/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/167/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1783/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/167/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/171/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1787/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/171/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/175/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1791/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/175/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/181/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1847/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/181/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/189/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1866/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/189/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/195/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1885/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/195/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/199/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1903/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/199/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/203/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1931/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/203/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:27
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/207/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1961/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/207/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:28
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/209/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1988/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/209/rebuild

review: Approve (continuous-integration)

[I Ahmad (iahmad)]

Getting these errors when tried to run locally http://paste.ubuntu.com/24057813/

[Heber Parrucci (heber013)]

> Getting these errors when tried to run locally
> http://paste.ubuntu.com/24057813/

Yes. It is because snapcraft helpers were updated to run the commands over ssh.
I was able to run the tests by connecting by ssh to my localhost. However, I needed to add the environment variables each time I sens the command via ssh... But it will not be needed once we have the containers setup in place, because we configure the env variables as part of the setup process.

If you still would like to tests it locally, add in ~/.config/ecosystem_tests.cfg:
[user]
user_email=^STORE_USER^
user_password=^STORE_PASSWORD^
hostname_remote=localhost
username_remote=^LOCAL_USERNAME^
port_remote=22

And replace in snappy_ecosystem_tests/utils/ssh.py the function run_command by:
http://paste.ubuntu.com/24058432/

As I said it is just a workaround to be able to run the tests on the localhost, it will not be needed once we have the setup environment in place.

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:29
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/210/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/1994/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/210/rebuild

review: Approve (continuous-integration)

[I Ahmad (iahmad)]

> > Getting these errors when tried to run locally
> > http://paste.ubuntu.com/24057813/
>
> Yes. It is because snapcraft helpers were updated to run the commands over
> ssh.
> I was able to run the tests by connecting by ssh to my localhost. However, I
> needed to add the environment variables each time I sens the command via
> ssh... But it will not be needed once we have the containers setup in place,
> because we configure the env variables as part of the setup process.
>
> If you still would like to tests it locally, add in
> ~/.config/ecosystem_tests.cfg:
> [user]
> user_email=^STORE_USER^
> user_password=^STORE_PASSWORD^
> hostname_remote=localhost
> username_remote=^LOCAL_USERNAME^
> port_remote=22
>
> And replace in snappy_ecosystem_tests/utils/ssh.py the function run_command
> by:
> http://paste.ubuntu.com/24058432/
>
> As I said it is just a workaround to be able to run the tests on the
> localhost, it will not be needed once we have the setup environment in place.

OK, then I think we should have the setup environment changes landed first with updated readme instructions.

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:30
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/225/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/2024/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/225/rebuild

review: Approve (continuous-integration)

[Omer Akram (om26er)]

added minor suggestion.

review: Needs Fixing

[Omer Akram (om26er)]

Added another comment/suggestion.

[Heber Parrucci (heber013)]

Reply inline Thanks!

[Heber Parrucci (heber013)]

Comment addressed

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:31
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/230/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/2031/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/230/rebuild

review: Approve (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:31
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/231/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/2034/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/231/rebuild

review: Approve (continuous-integration)

[lp:~canonical-platform-qa/snappy-ecosystem-tests/register-snap-tests]

32. By Heber Parrucci on 2017-03-02

merge from trunk

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:32
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/233/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/2036/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/233/rebuild

review: Approve (continuous-integration)

[lp:~canonical-platform-qa/snappy-ecosystem-tests/register-snap-tests]

33. By Omer Akram on 2017-03-03

merge with trunk

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:33
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/238/
Executed test runs:
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/2043/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/snappy-ecosystem-tests-ci/238/rebuild

review: Approve (continuous-integration)

[I Ahmad (iahmad)]

LGTM, please go ahead with landing.

review: Approve

[Omer Akram (om26er)]

added a comment. You seem to be using pexect on the host.

review: Needs Fixing

[Omer Akram (om26er)]

a few more inline comments.

review: Needs Fixing

[platform-qa-bot (platform-qa-bot)]

review: Approve (continuous-integration)

[Heber Parrucci (heber013)]

Thanks for reviewing! Will fix the bug separately.

=== modified file 'README.rst'
--- README.rst	2017-02-22 17:40:11 +0000
+++ README.rst	2017-03-03 10:32:00 +0000
@@ -69,17 +69,22 @@
 [user]
 user_email=^USER_NAME^
 user_password=^USER_PASSWORD^
-hostname_remote=^SSH_HOSTNAME^
-username_remote=^SSH_USERNAME^
-port_remote=^SSH_PORT^
+snapd_hostname_remote=^SNAPD_SSH_HOSTNAME^
+snapd_username_remote=^SNAPD_SSH_USERNAME^
+snapd_port_remote=^SNAPD_SSH_PORT^
+snapcraft_hostname_remote=^SNAPCRAFT_SSH_HOSTNAME^
+snapcraft_username_remote=^SNAPCRAFT_SSH_USERNAME^
+snapcraft_port_remote=^SNAPCRAFT_SSH_PORT^
 
 option 2 - Set the following environment variables:
 user_email=^USER_NAME^
 user_password=^USER_PASSWORD^
-hostname_remote=^SSH_HOSTNAME^
-username_remote=^SSH_USERNAME^
-port_remote=^SSH_PORT^
-
+snapd_hostname_remote=^SNAPD_SSH_HOSTNAME^
+snapd_username_remote=^SNAPD_SSH_USERNAME^
+snapd_port_remote=^SNAPD_SSH_PORT^
+snapcraft_hostname_remote=^SNAPCRAFT_SSH_HOSTNAME^
+snapcraft_username_remote=^SNAPCRAFT_SSH_USERNAME^
+snapcraft_port_remote=^SNAPCRAFT_SSH_PORT^
 
 Changing store:
 ===============

=== modified file 'pylint.cfg'
--- pylint.cfg	2017-02-21 13:46:08 +0000
+++ pylint.cfg	2017-03-03 10:32:00 +0000
@@ -169,10 +169,10 @@
 inlinevar-name-hint=[A-Za-z_][A-Za-z0-9_]*$
 
 # Regular expression matching correct function names
-function-rgx=[a-z_][a-z0-9_]{2,30}$
+function-rgx=[a-z_][a-z0-9_]{2,40}$
 
 # Naming hint for function names
-function-name-hint=[a-z_][a-z0-9_]{2,30}$
+function-name-hint=[a-z_][a-z0-9_]{2,40}$
 
 # Regular expression matching correct attribute names
 attr-rgx=[a-z_][a-z0-9_]{2,30}$
@@ -181,10 +181,10 @@
 attr-name-hint=[a-z_][a-z0-9_]{2,30}$
 
 # Regular expression matching correct method names
-method-rgx=[a-z_][a-z0-9_]{2,30}$|setUp|tearDown
+method-rgx=[a-z_][a-z0-9_]{2,30}$|setUp|tearDown|test_*
 
 # Naming hint for method names
-method-name-hint=[a-z_][a-z0-9_]{2,30}$|setUp|tearDown
+method-name-hint=[a-z_][a-z0-9_]{2,30}$|setUp|tearDown|test_*
 
 # Regular expression matching correct class attribute names
 class-attribute-rgx=([A-Za-z_][A-Za-z0-9_]{2,30}|(__.*__))$

=== modified file 'requirements-unit-tests.txt'
--- requirements-unit-tests.txt	2017-02-10 18:18:45 +0000
+++ requirements-unit-tests.txt	2017-03-03 10:32:00 +0000
@@ -1,1 +1,1 @@
-unittest2
+testtools

=== modified file 'requirements.txt'
--- requirements.txt	2017-03-01 10:43:34 +0000
+++ requirements.txt	2017-03-03 10:32:00 +0000
@@ -18,3 +18,4 @@
 pyyaml
 retrying
 paramiko
+chromedriver_installer

=== modified file 'run_system_tests'
--- run_system_tests	2017-02-13 16:00:04 +0000
+++ run_system_tests	2017-03-03 10:32:00 +0000
@@ -20,6 +20,7 @@
 
 . ./mk-venv "$@"
 
+ve/bin/python3 ./snappy_ecosystem_tests/utils/store_versions.py
 ve/bin/python3 ./snappy_ecosystem_tests/run.py "$@" -c snappy_ecosystem_tests/configs/pytest.cfg --ignore snappy_ecosystem_tests/unittests/ --junitxml snappy-ecosystem-results.xml
 
 deactivate

=== modified file 'snappy_ecosystem_tests/configs/ecosystem_tests.cfg'
--- snappy_ecosystem_tests/configs/ecosystem_tests.cfg	2017-02-10 19:20:45 +0000
+++ snappy_ecosystem_tests/configs/ecosystem_tests.cfg	2017-03-03 10:32:00 +0000
@@ -1,7 +1,5 @@
-[web-ui]
+[selenium]
 browser=chrome
-stage_url=https://myapps.developer.staging.ubuntu.com/
-production_url=https://myapps.developer.ubuntu.com/
 
 [store]
 # store to use in tests. Possible values: staging or production
@@ -12,9 +10,16 @@
 upload=https://upload.apps.staging.ubuntu.com/
 sso=https://login.staging.ubuntu.com/api/v2/
 search=https://search.apps.staging.ubuntu.com/
+web=https://myapps.developer.staging.ubuntu.com/
 
 [production_urls]
 root_api=https://myapps.developer.ubuntu.com/dev/api/
 upload=https://upload.apps.ubuntu.com/
 sso=https://login.ubuntu.com/api/v2/
 search=https://search.apps.ubuntu.com/
+web=https://myapps.developer.ubuntu.com/
+
+[time_between_registrations]
+# Time in seconds between each snap registration
+staging=10
+production=180

=== modified file 'snappy_ecosystem_tests/helpers/snapcraft/client.py'
--- snappy_ecosystem_tests/helpers/snapcraft/client.py	2017-02-15 19:35:54 +0000
+++ snappy_ecosystem_tests/helpers/snapcraft/client.py	2017-03-03 10:32:00 +0000
@@ -20,14 +20,50 @@
 
 """Snapcraft client helpers"""
 
+import logging
+import subprocess
+import time
+
 import pexpect
 
-
-# login credentials exported by shell environment
+from snappy_ecosystem_tests.models.snap import Snap
+from snappy_ecosystem_tests.utils import ssh
+from snappy_ecosystem_tests.utils.commands import build_command
+from snappy_ecosystem_tests.utils.filters import filter_list
+from snappy_ecosystem_tests.utils.storeconfig import get_current_store
+
+from snappy_ecosystem_tests.commons.config import CONFIG_STACK
+
 from snappy_ecosystem_tests.utils import storeconfig
 
+# login credentials gotten from config file or shell environment
+from snappy_ecosystem_tests.utils.user import (
+    get_snapcraft_remote_host_credentials
+)
+
 LOGIN_EMAIL, LOGIN_PASSWORD = storeconfig.get_store_credentials()
 
+# Commands
+PATH_SNAPCRAFT = '/usr/bin/snapcraft'
+COMMANDS_LOGIN = """\
+/usr/bin/expect \
+-c 'spawn {snapcraft} login' \
+-c 'expect Email:' \
+-c 'send {email}\\r' \
+-c 'expect Password:' \
+-c 'send {password}\\r' \
+-c 'interact'\
+"""
+
+COMMAND_LOGOUT = 'logout'
+COMMAND_REGISTER = 'register'
+COMMAND_LIST_REGISTERED = 'list-registered'
+
+LOGGER = logging.getLogger(__name__)
+
+HOSTNAME, USERNAME, PORT = get_snapcraft_remote_host_credentials()
+SNAPCRAFT_CONFIG_FILE_PATH = '~/.config/snapcraft/snapcraft.cfg'
+
 
 class Snapcraft(object):
     """Contain Snapcraft specific functionality to use via command
@@ -37,13 +73,49 @@
         self._login = False
         self._cleanup()
 
+    @staticmethod
+    def _run_snapcraft_command_ssh(command, debug=True):
+        """
+        Run snapcraft command via ssh
+        :param command: the command to be executed.
+        Can be a single string or a list of strings
+        :param debug: whether to enable debug mode
+        :return: the command's output
+        """
+        if not command.startswith(PATH_SNAPCRAFT):
+            command = build_snapcraft_command(command)
+        if debug:
+            command += ' -d'
+        return ssh.run_command(command, hostname=HOSTNAME, username=USERNAME,
+                               port=PORT)
+
+    @staticmethod
+    def assert_logged_in():
+        """Assert that an user is logged.
+        :raise ValueError: in case login is false
+        """
+        if Snapcraft.is_logged_in() is False:
+            raise ValueError("User is not logged in, "
+                             "please login before using this command")
+
+    @staticmethod
+    def is_logged_in():
+        """Return bool representing if the user is logged into snapcraft."""
+        try:
+            output = ssh.run_command(
+                'cat %s' % SNAPCRAFT_CONFIG_FILE_PATH,
+                hostname=HOSTNAME, username=USERNAME, port=PORT)
+            return output is not ''
+        except ValueError:
+            return False
+
     def _cleanup(self):
         """Perform cleanup actions"""
         self.logout()
 
     def logout(self):
         """logout of snapcraft store session"""
-        child = pexpect.spawn("snapcraft logout")
+        child = pexpect.spawn(build_snapcraft_command(COMMAND_LOGOUT))
         err = child.expect('Credentials cleared.')
         child.terminate(True)
         child.wait()
@@ -52,23 +124,105 @@
 
         self._login = False
 
-    def login(self):
-        """login to store using the credential environment variables"""
-        child = pexpect.spawn("snapcraft login")
-        child.expect('Email: ')
-        child.sendline(LOGIN_EMAIL)
-        child.expect('Password:')
-        child.sendline(LOGIN_PASSWORD)
-        err = child.expect('Login successful')
-        if err is not 0:
-            raise ValueError("Failed to login")
-
-        self._login = True
-
-    def list_registered(self):
-        """call snapcraft list-registered command,
-        raise exception if not logged in"""
-        if self._login is False:
-            raise ValueError("User is not logged in, "
-                             "please login before using this command")
-        return pexpect.spawnu("snapcraft list-registered").read()
+    @staticmethod
+    def login(email=LOGIN_EMAIL, password=LOGIN_PASSWORD):
+        """Login to Snapcraft. If email and/or password are not provided,
+        use the default ones.
+        :param email: the SSO email
+        :param password: the email password
+        """
+        ssh.run_command(
+            COMMANDS_LOGIN.format(email=email, password=password,
+                                  snapcraft=PATH_SNAPCRAFT),
+            hostname=HOSTNAME, username=USERNAME, port=PORT)
+        return Snapcraft.is_logged_in()
+
+    def list_registered(self, debug=True, raw=False):
+        """Call snapcraft list-registered command,
+        raise exception if not logged in
+        :param debug: whether to enable debug mode
+        :param raw: whether to return the output as a raw.
+        If False, return a list of Snap instances
+        """
+        self.assert_logged_in()
+        registered_snaps_output = self._run_snapcraft_command_ssh(
+            COMMAND_LIST_REGISTERED,
+            debug=debug)
+        if raw:
+            return registered_snaps_output
+        else:
+            snaps = registered_snaps_output.splitlines()
+            # if debug is set, the first 3 lines of output are the API calls
+            return parse_snaps_raw(snaps if debug is False else snaps[3:])
+
+    def filter_snaps(self, **predicates):
+        """
+        Return a list of the snaps that match with all the given predicates.
+        Examples:
+        filter_snap() --> return all the snaps
+        filter_snap(name='my_name') --> return the snaps that matches with
+         name 'my_name'
+        filter_snap(name='my_name', private=True) --> return the snaps that
+         matches with name 'my_name' and are private.
+        filter_snap(price='5') --> return the snaps with price '5'.
+        :return: A list of snap instances
+        """
+        return filter_list(self.list_registered(raw=False), **predicates)
+
+    def register(self, snap_name, private=False, wait=True):
+        """
+        Register a snap name in the store.
+        :param snap_name: the snap name to register.
+        :param private: whether the snap name is private.
+        :param wait: wheter to wait after registration to hitting the store
+         restriction on following registrations
+        :return: True if the snap was registered successfully, False otherwise.
+        """
+        self.assert_logged_in()
+        LOGGER.info('About to register snap: %s', snap_name)
+        command = build_snapcraft_command(COMMAND_REGISTER, snap_name)
+        if private:
+            command += ' --private'
+        try:
+            Snapcraft._run_snapcraft_command_ssh(command)
+        except subprocess.CalledProcessError as _e:
+            LOGGER.error('Unable to register snap: %s', _e.output)
+            return False
+        if wait:
+            time.sleep(int(CONFIG_STACK.get('time_between_registrations',
+                                            get_current_store())))
+        LOGGER.info('Snap %s registered successfully!!!', snap_name)
+        return True
+
+
+def build_snapcraft_command(*args, base_command=PATH_SNAPCRAFT):
+    """
+    Build a snapcraft command with arguments
+    :param args: list of arguments for the command
+    :param base_command: snapcraft executable that is going to be used
+    :return: the snapcraft command ready to be executed
+    """
+    return build_command(base_command, *args)
+
+
+def parse_snaps_raw(raw):
+    """
+    Parse snaps raw output to a list of Snaps object
+    :param raw: the raw that contains the snaps info.
+    It assumes that the first line is the output Header like:
+     (Name, Since, Price, etc.) to get the attributes order.
+    :return: A list of snaps instances
+    """
+    attributes_order = {}
+    for _i, att in enumerate(raw[0].split()):
+        attributes_order[att.lower()] = _i
+    snaps = []
+    for snap_raw in raw[1:]:
+        attrs = snap_raw.split()
+        private = attrs[attributes_order.get('visibility')].lower() == 'private'
+        snaps.append(Snap(name=attrs[attributes_order.get('name')],
+                          since=attrs[attributes_order.get('since')],
+                          private=private,
+                          price=attrs[attributes_order.get('price')],
+                          notes=attrs[attributes_order.get('notes')]))
+    return snaps

=== modified file 'snappy_ecosystem_tests/helpers/snapd/snapd.py'
--- snappy_ecosystem_tests/helpers/snapd/snapd.py	2017-02-28 21:52:46 +0000
+++ snappy_ecosystem_tests/helpers/snapd/snapd.py	2017-03-03 10:32:00 +0000
@@ -26,6 +26,7 @@
 import yaml
 
 from snappy_ecosystem_tests.utils import ssh
+from snappy_ecosystem_tests.utils.user import get_snapd_remote_host_credentials
 
 PATH_SNAP = '/usr/bin/snap'
 COMMAND_DOWNLOAD = 'download {snap} --channel={channel}'
@@ -47,6 +48,8 @@
 """
 LOGGER = logging.getLogger(__name__)
 
+HOSTNAME, USERNAME, PORT = get_snapd_remote_host_credentials()
+
 
 def run_snapd_command_ssh(parameters, cwd=''):
     """Run snapd command over ssh.
@@ -56,7 +59,8 @@
         should run.
     :returns: stdout of the command
     """
-    return ssh.run_command('{} {}'.format(PATH_SNAP, parameters), cwd=cwd)
+    return ssh.run_command('{} {}'.format(PATH_SNAP, parameters), cwd=cwd,
+                           hostname=HOSTNAME, username=USERNAME, port=PORT)
 
 
 def login(email, password):

=== modified file 'snappy_ecosystem_tests/helpers/store_apis/rest_apis.py'
--- snappy_ecosystem_tests/helpers/store_apis/rest_apis.py	2017-02-17 18:41:32 +0000
+++ snappy_ecosystem_tests/helpers/store_apis/rest_apis.py	2017-03-03 10:32:00 +0000
@@ -45,6 +45,8 @@
 from snappy_ecosystem_tests.helpers.snapcraft.options import ProjectOptions
 from snappy_ecosystem_tests.helpers.store_apis import errors
 from snappy_ecosystem_tests.helpers.store_apis.upload import upload_files
+from snappy_ecosystem_tests.models.snap import Snap
+from snappy_ecosystem_tests.utils.filters import filter_list
 
 LOGGER = logging.getLogger(__name__)
 
@@ -193,16 +195,28 @@
         """Get current account information"""
         return self._refresh_if_necessary(self.sca.get_account_information)
 
+    def get_registered_snaps(self, series=constants.DEFAULT_SERIES):
+        """Get registered snaps for current user.
+        First refresh macaroon if necessary"""
+        return self._refresh_if_necessary(self.sca.get_registered_snaps,
+                                          series)
+
+    def filter_snaps(self, series=constants.DEFAULT_SERIES, **predicates):
+        """Filter snaps that match with given predicates
+        First refresh macaroon if necessary"""
+        return self._refresh_if_necessary(self.sca.filter_snaps,
+                                          series=series, **predicates)
+
     def register_key(self, account_key_request):
         """Register a key for the current user"""
         return self._refresh_if_necessary(
             self.sca.register_key, account_key_request)
 
-    def register(self, snap_name, is_private=False):
+    def register(self, snap_name, private=False):
         """Register a package name for the current user
         First refresh macaroon if necessary"""
         return self._refresh_if_necessary(
-            self.sca.register, snap_name, is_private, constants.DEFAULT_SERIES)
+            self.sca.register, snap_name, private, constants.DEFAULT_SERIES)
 
     def push_precheck(self, snap_name):
         """Do a snap push as a pre-check (dry_run: do not actually push)
@@ -555,6 +569,36 @@
         else:
             raise errors.StoreAccountInformationError(response)
 
+    def get_registered_snaps(self, series=constants.DEFAULT_SERIES):
+        """
+        Get the registered snaps for the current user
+        :param series: get only snaps that match with this series
+        :return: the list of registered snaps
+        """
+        account_info = self.get_account_information()
+        user_snaps = account_info.get('snaps')
+        snaps_dict = user_snaps.get(series)
+        snaps = []
+        for name, snap_data in snaps_dict.items():
+            snaps.append(Snap(name=name, **snap_data))
+        return snaps
+
+    def filter_snaps(self, series=constants.DEFAULT_SERIES, **predicates):
+        """
+        Return a list of the snaps that match with all the given predicates.
+        :param: series: only look in the snaps that match with this series
+        Examples:
+        filter_snap() --> return all the snaps
+        filter_snap(name='my_name') --> return the snaps that matches with
+         name 'my_name'
+        filter_snap(name='my_name', private=True) --> return the snaps that
+         matches with name 'my_name' and are private.
+        filter_snap(price='5') --> return the snaps that with price '5'.
+        :return: A list of snap instances
+        """
+        return filter_list(self.get_registered_snaps(series=series),
+                           **predicates)
+
     def register_key(self, account_key_request):
         """Register a key for a user with the given request
         :param account_key_request: the key to register
@@ -568,20 +612,21 @@
         if not response.ok:
             raise errors.StoreKeyRegistrationError(response)
 
-    def register(self, snap_name, is_private, series):
+    def register(self, snap_name, private, series):
         """Register a snap name in the store
         :param snap_name: the name to be registered
-        :param is_private: whether the snap name is private or not
+        :param private: whether the snap name is private or not
         :param series: the snap's series to be registered
         """
         auth = _macaroon_auth(self.conf)
-        data = dict(snap_name=snap_name, is_private=is_private,
+        data = dict(snap_name=snap_name, is_private=private,
                     series=series)
         response = self.post(
             'register-name/', data=json.dumps(data),
-            headers=dict({'Authorization': auth}, **JSON_ACCEPT))
+            headers=dict({'Authorization': auth}, **JSON_CONTENT_TYPE))
         if not response.ok:
             raise errors.StoreRegistrationError(snap_name, response)
+        return True
 
     def snap_push_precheck(self, snap_name):
         """Do a snap push pre-check (dry_run: do not actually push)

=== added directory 'snappy_ecosystem_tests/models'
=== added file 'snappy_ecosystem_tests/models/__init__.py'
--- snappy_ecosystem_tests/models/__init__.py	1970-01-01 00:00:00 +0000
+++ snappy_ecosystem_tests/models/__init__.py	2017-03-03 10:32:00 +0000
@@ -0,0 +1,19 @@
+# -*- Mode: Python; coding: utf-8; indent-tabs-mode: nil; tab-width: 4 -*-
+
+#
+# Snappy Ecosystem Tests
+# Copyright (C) 2017 Canonical
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#

=== added file 'snappy_ecosystem_tests/models/snap.py'
--- snappy_ecosystem_tests/models/snap.py	1970-01-01 00:00:00 +0000
+++ snappy_ecosystem_tests/models/snap.py	2017-03-03 10:32:00 +0000
@@ -0,0 +1,39 @@
+# -*- Mode: Python; coding: utf-8; indent-tabs-mode: nil; tab-width: 4 -*-
+
+#
+# Snappy Ecosystem Tests
+# Copyright (C) 2017 Canonical
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#
+
+"""Business model classes for snaps"""
+
+
+class Snap:
+    """Represents a snap entity."""
+
+    def __init__(self, name='', price=None, private=False, since=None,
+                 _id=None, status=None, notes=None, **kwargs):
+        self.name = name
+        self.price = price
+        self.private = private
+        self.since = since
+        self._id = _id or kwargs.get('snap-id')
+        self.status = status
+        self.notes = notes
+
+    def is_private(self):
+        """Return True if the snap is private, False otherwise"""
+        return self.private

=== modified file 'snappy_ecosystem_tests/run.py'
--- snappy_ecosystem_tests/run.py	2017-02-15 19:14:19 +0000
+++ snappy_ecosystem_tests/run.py	2017-03-03 10:32:00 +0000
@@ -20,28 +20,38 @@
 
 """Entry point to run snappy ecosystem tests"""
 
+import argparse
+import os
 import re
 import sys
 import pytest
 
-FILTER_ARGUMENTS = '--proxy'
-
-
-def _filter_arguments():
-    """Remove from command line arguments all the ones that are in
-     FILTER_ARGUMENTS list."""
-    filtered_args = sys.argv[1:]
-    for i, arg in enumerate(sys.argv[1:]):
-        if arg in FILTER_ARGUMENTS:
-            filtered_args.pop(i + 1)
-            filtered_args.pop(i)
-    return filtered_args
-
 
 def _parse_arguments():
     """Parse and filter command line arguments to makethem pytest compatible"""
     sys.argv[0] = re.sub(r'(-script\.pyw?|\.exe)?$', '', sys.argv[0])
-    return _filter_arguments()
+    parser = argparse.ArgumentParser(description=
+                                     'Run snappy ecosystem tests.')
+    parser.add_argument('--proxy',
+                        help='proxy to use for creating the virtual env.',
+                        required=False)
+    parser.add_argument('--target', default="lxd",
+                        help='Target on which tests will be executed.')
+    ecosystem_args, pytest_args = parser.parse_known_args()
+    _set_env_variables(ecosystem_args)
+    return pytest_args
+
+
+def _set_env_variables(args):
+    """
+    Set environment variables with ecosystem arguments passed
+    in the command line.
+    :param args: The arguments to store in env variables
+    """
+    for arg in vars(args):
+        value = getattr(args, arg, None)
+        if value:
+            os.environ[arg] = value
 
 if __name__ == '__main__':
     sys.exit(pytest.main(args=_parse_arguments() + ['-p', 'no:cacheprovider']))

=== added file 'snappy_ecosystem_tests/tests/test_register_snap.py'
--- snappy_ecosystem_tests/tests/test_register_snap.py	1970-01-01 00:00:00 +0000
+++ snappy_ecosystem_tests/tests/test_register_snap.py	2017-03-03 10:32:00 +0000
@@ -0,0 +1,116 @@
+# -*- Mode: Python; coding: utf-8; indent-tabs-mode: nil; tab-width: 4 -*-
+
+#
+# Snappy Ecosystem Tests
+# Copyright (C) 2017 Canonical
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#
+
+"""Tests for Registering a snap name in the store"""
+
+import uuid
+
+from snappy_ecosystem_tests.helpers.snapcraft.client import Snapcraft
+from snappy_ecosystem_tests.helpers.store_apis.rest_apis import Store
+from snappy_ecosystem_tests.helpers.test_base import SnappyEcosystemTestCase
+from snappy_ecosystem_tests.utils.storeconfig import get_store_credentials
+
+
+class RegisterSnapNameTestCase(SnappyEcosystemTestCase):
+
+    def setUp(self):
+        super().setUp()
+        self.store = Store()
+        self.snapcraft = Snapcraft()
+        self.store.login(*get_store_credentials())
+        self.addCleanup(self.store.logout)
+        self.snapcraft.login()
+        self.addCleanup(self.snapcraft.logout)
+
+    @staticmethod
+    def _get_random_snap_name(prefix='ecosystem-test'):
+        """Get a random snap name using uuid
+        :param prefix: the string prefix,
+        if not provided, use default one.
+        """
+        return '{}{}'.format(prefix, int(uuid.uuid4()))
+
+    def test_register_public_snap_name_using_snapcraft(self):
+        """Test register a public snap name via snapcraft
+        and verify it via REST API"""
+        # Register snap via Snapcraft
+        snap_name = self._get_random_snap_name()
+        self.assertTrue(self.snapcraft.register(snap_name),
+                        'Unable to register snap')
+
+        # Verify the registered snap via REST API
+        snaps = self.store.filter_snaps(name=snap_name)
+        self.assertEqual(1, len(snaps),
+                         'Expected 1 snap with name %s but found %s'
+                         % (snap_name, len(snaps)))
+        snap = snaps[0]
+        self.assertEqual(snap_name, snap.name)
+        self.assertFalse(snap.is_private())
+
+    def test_register_private_snap_name_using_snapcraft(self):
+        """Test register a private snap name via snapcraft
+        and verify it via REST API"""
+        # Register snap via Snapcraft
+        snap_name = self._get_random_snap_name()
+        self.assertTrue(self.snapcraft.register(snap_name, private=True),
+                        'Unable to register snap')
+
+        # Verify the registered snap via REST API
+        snaps = self.store.filter_snaps(name=snap_name)
+        self.assertEqual(1, len(snaps),
+                         'Expected 1 snap with name %s but found %s'
+                         % (snap_name, len(snaps)))
+        snap = snaps[0]
+        self.assertEqual(snap_name, snap.name)
+        self.assertTrue(snap.is_private())
+
+    def test_register_public_snap_name_using_api(self):
+        """Verify that snapcraft lists a new snap registered via
+        RESTful API when using the command snapcraft list-registered"""
+        # Register snap via API
+        snap_name = self._get_random_snap_name()
+        self.assertTrue(self.store.register(snap_name),
+                        'Unable to register snap')
+
+        # Verify the registered snap via Snapcraft
+        snaps = self.snapcraft.filter_snaps(name=snap_name)
+        self.assertEqual(1, len(snaps),
+                         'Expected 1 snap with name %s but found %s'
+                         % (snap_name, len(snaps)))
+        snap = snaps[0]
+        self.assertEqual(snap_name, snap.name)
+        self.assertFalse(snap.is_private())
+
+    def test_register_private_snap_name_using_api(self):
+        """Verify that snapcraft lists a new private snap registered via
+        RESTful API when using the command snapcraft list-registered"""
+        # Register snap via API
+        snap_name = self._get_random_snap_name()
+        self.assertTrue(self.store.register(snap_name, private=True),
+                        'Unable to register snap')
+
+        # Verify the registered snap via Snapcraft
+        snaps = self.snapcraft.filter_snaps(name=snap_name)
+        self.assertEqual(1, len(snaps),
+                         'Expected 1 snap with name %s but found %s'
+                         % (snap_name, len(snaps)))
+        snap = snaps[0]
+        self.assertEqual(snap_name, snap.name)
+        self.assertTrue(snap.is_private())

=== added file 'snappy_ecosystem_tests/unittests/test_filters.py'
--- snappy_ecosystem_tests/unittests/test_filters.py	1970-01-01 00:00:00 +0000
+++ snappy_ecosystem_tests/unittests/test_filters.py	2017-03-03 10:32:00 +0000
@@ -0,0 +1,113 @@
+# -*- Mode: Python; coding: utf-8; indent-tabs-mode: nil; tab-width: 4 -*-
+
+#
+# Snappy Ecosystem Tests
+# Copyright (C) 2017 Canonical
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#
+
+"""Unit tests cases for filter utils"""
+
+from testtools import (
+    TestCase,
+    ExpectedException
+)
+
+from snappy_ecosystem_tests.utils.filters import (
+    object_filter,
+    filter_list
+)
+
+
+class DummyObject:  # pylint: disable=too-few-public-methods
+    """Dummy object to be used in unit tests"""
+
+    def __init__(self, **kwargs):
+        for _k, _v in kwargs.items():
+            setattr(self, _k, _v)
+
+
+class FilterTestCase(TestCase):
+
+    def setUp(self):
+        super().setUp()
+        self.obj = DummyObject(name='dummy', desc='this is dummy')
+        self.obj_2 = DummyObject(name='another-dummy',
+                                 desc='this is another dummy')
+        self.objects = [self.obj, self.obj_2]
+
+    def test_object_filter_with_single_argument(self):
+        """Filter successfully passing one argument"""
+        objects = list(filter(object_filter(name='dummy'), self.objects))
+        self.assertIsNotNone(objects)
+        self.assertEqual(len(objects), 1)
+        self.assertEqual(objects[0], self.obj)
+
+    def test_object_filter_with_multiple_arguments(self):
+        """Filter successfully passing two arguments"""
+        objects = list(filter(object_filter(name='dummy',
+                                            desc='this is dummy'),
+                              self.objects))
+        self.assertIsNotNone(objects)
+        self.assertEqual(len(objects), 1)
+        self.assertEqual(objects[0], self.obj)
+
+    def test_object_filter_does_not_match(self):
+        """Return empty list when no object match criteria"""
+        objects = list(filter(object_filter(name='dummy',
+                                            desc='any desc'),
+                              self.objects))
+        self.assertEqual([], objects)
+
+    def test_object_filter_return_all(self):
+        """Get all objects when no filter is provided"""
+        objects = list(filter(object_filter(), self.objects))
+        self.assertEqual(len(objects), len(self.objects))
+
+    def test_object_filter_raises_attribute_error_if_invalid_filter_name(self):
+        """Object filter raises AttributeError when invalid filter
+         is provided"""
+        with ExpectedException(AttributeError):
+            list(filter(object_filter(invalid='dummy'), self.objects))
+
+    def test_filter_list_with_single_argument(self):
+        """Filter List successfully passing one argument"""
+        objects = filter_list(self.objects, name='dummy')
+        self.assertIsNotNone(objects)
+        self.assertEqual(len(objects), 1)
+        self.assertEqual(objects[0], self.obj)
+
+    def test_filter_list_with_multiple_arguments(self):
+        """Filter List successfully passing multiple argument"""
+        objects = filter_list(self.objects, name='another-dummy',
+                              desc='this is another dummy')
+        self.assertIsNotNone(objects)
+        self.assertEqual(len(objects), 1)
+        self.assertEqual(objects[0], self.obj_2)
+
+    def test_filter_list_does_not_match(self):
+        """Filter List returns empty list when no object match criteria"""
+        objects = filter_list(self.objects, desc='desc does not match')
+        self.assertEqual([], objects)
+
+    def test_filter_list_return_all(self):
+        """Filter list returns all objects when no filter is provided"""
+        objects = filter_list(self.objects)
+        self.assertEqual(len(objects), len(self.objects))
+
+    def test_filter_list_raises_attribute_error_if_invalid_filter_name(self):
+        """Filter list raises AttributeError when invalid filter is provided"""
+        with ExpectedException(AttributeError):
+            filter_list(self.objects, invalid='invalid filter')

=== removed file 'snappy_ecosystem_tests/unittests/test_snapcraft.py'
--- snappy_ecosystem_tests/unittests/test_snapcraft.py	2017-02-13 16:00:04 +0000
+++ snappy_ecosystem_tests/unittests/test_snapcraft.py	1970-01-01 00:00:00 +0000
@@ -1,31 +0,0 @@
-# -*- Mode: Python; coding: utf-8; indent-tabs-mode: nil; tab-width: 4 -*-
-
-#
-# Snappy Ecosystem Tests
-# Copyright (C) 2017 Canonical
-#
-# This program is free software: you can redistribute it and/or modify
-# it under the terms of the GNU General Public License as published by
-# the Free Software Foundation, either version 3 of the License, or
-# (at your option) any later version.
-#
-# This program is distributed in the hope that it will be useful,
-# but WITHOUT ANY WARRANTY; without even the implied warranty of
-# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
-# GNU General Public License for more details.
-#
-# You should have received a copy of the GNU General Public License
-# along with this program.  If not, see <http://www.gnu.org/licenses/>.
-#
-
-"""Unit tests cases for snapcraft"""
-
-from unittest2 import TestCase
-
-
-class SnapcraftTestCase(TestCase):
-
-    def test_snapcraft_dummy_test(self):
-        """Dummy test case"""
-        _a = True
-        self.assertTrue(_a)

=== added file 'snappy_ecosystem_tests/utils/commands.py'
--- snappy_ecosystem_tests/utils/commands.py	1970-01-01 00:00:00 +0000
+++ snappy_ecosystem_tests/utils/commands.py	2017-03-03 10:32:00 +0000
@@ -0,0 +1,31 @@
+# -*- Mode: Python; coding: utf-8; indent-tabs-mode: nil; tab-width: 4 -*-
+
+#
+# Snappy Ecosystem Tests
+# Copyright (C) 2017 Canonical
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#
+
+"""Manage commands to be executed in a shell"""
+
+
+def build_command(command, *args):
+    """
+    Build a command with arguments
+    :param command: the executable that is going to be used
+    :param args: list of arguments for the command
+    :return: the command ready to be executed
+    """
+    return'{c} {a}'.format(c=command, a=' '.join(args)).strip()

=== added file 'snappy_ecosystem_tests/utils/filters.py'
--- snappy_ecosystem_tests/utils/filters.py	1970-01-01 00:00:00 +0000
+++ snappy_ecosystem_tests/utils/filters.py	2017-03-03 10:32:00 +0000
@@ -0,0 +1,51 @@
+# -*- Mode: Python; coding: utf-8; indent-tabs-mode: nil; tab-width: 4 -*-
+
+#
+# Snappy Ecosystem Tests
+# Copyright (C) 2017 Canonical
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#
+
+"""Filter utils"""
+
+
+def object_filter(**predicates):
+    """
+    Higher-order function to build and return an object filter function
+     :param predicates: key/values that represent
+     the conditions to look for in the object instance.
+    :return: a function to be used with filter or lambda expressions.
+    :raise: AttributeError if any of the attributes provided in predicates
+     does not exists
+    """
+    def wrapped_filter(instance):
+        """wrapped function to be returned when calling object_filter"""
+        return all(getattr(instance,
+                           param) == val for param, val in predicates.items())
+    return wrapped_filter
+
+
+def filter_list(objects_list, **predicates):
+    """
+    Filter a list of objects with the given predicates
+    :param objects_list: the target list that contains
+     the objects to be filtered
+    :param predicates: key/values that represent
+    the conditions to look for in the object list.
+    :return: A list with the objects that match all the predicates
+    :raise: AttributeError if any of the attributes provided in predicates
+     does not exists
+    """
+    return list(filter(object_filter(**predicates), objects_list))

=== modified file 'snappy_ecosystem_tests/utils/ssh.py'
--- snappy_ecosystem_tests/utils/ssh.py	2017-03-01 18:57:02 +0000
+++ snappy_ecosystem_tests/utils/ssh.py	2017-03-03 10:32:00 +0000
@@ -23,7 +23,7 @@
 import logging
 import paramiko
 
-from snappy_ecosystem_tests.utils.user import get_remote_host_credentials
+from snappy_ecosystem_tests.utils.user import get_snapd_remote_host_credentials
 
 LOGGER = logging.getLogger(__name__)
 
@@ -113,7 +113,9 @@
     :raises ValueError: if command exits with non-zero status.
     :return: the stdout of the command.
     """
-    _hostname, _username, _port = get_remote_host_credentials()
+    # Take snapd remote credentials as default if they are not provided.
+    # Just arbitrary... Could have been other ones.
+    _hostname, _username, _port = get_snapd_remote_host_credentials()
     ssh = SSHManager.get_instance(
         hostname or _hostname, username or _username, port or _port)
     return ssh.exec_command(command, cwd=cwd)

=== added file 'snappy_ecosystem_tests/utils/store_versions.py'
--- snappy_ecosystem_tests/utils/store_versions.py	1970-01-01 00:00:00 +0000
+++ snappy_ecosystem_tests/utils/store_versions.py	2017-03-03 10:32:00 +0000
@@ -0,0 +1,74 @@
+# -*- Mode: Python; coding: utf-8; indent-tabs-mode: nil; tab-width: 4 -*-
+
+#
+# Snappy Ecosystem Tests
+# Copyright (C) 2017 Canonical
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#
+
+"""Utility for printing Store versions of: CPI, SCA and SSO.
+To be called as a standalone script.
+"""
+
+import requests
+
+DEFAULT_HEADER = "X-BZR-REVISION-NUMBER"
+
+SERVICES_INFO = dict(
+    CPI=('https://search.apps.ubuntu.com/api/v1',
+         'https://search.apps.staging.ubuntu.com/api/v1'),
+    SCA=('https://myapps.developer.ubuntu.com/',
+         'https://myapps.developer.staging.ubuntu.com/'),
+    SSO=('https://login.ubuntu.com/',
+         'https://login.staging.ubuntu.com/'),
+)
+
+
+def get_deployed_revno(service, environment):
+    """Get revno from service."""
+    prod, stag = SERVICES_INFO[service]
+    if environment == 'staging':
+        url = stag
+    else:
+        url = prod
+    with requests.Session() as session:
+        resp = session.get(url)
+        if resp.status_code == 200:
+            revno = resp.headers[DEFAULT_HEADER]
+        else:
+            print("{} 500'ed: {}".format(service, resp.text))
+            revno = 0
+    return service, environment, revno
+
+
+def print_versions():
+    """Print Store components version"""
+    coros = []
+    for service in SERVICES_INFO:
+        coro = get_deployed_revno(service, 'staging')
+        coros.append(coro)
+        coro = get_deployed_revno(service, 'production')
+        coros.append(coro)
+
+    data = {(service, kind): value for service, kind, value in coros}
+    print("#########################-STORE VERSIONS-#########################")
+    for service in sorted(SERVICES_INFO):
+        print("{}:    Staging:    {:>5}".format(service,
+                                                data[(service, 'staging')]))
+        print("{}:    Production: {:>5}".format(service,
+                                                data[(service, 'production')]))
+
+if __name__ == '__main__':
+    print_versions()

=== modified file 'snappy_ecosystem_tests/utils/storeconfig.py'
--- snappy_ecosystem_tests/utils/storeconfig.py	2017-02-15 19:14:19 +0000
+++ snappy_ecosystem_tests/utils/storeconfig.py	2017-03-03 10:32:00 +0000
@@ -27,8 +27,8 @@
     USER_CONFIG_STACK
 )
 
-URL_WEB_STORE_PRODUCTION = CONFIG_STACK.get('web-ui', 'production_url')
-URL_WEB_STORE_STAGING = CONFIG_STACK.get('web-ui', 'stage_url')
+URL_WEB_STORE_PRODUCTION = CONFIG_STACK.get('production_urls', 'web')
+URL_WEB_STORE_STAGING = CONFIG_STACK.get('staging_urls', 'web')
 
 
 def get_store_credentials():

=== modified file 'snappy_ecosystem_tests/utils/user.py'
--- snappy_ecosystem_tests/utils/user.py	2017-02-22 15:39:40 +0000
+++ snappy_ecosystem_tests/utils/user.py	2017-03-03 10:32:00 +0000
@@ -23,13 +23,34 @@
 import os
 
 from snappy_ecosystem_tests.commons.config import USER_CONFIG_STACK
-
-
-def get_remote_host_credentials():
-    """Return credentials for remote machine, to run commands on."""
-    return (USER_CONFIG_STACK.get('user', 'hostname_remote',
-                                  default=os.environ.get('hostname_remote')),
-            USER_CONFIG_STACK.get('user', 'username_remote',
-                                  default=os.environ.get('username_remote')),
-            USER_CONFIG_STACK.get('user', 'port_remote',
-                                  default=os.environ.get('port_remote')))
+from snappy_ecosystem_tests.environment.managers import get_manager
+
+MANAGER = get_manager(os.environ['target'])
+
+
+def get_snapd_remote_host_credentials():
+    """Return credentials for snapd remote machine, to run commands on."""
+    _ip = MANAGER.get_ip(USER_CONFIG_STACK.get(
+        'user', 'snapd_hostname_remote',
+        default=os.environ.get('snapd_hostname_remote')))
+    return (_ip,
+            USER_CONFIG_STACK.get('user', 'snapd_username_remote',
+                                  default=os.environ.get(
+                                      'snapd_username_remote')),
+            USER_CONFIG_STACK.get('user', 'snapd_port_remote',
+                                  default=os.environ.get(
+                                      'snapd_port_remote')))
+
+
+def get_snapcraft_remote_host_credentials():
+    """Return credentials for snapcraft remote machine, to run commands on."""
+    _ip = MANAGER.get_ip(USER_CONFIG_STACK.get(
+        'user', 'snapcraft_hostname_remote',
+        default=os.environ.get('snapcraft_snapcraft_remote')))
+    return (_ip,
+            USER_CONFIG_STACK.get('user', 'snapcraft_username_remote',
+                                  default=os.environ.get(
+                                      'snapcraft_username_remote')),
+            USER_CONFIG_STACK.get('user', 'snapcraft_port_remote',
+                                  default=os.environ.get(
+                                      'snapcraft_port_remote')))