Merge ~morphis/snappy-hwe-snaps/+git/alsa-utils:feature/rework-manual-tests into ~snappy-hwe-team/snappy-hwe-snaps/+git/alsa-utils:master

[Simon Fels]

tests: rework tests to be manual instead of automated ones

Somehow the execution of /snap/bin binaries was working before in
devmode was working before but now fails. Converting test cases
to manual ones for the time being.

[System Enablement Bot (system-enablement-ci-bot)]

PASSED: Continuous integration, rev:7999f93c7a48d7e2b46dd910c74ab873aec28c43
https://jenkins.canonical.com/system-enablement/job/generic-build-snap/947/
Executed test runs:
    SUCCESS: https://jenkins.canonical.com/system-enablement/job/generic-run-snap-spread-tests/629
    None: https://jenkins.canonical.com/system-enablement/job/generic-update-snap-mp/855/console

Click here to trigger a rebuild:
https://jenkins.canonical.com/system-enablement/job/generic-build-snap/947/rebuild

review: Approve (continuous-integration)

[Alfonso Sanchez-Beato (alfonsosanchezbeato)]

Please add a bug report to alsa-utils or to the project where the problem might reside, and add a comment in tests/manual/units/device.pxu pointing to that bug.

Besides that, LGTM.

review: Needs Fixing

[Alfonso Sanchez-Beato (alfonsosanchezbeato)]

review: Approve

[System Enablement Bot (system-enablement-ci-bot)]

PASSED: Continuous integration, rev:c407cd858d281ea3880926c74c0029e53b96322f
https://jenkins.canonical.com/system-enablement/job/generic-build-snap/964/
Executed test runs:
    SUCCESS: https://jenkins.canonical.com/system-enablement/job/generic-run-snap-spread-tests/668
    None: https://jenkins.canonical.com/system-enablement/job/generic-update-snap-mp/872/console

Click here to trigger a rebuild:
https://jenkins.canonical.com/system-enablement/job/generic-build-snap/964/rebuild

review: Approve (continuous-integration)

diff --git a/tests/manual/units/device.pxu b/tests/manual/units/device.pxu
index 386735a..a3f7b34 100644
--- a/tests/manual/units/device.pxu
+++ b/tests/manual/units/device.pxu
@@ -1,12 +1,15 @@
+# FIXME: Convert this test back to an automated one. See LP #1665652
 id: alsa_utils/device/can_list_available_cards
 category_id: alsa_utils
 _description:
   Validate that available ALSA sound cards can be listed with the
   utilities the snap ships.
-plugin: shell
-command:
-  test `/snap/bin/aplay -L | wc -l` -gt 0
-  /snap/bin/amixer | grep Simple
-  /snap/bin/amixer controls | grep CARD
-estimated_duration: 1s
-flags: preserve-locale
+plugin: manual
+_steps:
+ Execute the following command:
+ .
+ $ /snap/bin/aplay -L
+ .
+_verification:
+ Verify that the command prints out a list of available ALSA
+ devices.
diff --git a/tests/manual/units/playback.pxu b/tests/manual/units/playback.pxu
index d79b0cf..d1a8083 100644
--- a/tests/manual/units/playback.pxu
+++ b/tests/manual/units/playback.pxu
@@ -1,10 +1 @@
-id: alsa_utils/playback/can_play_wav
-category_id: alsa_utils
-_description:
-  Validate we can play a simple wav file we ship as part of the alsa-utils
-  snap.
-plugin: shell
-command:
-  /snap/bin/aplay -D hw:1 /snap/alsa-utils/current/usr/share/sounds/alsa/Noise.wav
-estimated_duration: 1s
-flags: preserve-locale
+# FIXME: Convert this test back to an automated one. See LP #1665652