Merge ~gabrielzchen/plainbox-provider-checkbox:dock-and-pm into plainbox-provider-checkbox:master

[Gabriel Zhi Chen]

1. Add the power-button test case,
2. Modify the steps of audio-playback-headphones and audio-alsa-record-playback-external cases,
3.Remove the cases audio-speaker-headphone-plug-detection and audio-microphone-plug-detection.

[Jerry Kao (jerry.kao)]

+1

review: Approve

[Betty Lin (bettyl)]

LGTM +1

review: Approve

[Devices Certification Bot (ce-certification-qa)]

The merge was fine but running tests failed.

[bionic] [09:25:06] starting container
Device project added to bionic-testing
[bionic] [09:25:19] provisioning container
[bionic] [09:27:31] Unable to provision requirements in container!
[bionic] output: https://paste.ubuntu.com/p/kr6cHH3J8X/
[bionic] [09:27:34] Fixing file permissions in source directory
[bionic] Destroying failed container to reclaim resources
[xenial] [09:28:50] starting container
Device project added to xenial-testing
[xenial] [09:28:59] provisioning container
[xenial] [09:29:19] Starting tests...
[xenial] Found a test script: ./requirements/container-tests-provider-checkbox
[xenial] [10:05:21] container-tests-provider-checkbox: FAIL
[xenial] output: https://paste.ubuntu.com/p/xF36w7vHM6/
[xenial] [10:05:23] Fixing file permissions in source directory
[xenial] [10:05:24] Destroying container

review: Needs Fixing

[Devices Certification Bot (ce-certification-qa)]

The merge was fine but running tests failed.

[xenial] [01:46:04] starting container
[bionic] [01:46:06] starting container
Device project added to xenial-testing
Device project added to bionic-testing
[xenial] [01:46:14] provisioning container
[bionic] [01:46:18] provisioning container
[bionic] [01:46:35] Starting tests...
[bionic] Found a test script: ./requirements/container-tests-provider-checkbox
[xenial] [01:46:36] Starting tests...
[xenial] Found a test script: ./requirements/container-tests-provider-checkbox
[bionic] [01:47:37] container-tests-provider-checkbox: FAIL
[bionic] output: https://paste.ubuntu.com/p/fHgmWqgT8g/
[bionic] [01:47:40] Fixing file permissions in source directory
[bionic] [01:47:40] Destroying container
[xenial] [01:47:41] container-tests-provider-checkbox: FAIL
[xenial] output: https://paste.ubuntu.com/p/FNChFQSWpn/
[xenial] [01:47:44] Fixing file permissions in source directory
[xenial] [01:47:44] Destroying container

review: Needs Fixing

[Sylvain Pineau (sylvain-pineau)]

There's a validation problem, nothing related to lp:

error: units/keys/jobs.pxu:280-291: job 'keys/power-button', field 'description', manual jobs must have a description field, or a set of purpose, steps, and verification fields

review: Needs Fixing

[Devices Certification Bot (ce-certification-qa)]

I tried to merge it but there are some problems. Typically you want to merge or rebase and try again.

review: Needs Fixing

[Devices Certification Bot (ce-certification-qa)]

The merge was fine but running tests failed.

[bionic] [08:33:37] starting container
[xenial] [08:33:37] starting container
Device project added to bionic-testing
Device project added to xenial-testing
[xenial] [08:33:46] provisioning container
[bionic] [08:33:50] provisioning container
[xenial] [08:34:07] Starting tests...
[xenial] Found a test script: ./requirements/container-tests-provider-checkbox
[bionic] [08:34:09] Starting tests...
[bionic] Found a test script: ./requirements/container-tests-provider-checkbox
[xenial] [08:35:01] container-tests-provider-checkbox: FAIL
[xenial] output: https://paste.ubuntu.com/p/PTGBHG4T9r/
[xenial] [08:35:04] Fixing file permissions in source directory
[xenial] [08:35:04] Destroying container
[bionic] [08:35:15] container-tests-provider-checkbox: FAIL
[bionic] output: https://paste.ubuntu.com/p/HJ4CYDH5Tx/
[bionic] [08:35:18] Fixing file permissions in source directory
[bionic] [08:35:18] Destroying container

review: Needs Fixing

[Jonathan Cave (jocave)]

@Gabriel please fix this and set back to Needs Review if you want it to land still

[OEM Taipei Bot (oem-taipei-bot)]

Execute `curl -X POST http://10.102.135.31/api/v1/teams/self-contained/pipelines/plainbox-provider-checkbox/resources/merge-proposal-377348/check/webhook?webhook_token=merge-proposal-377348` within TW VPN to restart the test.
[autopkgtest]
$ cat plainbox-provider-checkbox-0.59.0-1-0af7fa5-in-linux-container-focal-summary.log
bootstrap-client-cert-desktop-20-04-automated FAIL stderr: unable to find nested part: com.canonical.certification::submission-cert-automated
https://oem-share.canonical.com/partners/lyoncore/share/artifacts/plainbox-provider-checkbox-0.59.0-1-0af7fa5-in-linux-container-focal

[Gabriel Zhi Chen (gabrielzchen)]

@Jonathan, Please skip the MR, The MR is out of date and it is no longer suitable for current testing. Thanks for the notice.

Unmerged commits

0af7fa5... by Gabriel Zhi Chen on 2020-01-13

Remove the Leading space before _purpose, _steps and _verificaion

f533e71... by Gabriel Zhi Chen on 2020-01-09

1. Add the power-button test case,2. Modify the steps of audio-playback-headphones and audio-alsa-record-playback-external cases,3.Remove the cases audio-speaker-headphone-plug-detection and audio-microphone-plug-detection.

de3595e... by PMR <pmr@pmr-lander> on 2020-01-08

Merge #377102 from ~bettyl/plainbox-provider-checkbox:remove-obex-tests

a3b1b3f... by PMR <pmr@pmr-lander> on 2020-01-07

Merge #377003 from ~jocave/plainbox-provider-checkbox:chameleon-edid-stress

72bc0d9... by Jonathan Cave on 2019-12-19

monitor: add EDID stress test using chameleon

Imports a set of EDID example data from chromiomos project and
loads these one at a time in to the Chamelon board.

diff --git a/units/dock/jobs.pxu b/units/dock/jobs.pxu
index 5368718..c457102 100644
--- a/units/dock/jobs.pxu
+++ b/units/dock/jobs.pxu
@@ -398,7 +398,8 @@ _purpose:
     (Skip this test if there is no headphone connector on the dock)
 _steps:
     1. Connect a pair of headphones to the dock
-    2. Click the Test button to play a sound to your audio device
+    2. Go to the Sound settings and make sure the correct Output is selected
+    3. Click the Test button to play a sound to your audio device
 _verification:
     Did you hear a sound through the headphones and did the sound play without any distortion, clicks or other strange noises from your headphones?
 
@@ -426,8 +427,9 @@ _purpose:
     (Skip this test if the dock does not have a microphone connector)
 _steps:
     1. Connect a microphone to the dock's microphone port
-    2. Click "Test", then speak into the external microphone
-    3. After a few seconds, your speech will be played back to you
+    2. Go to the Sound settings and make sure the correct Output is selected
+    3. Click "Test", then speak into the external microphone
+    4. After a few seconds, your speech will be played back to you
 _verification:
     Did you hear your speech played back?
 
diff --git a/units/dock/test-plan.pxu b/units/dock/test-plan.pxu
index 7d21dfa..4c906ac 100644
--- a/units/dock/test-plan.pxu
+++ b/units/dock/test-plan.pxu
@@ -45,9 +45,7 @@ include:
   dock/audio-alsa-info-collect
   dock/audio-alsa-info-attachment
   dock/audio-list-devices
-  dock/audio-speaker-headphone-plug-detection   certification-status=blocker
   dock/audio-playback-headphones        certification-status=blocker
-  dock/audio-microphone-plug-detection  certification-status=blocker
   dock/audio-alsa-record-playback-external      certification-status=blocker
   dock/audio-external-linein
   dock/audio-external-lineout
@@ -208,9 +206,7 @@ include:
   dock/monitor_type-c_vga                 certification-status=blocker
   dock/keys-video-out                     certification-status=blocker
   dock/monitor-dual-head                  certification-status=blocker
-  dock/audio-speaker-headphone-plug-detection   certification-status=blocker
   dock/audio-playback-headphones        certification-status=blocker
-  dock/audio-microphone-plug-detection  certification-status=blocker
   dock/audio-alsa-record-playback-external      certification-status=blocker
   dock/networking-gateway-ping          certification-status=blocker
   dock/networking-ntp                   certification-status=blocker
diff --git a/units/keys/jobs.pxu b/units/keys/jobs.pxu
index 4402b4c..4217db5 100644
--- a/units/keys/jobs.pxu
+++ b/units/keys/jobs.pxu
@@ -277,3 +277,15 @@ _description:
  VERIFICATION:
      Did the keyboard overhead light key or switch turns on and off the light?
 
+plugin: manual
+category_id: com.canonical.plainbox::keys
+id: keys/power-button
+estimated_duration: 30.0
+flags: also-after-suspend-manual
+_purpose:
+    This test will test the power button
+_steps:
+    1. press the power button.
+    2. press cancel to quit.
+_verification:
+    Did the power management prompt pop up when press power button?
diff --git a/units/keys/test-plan.pxu b/units/keys/test-plan.pxu
index 38386ef..87b7fbc 100644
--- a/units/keys/test-plan.pxu
+++ b/units/keys/test-plan.pxu
@@ -24,6 +24,7 @@ include:
  keys/wireless                                  certification-status=blocker
  keys/keyboard-backlight                        certification-status=blocker
  keys/microphone-mute                           certification-status=blocker
+ keys/power-button                              certification-status=blocker
 
 id: keys-cert-automated
 unit: test plan