Merge ~sylvain-pineau/plainbox-provider-certification-client:nested_parts_16.04 into plainbox-provider-certification-client:master
- Git
- lp:~sylvain-pineau/plainbox-provider-certification-client
- nested_parts_16.04
- Merge into master
Proposed by
Sylvain Pineau
| Status: | Merged |
|---|---|
| Approved by: | Sylvain Pineau |
| Approved revision: | a1cb0d162484e016620a6154801990a8bcb1a62b |
| Merged at revision: | 14d1cbb950c076a08921093fde7c2ea7f4922470 |
| Proposed branch: | ~sylvain-pineau/plainbox-provider-certification-client:nested_parts_16.04 |
| Merge into: | plainbox-provider-certification-client:master |
| Diff against target: |
527 lines (+54/-449) 2 files modified
units/client-cert-16-04.pxu (+49/-368) units/touchpad.pxu (+5/-81) |
| Related bugs: |
| Reviewer | Review Type | Date Requested | Status |
|---|---|---|---|
| Devices Certification Bot | Needs Fixing | ||
| Sylvain Pineau (community) | Approve | ||
|
Review via email:
|
|||
Commit message
Description of the change
Use nested parts defined in p-p-c to build the 16.04 certification client test plan.
This updated version includes the following additions matching what somerville project is using (all w/o a certification status):
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
+com.canonical.
-com.canonical.
-com.canonical.
To post a comment you must log in.
Revision history for this message
| Sylvain Pineau (sylvain-pineau) wrote : | # |
review:
Needs Resubmitting
Revision history for this message
| Sylvain Pineau (sylvain-pineau) wrote : | # |
Diff was reviewed by Jerry last week, LGTM.
review:
Approve
Revision history for this message
| Devices Certification Bot (ce-certification-qa) wrote : | # |
The merge was fine but running tests failed.
[trusty] creating pristine container
[trusty] Unable to create pristine container!
[trusty] stdout:
[trusty] NOTE: unable to execute tests, marked as failed
[trusty] Trying to destroy to reclaim possible resources
[xenial] creating pristine container
[xenial] Unable to create pristine container!
[xenial] stdout:
[xenial] NOTE: unable to execute tests, marked as failed
[xenial] Trying to destroy to reclaim possible resources
review:
Needs Fixing
Revision history for this message
| Devices Certification Bot (ce-certification-qa) wrote : | # |
The merge was fine but running tests failed.
[trusty] creating pristine container
[trusty] Unable to create pristine container!
[trusty] stdout:
[trusty] NOTE: unable to execute tests, marked as failed
[trusty] Trying to destroy to reclaim possible resources
[xenial] creating pristine container
[xenial] Unable to create pristine container!
[xenial] stdout:
[xenial] NOTE: unable to execute tests, marked as failed
[xenial] Trying to destroy to reclaim possible resources
review:
Needs Fixing
Preview Diff
[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
| 1 | diff --git a/units/client-cert-16-04.pxu b/units/client-cert-16-04.pxu | |||
| 2 | index e7fd3ae..f210ca3 100644 | |||
| 3 | --- a/units/client-cert-16-04.pxu | |||
| 4 | +++ b/units/client-cert-16-04.pxu | |||
| 5 | @@ -9,379 +9,60 @@ _description: | |||
| 6 | 9 | properly in your test environment. To avoid false failures, please use the | 9 | properly in your test environment. To avoid false failures, please use the |
| 7 | 10 | client-selftest test plan instead. | 10 | client-selftest test plan instead. |
| 8 | 11 | include: | 11 | include: |
| 234 | 12 | # Resource Jobs (Not used by templates jobs) | 12 | nested_part: |
| 235 | 13 | IEEE_80211 | 13 | submission-cert-full |
| 236 | 14 | block_device | 14 | audio-cert-full |
| 237 | 15 | cdimage | 15 | bluetooth-cert-full |
| 238 | 16 | cpuinfo | 16 | camera-cert-full |
| 239 | 17 | display | 17 | esata-cert-full |
| 240 | 18 | dmi | 18 | firewire-cert-full |
| 241 | 19 | dpkg | 19 | thunderbolt-cert-full |
| 242 | 20 | efi | 20 | monitor-integrated-gpu-cert-full |
| 243 | 21 | environment | 21 | graphics-integrated-gpu-cert-full |
| 244 | 22 | lsb | 22 | graphics-discrete-gpu-cert-full |
| 245 | 23 | meminfo | 23 | monitor-discrete-gpu-cert-full |
| 246 | 24 | mobilebroadband | 24 | input-cert-full |
| 247 | 25 | module | 25 | disk-cert-manual |
| 248 | 26 | optical_drive_.* certification-status=blocker | 26 | keys-cert-full |
| 249 | 27 | package | 27 | led-cert-full |
| 250 | 28 | rtc | 28 | mediacard-cert-full |
| 251 | 29 | sleep | 29 | mobilebroadband-cert-full |
| 252 | 30 | uname | 30 | networking-cert-full |
| 253 | 31 | usb | 31 | optical-cert-full |
| 254 | 32 | xinput | 32 | power-management-precheck-cert |
| 255 | 33 | # END Resource Jobs | 33 | touchpad-cert-full |
| 256 | 34 | audio/alsa_info_collect | 34 | touchscreen-cert-full |
| 257 | 35 | audio/alsa_info_attachment | 35 | usb-cert-full |
| 258 | 36 | audio/list_devices | 36 | usb3-cert-full |
| 259 | 37 | audio/speaker-headphone-plug-detection certification-status=blocker | 37 | usb-c-cert-full |
| 260 | 38 | audio/microphone-plug-detection certification-status=blocker | 38 | wireless-cert-full |
| 261 | 39 | audio/playback_headphones certification-status=blocker | 39 | before-suspend-reference-cert-full |
| 262 | 40 | audio/alsa_record_playback_external certification-status=blocker | 40 | # Test discrete card first, if present, since it's the one we will be using |
| 38 | 41 | audio/playback_auto certification-status=blocker | ||
| 39 | 42 | audio/alsa_record_playback_internal certification-status=blocker | ||
| 40 | 43 | # See Monitor / Graphic test section for hybrid-graphic monitor audio tests | ||
| 41 | 44 | bluetooth/detect-output certification-status=blocker | ||
| 42 | 45 | bluetooth/audio-a2dp certification-status=blocker | ||
| 43 | 46 | bluetooth/browse-files certification-status=blocker | ||
| 44 | 47 | bluetooth/file-transfer certification-status=blocker | ||
| 45 | 48 | bluetooth/HID | ||
| 46 | 49 | bluetooth4/HOGP-mouse certification-status=non-blocker | ||
| 47 | 50 | bluetooth4/HOGP-keyboard certification-status=non-blocker | ||
| 48 | 51 | camera/detect certification-status=blocker | ||
| 49 | 52 | camera/still certification-status=blocker | ||
| 50 | 53 | camera/display certification-status=blocker | ||
| 51 | 54 | camera/multiple-resolution-images certification-status=blocker | ||
| 52 | 55 | cpu/cstates certification-status=blocker | ||
| 53 | 56 | cpu/cstates_results.log | ||
| 54 | 57 | disk/detect certification-status=blocker | ||
| 55 | 58 | esata/insert certification-status=blocker | ||
| 56 | 59 | esata/storage-test certification-status=blocker | ||
| 57 | 60 | esata/remove certification-status=blocker | ||
| 58 | 61 | firewire/insert certification-status=blocker | ||
| 59 | 62 | firewire/storage-test certification-status=blocker | ||
| 60 | 63 | firewire/remove certification-status=blocker | ||
| 61 | 64 | thunderbolt/insert certification-status=blocker | ||
| 62 | 65 | thunderbolt/storage-test certification-status=blocker | ||
| 63 | 66 | thunderbolt/remove certification-status=blocker | ||
| 64 | 67 | thunderbolt3/insert certification-status=non-blocker | ||
| 65 | 68 | thunderbolt3/storage-test certification-status=non-blocker | ||
| 66 | 69 | thunderbolt3/remove certification-status=non-blocker | ||
| 67 | 70 | monitor/1_powersaving_.* certification-status=blocker | ||
| 68 | 71 | monitor/1_dim_brightness_.* certification-status=blocker | ||
| 69 | 72 | monitor/1_displayport_.* certification-status=blocker | ||
| 70 | 73 | monitor/1_type-c_displayport_.* certification-status=non-blocker | ||
| 71 | 74 | audio/1_playback_displayport_.* certification-status=blocker | ||
| 72 | 75 | audio/1_playback_type-c_displayport_.* certification-status=non-blocker | ||
| 73 | 76 | monitor/1_dvi_.* certification-status=blocker | ||
| 74 | 77 | monitor/1_hdmi_.* certification-status=blocker | ||
| 75 | 78 | audio/1_playback_hdmi_.* certification-status=blocker | ||
| 76 | 79 | monitor/1_thunderbolt_.* certification-status=blocker | ||
| 77 | 80 | monitor/1_thunderbolt3_.* certification-status=non-blocker | ||
| 78 | 81 | audio/1_playback_thunderbolt_.* certification-status=blocker | ||
| 79 | 82 | audio/1_playback_thunderbolt3_.* certification-status=non-blocker | ||
| 80 | 83 | thunderbolt/daisy-chain certification-status=blocker | ||
| 81 | 84 | thunderbolt3/daisy-chain certification-status=non-blocker | ||
| 82 | 85 | monitor/1_rca_.* certification-status=blocker | ||
| 83 | 86 | monitor/1_svideo_.* certification-status=blocker | ||
| 84 | 87 | monitor/1_vga_.* certification-status=blocker | ||
| 85 | 88 | monitor/1_multi-head_.* certification-status=blocker | ||
| 86 | 89 | # See Graphic Tests section for monitor test on second graphic card | ||
| 87 | 90 | graphics/xorg-version certification-status=blocker | ||
| 88 | 91 | graphics/xorg-failsafe certification-status=blocker | ||
| 89 | 92 | graphics/xorg-process certification-status=blocker | ||
| 90 | 93 | graphics/VESA_drivers_not_in_use certification-status=blocker | ||
| 91 | 94 | graphics/1_maximum_resolution_.* certification-status=blocker | ||
| 92 | 95 | graphics/1_glxgears_.* certification-status=blocker | ||
| 93 | 96 | graphics/1_driver_version_.* certification-status=blocker | ||
| 94 | 97 | graphics/1_compiz_check_.* certification-status=blocker | ||
| 95 | 98 | graphics/1_rotation_.* certification-status=blocker | ||
| 96 | 99 | graphics/1_video_.* certification-status=blocker | ||
| 97 | 100 | graphics/1_minimum_resolution_.* | ||
| 98 | 101 | graphics/1_cycle_resolution_.* certification-status=non-blocker | ||
| 99 | 102 | graphics/2_switch_card_.*_xenial certification-status=blocker | ||
| 100 | 103 | graphics/2_maximum_resolution_.* certification-status=blocker | ||
| 101 | 104 | graphics/2_valid_opengl_renderer_.* certification-status=blocker | ||
| 102 | 105 | graphics/2_glxgears_.* certification-status=blocker | ||
| 103 | 106 | graphics/2_driver_version_.* certification-status=blocker | ||
| 104 | 107 | graphics/2_compiz_check_.* certification-status=blocker | ||
| 105 | 108 | graphics/2_rotation_.* certification-status=blocker | ||
| 106 | 109 | graphics/2_video_.* certification-status=blocker | ||
| 107 | 110 | graphics/2_minimum_resolution_.* | ||
| 108 | 111 | graphics/2_cycle_resolution_.* certification-status=non-blocker | ||
| 109 | 112 | monitor/2_powersaving_.* certification-status=blocker | ||
| 110 | 113 | monitor/2_dim_brightness_.* certification-status=blocker | ||
| 111 | 114 | monitor/2_displayport_.* certification-status=blocker | ||
| 112 | 115 | monitor/2_type-c_displayport_.* certification-status=non-blocker | ||
| 113 | 116 | audio/2_playback_displayport_.* certification-status=blocker | ||
| 114 | 117 | audio/2_playback_type-c_displayport_.* certification-status=non-blocker | ||
| 115 | 118 | monitor/2_dvi_.* certification-status=blocker | ||
| 116 | 119 | monitor/2_hdmi_.* certification-status=blocker | ||
| 117 | 120 | audio/2_playback_hdmi_.* certification-status=blocker | ||
| 118 | 121 | monitor/2_thunderbolt_.* certification-status=blocker | ||
| 119 | 122 | monitor/2_thunderbolt3_.* certification-status=non-blocker | ||
| 120 | 123 | audio/2_playback_thunderbolt_.* certification-status=blocker | ||
| 121 | 124 | audio/2_playback_thunderbolt3_.* certification-status=non-blocker | ||
| 122 | 125 | monitor/2_rca_.* certification-status=blocker | ||
| 123 | 126 | monitor/2_svideo_.* certification-status=blocker | ||
| 124 | 127 | monitor/2_vga_.* certification-status=blocker | ||
| 125 | 128 | monitor/2_multi-head_.* certification-status=blocker | ||
| 126 | 129 | input/accelerometer certification-status=non-blocker | ||
| 127 | 130 | input/pointing_.* certification-status=blocker | ||
| 128 | 131 | input/clicking_.* certification-status=blocker | ||
| 129 | 132 | input/keyboard certification-status=blocker | ||
| 130 | 133 | disk/hdd-parking certification-status=non-blocker | ||
| 131 | 134 | keys/lock-screen certification-status=blocker | ||
| 132 | 135 | keys/super certification-status=blocker | ||
| 133 | 136 | keys/battery-info certification-status=blocker | ||
| 134 | 137 | keys/brightness certification-status=blocker | ||
| 135 | 138 | keys/media-control certification-status=blocker | ||
| 136 | 139 | keys/mute certification-status=blocker | ||
| 137 | 140 | keys/volume certification-status=blocker | ||
| 138 | 141 | keys/video-out certification-status=blocker | ||
| 139 | 142 | keys/wireless certification-status=blocker | ||
| 140 | 143 | keys/keyboard-backlight certification-status=blocker | ||
| 141 | 144 | keys/microphone-mute certification-status=blocker | ||
| 142 | 145 | led/bluetooth certification-status=non-blocker | ||
| 143 | 146 | led/camera certification-status=blocker | ||
| 144 | 147 | led/caps-lock certification-status=blocker | ||
| 145 | 148 | led/mute certification-status=blocker | ||
| 146 | 149 | led/microphone-mute certification-status=non-blocker | ||
| 147 | 150 | led/numeric-keypad certification-status=blocker | ||
| 148 | 151 | led/power certification-status=blocker | ||
| 149 | 152 | # NOTE: led/power-blink-suspend and led/suspend are used later in the | ||
| 150 | 153 | # testplan just after a number of suspend tests. | ||
| 151 | 154 | # led/power-blink-suspend | ||
| 152 | 155 | # led/suspend | ||
| 153 | 156 | # NOTE: led/wireless is redundant given that we have led/wlan and | ||
| 154 | 157 | # led/bluetooth already | ||
| 155 | 158 | # led/wireless | ||
| 156 | 159 | led/wlan certification-status=non-blocker | ||
| 157 | 160 | led/wlan-disabled | ||
| 158 | 161 | mediacard/sd-insert certification-status=blocker | ||
| 159 | 162 | mediacard/sd-storage certification-status=blocker | ||
| 160 | 163 | mediacard/sd-remove certification-status=blocker | ||
| 161 | 164 | mediacard/sdhc-insert certification-status=blocker | ||
| 162 | 165 | mediacard/sdhc-storage certification-status=blocker | ||
| 163 | 166 | mediacard/sdhc-remove certification-status=blocker | ||
| 164 | 167 | miscellanea/oops certification-status=blocker | ||
| 165 | 168 | miscellanea/oops_results.log | ||
| 166 | 169 | mobilebroadband/gsm_connection certification-status=non-blocker | ||
| 167 | 170 | mobilebroadband/cdma_connection certification-status=non-blocker | ||
| 168 | 171 | ethernet/detect certification-status=blocker | ||
| 169 | 172 | networking/gateway_ping certification-status=blocker | ||
| 170 | 173 | networking/info.* certification-status=blocker | ||
| 171 | 174 | networking/ntp certification-status=blocker | ||
| 172 | 175 | optical/detect certification-status=blocker | ||
| 173 | 176 | optical/read_.* certification-status=blocker | ||
| 174 | 177 | optical/cdrom-write_.* certification-status=blocker | ||
| 175 | 178 | optical/dvd-write_.* certification-status=blocker | ||
| 176 | 179 | optical/bluray-read_.* certification-status=blocker | ||
| 177 | 180 | optical/bluray-write_.* certification-status=blocker | ||
| 178 | 181 | # Laptop lid tests relocated to the S3-adv section as it will trigger S3 as well | ||
| 179 | 182 | power-management/rtc certification-status=blocker | ||
| 180 | 183 | power-management/tickless_idle certification-status=blocker | ||
| 181 | 184 | power-management/fwts_wakealarm certification-status=blocker | ||
| 182 | 185 | power-management/fwts_wakealarm-log-attach | ||
| 183 | 186 | touchpad/detected-as-mouse certification-status=blocker | ||
| 184 | 187 | touchpad/palm-rejection certification-status=non-blocker | ||
| 185 | 188 | touchpad/continuous-move certification-status=blocker | ||
| 186 | 189 | touchpad/horizontal certification-status=blocker | ||
| 187 | 190 | touchpad/vertical certification-status=blocker | ||
| 188 | 191 | touchpad/singletouch-automated certification-status=blocker | ||
| 189 | 192 | touchpad/singletouch-selection certification-status=blocker | ||
| 190 | 193 | touchpad/drag-and-drop certification-status=blocker | ||
| 191 | 194 | touchpad/multitouch-automated certification-status=blocker | ||
| 192 | 195 | touchpad/multitouch-manual certification-status=blocker | ||
| 193 | 196 | touchpad/multitouch-rightclick certification-status=blocker | ||
| 194 | 197 | touchpad/multitouch-horizontal certification-status=blocker | ||
| 195 | 198 | touchpad/multitouch-vertical certification-status=blocker | ||
| 196 | 199 | touchpad/multitouch-dash certification-status=non-blocker | ||
| 197 | 200 | touchscreen/drag-n-drop certification-status=blocker | ||
| 198 | 201 | touchscreen/multitouch-zoom certification-status=blocker | ||
| 199 | 202 | touchscreen/multitouch-rotate | ||
| 200 | 203 | touchscreen/3-touch-tap certification-status=blocker | ||
| 201 | 204 | touchscreen/4-touch-tap certification-status=blocker | ||
| 202 | 205 | touchscreen/multitouch-dash certification-status=non-blocker | ||
| 203 | 206 | usb/detect certification-status=blocker | ||
| 204 | 207 | usb/HID certification-status=blocker | ||
| 205 | 208 | usb/insert certification-status=blocker | ||
| 206 | 209 | usb/storage-automated certification-status=blocker | ||
| 207 | 210 | usb/remove certification-status=blocker | ||
| 208 | 211 | usb3/insert certification-status=blocker | ||
| 209 | 212 | usb3/storage-automated certification-status=blocker | ||
| 210 | 213 | usb3/remove certification-status=blocker | ||
| 211 | 214 | usb-c/c-to-a-adapter/hid certification-status=non-blocker | ||
| 212 | 215 | usb-c/c-to-a-adapter/insert certification-status=non-blocker | ||
| 213 | 216 | usb-c/c-to-a-adapter/storage-automated certification-status=non-blocker | ||
| 214 | 217 | usb-c/c-to-a-adapter/remove certification-status=non-blocker | ||
| 215 | 218 | usb-c/hid certification-status=non-blocker | ||
| 216 | 219 | usb-c/insert certification-status=non-blocker | ||
| 217 | 220 | usb-c/storage-automated certification-status=non-blocker | ||
| 218 | 221 | usb-c/remove certification-status=non-blocker | ||
| 219 | 222 | wireless/wireless_scanning certification-status=blocker | ||
| 220 | 223 | wireless/wireless_connection_wpa_bg certification-status=blocker | ||
| 221 | 224 | wireless/wireless_connection_open_bg certification-status=blocker | ||
| 222 | 225 | wireless/wireless_connection_wpa_n certification-status=blocker | ||
| 223 | 226 | wireless/wireless_connection_open_n certification-status=blocker | ||
| 224 | 227 | wireless/wireless_connection_wpa_ac certification-status=blocker | ||
| 225 | 228 | wireless/wireless_connection_open_ac certification-status=blocker | ||
| 226 | 229 | suspend/network_before_suspend certification-status=blocker | ||
| 227 | 230 | suspend/audio_before_suspend certification-status=blocker | ||
| 228 | 231 | suspend/cpu_before_suspend certification-status=blocker | ||
| 229 | 232 | suspend/memory_before_suspend certification-status=blocker | ||
| 230 | 233 | suspend/bluetooth_obex_send_before_suspend certification-status=blocker | ||
| 231 | 234 | suspend/bluetooth_obex_browse_before_suspend certification-status=blocker | ||
| 232 | 235 | suspend/bluetooth_obex_get_before_suspend certification-status=blocker | ||
| 233 | 236 | # Test card 2 first, if present, since it's the one we will be using | ||
| 263 | 237 | # after coming back from suspend if the system has hybrid graphics. | 41 | # after coming back from suspend if the system has hybrid graphics. |
| 338 | 238 | suspend/2_resolution_before_suspend_.*_xenial certification-status=blocker | 42 | after-suspend-graphics-discrete-gpu-cert-full |
| 339 | 239 | suspend/2_suspend_after_switch_to_card_.*_xenial certification-status=blocker | 43 | after-suspend-graphics-integrated-gpu-cert-full |
| 340 | 240 | suspend/2_suspend-time-check_.*_xenial certification-status=non-blocker | 44 | suspend-key-led-oops-check-cert |
| 341 | 241 | suspend/2_suspend-single-log-attach_.*_xenial | 45 | after-suspend-reference-cert-full |
| 342 | 242 | suspend/2_compiz_check_after_suspend_.*_xenial certification-status=blocker | 46 | after-suspend-audio-cert-full |
| 343 | 243 | suspend/2_driver_version_after_suspend_.*_xenial certification-status=blocker | 47 | after-suspend-camera-cert-full |
| 344 | 244 | suspend/2_resolution_after_suspend_.*_xenial certification-status=blocker | 48 | after-suspend-input-cert-full |
| 345 | 245 | suspend/2_display_after_suspend_.*_xenial certification-status=blocker | 49 | after-suspend-led-cert-full |
| 346 | 246 | suspend/2_glxgears_after_suspend_.*_xenial certification-status=blocker | 50 | after-suspend-mediacard-cert-full |
| 347 | 247 | suspend/2_video_after_suspend_.*_xenial certification-status=blocker | 51 | after-suspend-touchpad-cert-full |
| 348 | 248 | suspend/2_cycle_resolutions_after_suspend_.*_xenial certification-status=non-blocker | 52 | after-suspend-usb-cert-full |
| 349 | 249 | suspend/2_xrandr_screens_after_suspend_.*.tar.gz_xenial | 53 | after-suspend-usb3-cert-full |
| 350 | 250 | power-management/2_hibernate_advanced_.* certification-status=non-blocker | 54 | after-suspend-wireless-cert-full |
| 277 | 251 | power-management/2_hibernate-single-log-attach_.* | ||
| 278 | 252 | # Now we ask to switch to the first graphics card. This requires a restart | ||
| 279 | 253 | # of checkbox. | ||
| 280 | 254 | graphics/1_switch_card_.*_xenial certification-status=blocker | ||
| 281 | 255 | suspend/1_resolution_before_suspend_.*_xenial certification-status=blocker | ||
| 282 | 256 | suspend/suspend_advanced certification-status=blocker | ||
| 283 | 257 | suspend/1_suspend-time-check_.*_xenial certification-status=non-blocker | ||
| 284 | 258 | suspend/1_suspend-single-log-attach_.*_xenial | ||
| 285 | 259 | power-management/lid certification-status=blocker | ||
| 286 | 260 | power-management/lid_close certification-status=blocker | ||
| 287 | 261 | power-management/lid_open certification-status=blocker | ||
| 288 | 262 | suspend/1_compiz_check_after_suspend_.*_xenial certification-status=blocker | ||
| 289 | 263 | suspend/1_driver_version_after_suspend_.*_xenial certification-status=blocker | ||
| 290 | 264 | suspend/1_resolution_after_suspend_.*_xenial certification-status=blocker | ||
| 291 | 265 | suspend/1_display_after_suspend_.*_xenial certification-status=blocker | ||
| 292 | 266 | suspend/1_glxgears_after_suspend_.*_xenial certification-status=blocker | ||
| 293 | 267 | suspend/1_video_after_suspend_.*_xenial certification-status=blocker | ||
| 294 | 268 | suspend/1_cycle_resolutions_after_suspend_.*_xenial certification-status=non-blocker | ||
| 295 | 269 | suspend/1_xrandr_screens_after_suspend.tar.gz_xenial | ||
| 296 | 270 | keys/sleep certification-status=blocker | ||
| 297 | 271 | led/power-blink-suspend certification-status=blocker | ||
| 298 | 272 | led/suspend certification-status=blocker | ||
| 299 | 273 | suspend/network_after_suspend certification-status=blocker | ||
| 300 | 274 | suspend/audio_after_suspend certification-status=blocker | ||
| 301 | 275 | suspend/cpu_after_suspend certification-status=blocker | ||
| 302 | 276 | suspend/memory_after_suspend certification-status=blocker | ||
| 303 | 277 | suspend/bluetooth_detect_after_suspend certification-status=blocker | ||
| 304 | 278 | suspend/bluetooth_obex_send_after_suspend certification-status=blocker | ||
| 305 | 279 | suspend/bluetooth_obex_browse_after_suspend certification-status=blocker | ||
| 306 | 280 | suspend/bluetooth_obex_get_after_suspend certification-status=blocker | ||
| 307 | 281 | suspend/speaker-headphone-plug-detection-after-suspend certification-status=blocker | ||
| 308 | 282 | suspend/microphone-plug-detection-after-suspend certification-status=blocker | ||
| 309 | 283 | suspend/playback_headphones-after-suspend certification-status=blocker | ||
| 310 | 284 | suspend/alsa_record_playback_external-after-suspend certification-status=blocker | ||
| 311 | 285 | camera/display_after_suspend certification-status=blocker | ||
| 312 | 286 | camera/still_after_suspend certification-status=blocker | ||
| 313 | 287 | suspend/pointing-after-suspend_.* certification-status=blocker | ||
| 314 | 288 | suspend/clicking-after-suspend_.* certification-status=blocker | ||
| 315 | 289 | suspend/sd-insert-after-suspend certification-status=blocker | ||
| 316 | 290 | suspend/sd-storage-after-suspend certification-status=blocker | ||
| 317 | 291 | suspend/sd-remove-after-suspend certification-status=blocker | ||
| 318 | 292 | suspend/sdhc-insert-after-suspend certification-status=blocker | ||
| 319 | 293 | suspend/sdhc-storage-after-suspend certification-status=blocker | ||
| 320 | 294 | suspend/sdhc-remove-after-suspend certification-status=blocker | ||
| 321 | 295 | suspend/usb_insert_after_suspend certification-status=blocker | ||
| 322 | 296 | suspend/usb_storage_automated_after_suspend certification-status=blocker | ||
| 323 | 297 | suspend/usb_remove_after_suspend certification-status=blocker | ||
| 324 | 298 | suspend/usb3_insert_after_suspend certification-status=blocker | ||
| 325 | 299 | suspend/usb3_storage_automated_after_suspend certification-status=blocker | ||
| 326 | 300 | suspend/usb3_remove_after_suspend certification-status=blocker | ||
| 327 | 301 | suspend/oops_after_suspend certification-status=blocker | ||
| 328 | 302 | suspend/oops_results_after_suspend.log | ||
| 329 | 303 | suspend/wireless_connection_after_suspend_wpa_bg certification-status=blocker | ||
| 330 | 304 | suspend/wireless_connection_after_suspend_open_bg certification-status=blocker | ||
| 331 | 305 | suspend/wireless_connection_after_suspend_wpa_n certification-status=blocker | ||
| 332 | 306 | suspend/wireless_connection_after_suspend_open_n certification-status=blocker | ||
| 333 | 307 | suspend/wireless_connection_after_suspend_wpa_ac certification-status=blocker | ||
| 334 | 308 | suspend/wireless_connection_after_suspend_open_ac certification-status=blocker | ||
| 335 | 309 | power-management/hibernate_advanced certification-status=non-blocker | ||
| 336 | 310 | power-management/hibernate-single-log-attach | ||
| 337 | 311 | keys/hibernate certification-status=blocker | ||
| 351 | 312 | # The following tests should run BEFORE the automated tests. The reboot and | 55 | # The following tests should run BEFORE the automated tests. The reboot and |
| 352 | 313 | # power off tests will also give us a clean system to start the stress run | 56 | # power off tests will also give us a clean system to start the stress run |
| 353 | 314 | # with. | 57 | # with. |
| 358 | 315 | power-management/poweroff certification-status=blocker | 58 | power-management-reboot-poweroff-cert |
| 355 | 316 | power-management/poweroff-log-attach | ||
| 356 | 317 | power-management/reboot certification-status=blocker | ||
| 357 | 318 | power-management/reboot-log-attach | ||
| 359 | 319 | # Automated Tests | 59 | # Automated Tests |
| 360 | 320 | # The following tests are purely automated and/or lenghty stress tests. | 60 | # The following tests are purely automated and/or lenghty stress tests. |
| 361 | 321 | # They have been moved to the end of the test run to improve the testing | 61 | # They have been moved to the end of the test run to improve the testing |
| 362 | 322 | # process. | 62 | # process. |
| 428 | 323 | firmware/fwts_desktop_diagnosis | 63 | misc-client-cert-full |
| 429 | 324 | firmware/fwts_desktop_diagnosis_hwe | 64 | cpu-cert-full |
| 430 | 325 | firmware/fwts_desktop_diagnosis_results.log.gz | 65 | disk-cert-automated |
| 431 | 326 | firmware/fwts_desktop_diagnosis_results_hwe.log.gz | 66 | stress-cert-full |
| 432 | 327 | firmware/fwts_wakealarm.* certification-status=blocker | 67 | tpm2.0 |
| 433 | 328 | firmware/fwts_uefirtvariable.* certification-status=blocker | 68 | info-attachment-cert-full |
| 369 | 329 | firmware/no_ACPI_REV_interface | ||
| 370 | 330 | miscellanea/dmitest_client | ||
| 371 | 331 | benchmarks/disk/hdparm-read_.* | ||
| 372 | 332 | benchmarks/disk/hdparm-cache-read_.* | ||
| 373 | 333 | cpu/scaling_test certification-status=blocker | ||
| 374 | 334 | cpu/scaling_test-log-attach | ||
| 375 | 335 | cpu/maxfreq_test certification-status=blocker | ||
| 376 | 336 | cpu/maxfreq_test-log-attach | ||
| 377 | 337 | cpu/offlining_test certification-status=blocker | ||
| 378 | 338 | cpu/topology certification-status=blocker | ||
| 379 | 339 | cpu/clocktest | ||
| 380 | 340 | disk/stats_.* | ||
| 381 | 341 | disk/read_performance_.* certification-status=blocker | ||
| 382 | 342 | disk/storage_device_.* certification-status=blocker | ||
| 383 | 343 | memory/info certification-status=blocker | ||
| 384 | 344 | memory/check certification-status=blocker | ||
| 385 | 345 | power-management/suspend_30_cycles certification-status=blocker | ||
| 386 | 346 | power-management/suspend-30-cycle-log-attach | ||
| 387 | 347 | power-management/suspend-30-cycles-time-check certification-status=non-blocker | ||
| 388 | 348 | power-management/hibernate_30_cycles certification-status=non-blocker | ||
| 389 | 349 | power-management/hibernate-30-cycle-log-attach | ||
| 390 | 350 | stress/cpu_stress_test certification-status=blocker | ||
| 391 | 351 | tpm2.0/.* certification-status=non-blocker | ||
| 392 | 352 | #Info attachment jobs | ||
| 393 | 353 | codecs_attachment | ||
| 394 | 354 | cpuinfo_attachment | ||
| 395 | 355 | dmesg_attachment | ||
| 396 | 356 | dmi_attachment | ||
| 397 | 357 | dmidecode_attachment | ||
| 398 | 358 | efi_attachment | ||
| 399 | 359 | lspci_attachment | ||
| 400 | 360 | lspci_standard_config_attachment | ||
| 401 | 361 | lsusb_attachment | ||
| 402 | 362 | kernel_cmdline_attachment | ||
| 403 | 363 | meminfo_attachment | ||
| 404 | 364 | modinfo_attachment | ||
| 405 | 365 | modprobe_attachment | ||
| 406 | 366 | modules_attachment | ||
| 407 | 367 | sysctl_attachment | ||
| 408 | 368 | sysfs_attachment | ||
| 409 | 369 | udev_attachment | ||
| 410 | 370 | recovery_info_attachment | ||
| 411 | 371 | dell_bto_xml_attachment | ||
| 412 | 372 | lsmod_attachment | ||
| 413 | 373 | dkms_info_attachment | ||
| 414 | 374 | acpi_sleep_attachment | ||
| 415 | 375 | info/hdparm_.*.txt | ||
| 416 | 376 | installer_debug.gz | ||
| 417 | 377 | info/touchpad_driver | ||
| 418 | 378 | info/disk_partitions | ||
| 419 | 379 | bootstrap_include: | ||
| 420 | 380 | device | ||
| 421 | 381 | fwts | ||
| 422 | 382 | graphics_card | ||
| 423 | 383 | mandatory_include: | ||
| 424 | 384 | com.canonical.plainbox::collect-manifest | ||
| 425 | 385 | miscellanea/device_check | ||
| 426 | 386 | # Meta-job to include required resources, don't remove. | ||
| 427 | 387 | miscellanea/submission-resources | ||
| 434 | diff --git a/units/touchpad.pxu b/units/touchpad.pxu | |||
| 435 | index a3f362f..6cf44bb 100644 | |||
| 436 | --- a/units/touchpad.pxu | |||
| 437 | +++ b/units/touchpad.pxu | |||
| 438 | @@ -5,84 +5,8 @@ _description: | |||
| 439 | 5 | This test plan is used for customers and independent hardware vendors (IHV) | 5 | This test plan is used for customers and independent hardware vendors (IHV) |
| 440 | 6 | to test and verify the behavior of touchpads on tested devices. | 6 | to test and verify the behavior of touchpads on tested devices. |
| 441 | 7 | include: | 7 | include: |
| 523 | 8 | # Resource Jobs (Not used by templates jobs) | 8 | nested_part: |
| 524 | 9 | block_device | 9 | submission-cert-full |
| 525 | 10 | cdimage | 10 | touchpad-cert-full |
| 526 | 11 | cpuinfo | 11 | after-suspend-touchpad-cert-full |
| 527 | 12 | dmi | 12 | info-attachment-cert-full |
| 447 | 13 | dpkg | ||
| 448 | 14 | efi | ||
| 449 | 15 | environment | ||
| 450 | 16 | lsb | ||
| 451 | 17 | meminfo | ||
| 452 | 18 | module | ||
| 453 | 19 | package | ||
| 454 | 20 | rtc | ||
| 455 | 21 | sleep | ||
| 456 | 22 | uname | ||
| 457 | 23 | usb | ||
| 458 | 24 | xinput | ||
| 459 | 25 | # END Resource Jobs | ||
| 460 | 26 | touchpad/basic certification-status=blocker | ||
| 461 | 27 | touchpad/detected-as-mouse certification-status=blocker | ||
| 462 | 28 | touchpad/palm-rejection certification-status=non-blocker | ||
| 463 | 29 | touchpad/continuous-move certification-status=blocker | ||
| 464 | 30 | touchpad/horizontal certification-status=blocker | ||
| 465 | 31 | touchpad/vertical certification-status=blocker | ||
| 466 | 32 | touchpad/singletouch-automated certification-status=blocker | ||
| 467 | 33 | touchpad/singletouch-selection certification-status=blocker | ||
| 468 | 34 | touchpad/drag-and-drop certification-status=blocker | ||
| 469 | 35 | touchpad/multitouch-automated certification-status=blocker | ||
| 470 | 36 | touchpad/multitouch-manual certification-status=blocker | ||
| 471 | 37 | touchpad/multitouch-rightclick certification-status=blocker | ||
| 472 | 38 | touchpad/multitouch-horizontal certification-status=blocker | ||
| 473 | 39 | touchpad/multitouch-vertical certification-status=blocker | ||
| 474 | 40 | touchpad/multitouch-dash certification-status=non-blocker | ||
| 475 | 41 | # Touchpad tests after suspend | ||
| 476 | 42 | touchpad/basic-after-suspend certification-status=blocker | ||
| 477 | 43 | touchpad/detected-as-mouse-after-suspend certification-status=blocker | ||
| 478 | 44 | touchpad/palm-rejection-after-suspend certification-status=non-blocker | ||
| 479 | 45 | touchpad/continuous-move-after-suspend certification-status=blocker | ||
| 480 | 46 | touchpad/horizontal-after-suspend certification-status=blocker | ||
| 481 | 47 | touchpad/vertical-after-suspend certification-status=blocker | ||
| 482 | 48 | touchpad/singletouch-automated-after-suspend certification-status=blocker | ||
| 483 | 49 | touchpad/singletouch-selection-after-suspend certification-status=blocker | ||
| 484 | 50 | touchpad/drag-and-drop-after-suspend certification-status=blocker | ||
| 485 | 51 | touchpad/multitouch-automated-after-suspend certification-status=blocker | ||
| 486 | 52 | touchpad/multitouch-manual-after-suspend certification-status=blocker | ||
| 487 | 53 | touchpad/multitouch-rightclick-after-suspend certification-status=blocker | ||
| 488 | 54 | touchpad/multitouch-horizontal-after-suspend certification-status=blocker | ||
| 489 | 55 | touchpad/multitouch-vertical-after-suspend certification-status=blocker | ||
| 490 | 56 | touchpad/multitouch-dash-after-suspend certification-status=non-blocker | ||
| 491 | 57 | #Info attachment jobs | ||
| 492 | 58 | codecs_attachment | ||
| 493 | 59 | cpuinfo_attachment | ||
| 494 | 60 | dmesg_attachment | ||
| 495 | 61 | dmi_attachment | ||
| 496 | 62 | dmidecode_attachment | ||
| 497 | 63 | efi_attachment | ||
| 498 | 64 | lspci_attachment | ||
| 499 | 65 | lspci_standard_config_attachment | ||
| 500 | 66 | lsusb_attachment | ||
| 501 | 67 | kernel_cmdline_attachment | ||
| 502 | 68 | meminfo_attachment | ||
| 503 | 69 | modinfo_attachment | ||
| 504 | 70 | modprobe_attachment | ||
| 505 | 71 | modules_attachment | ||
| 506 | 72 | sysctl_attachment | ||
| 507 | 73 | sysfs_attachment | ||
| 508 | 74 | udev_attachment | ||
| 509 | 75 | recovery_info_attachment | ||
| 510 | 76 | dell_bto_xml_attachment | ||
| 511 | 77 | lsmod_attachment | ||
| 512 | 78 | dkms_info_attachment | ||
| 513 | 79 | acpi_sleep_attachment | ||
| 514 | 80 | info/hdparm_.*.txt | ||
| 515 | 81 | installer_debug.gz | ||
| 516 | 82 | info/touchpad_driver | ||
| 517 | 83 | info/disk_partitions | ||
| 518 | 84 | bootstrap_include: | ||
| 519 | 85 | device | ||
| 520 | 86 | mandatory_include: | ||
| 521 | 87 | # Meta-job to include required resources, don't remove. | ||
| 522 | 88 | miscellanea/submission-resources | ||
Cleaned history (thanks Pierre) + after suspend touchpad tests (from https:/