Merge lp:~pieq/checkbox/1624968-updated-docking-tests into lp:checkbox
- 1624968-updated-docking-tests
- Merge into trunk
Status: | Merged | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Approved by: | Pierre Equoy | ||||||||||||
Approved revision: | 4488 | ||||||||||||
Merged at revision: | 4502 | ||||||||||||
Proposed branch: | lp:~pieq/checkbox/1624968-updated-docking-tests | ||||||||||||
Merge into: | lp:checkbox | ||||||||||||
Diff against target: |
1500 lines (+959/-50) 1 file modified
providers/plainbox-provider-checkbox/units/dock.pxu (+959/-50) |
||||||||||||
To merge this branch: | bzr merge lp:~pieq/checkbox/1624968-updated-docking-tests | ||||||||||||
Related bugs: |
|
Reviewer | Review Type | Date Requested | Status |
---|---|---|---|
Pierre Equoy | Approve | ||
Review via email: mp+306054@code.launchpad.net |
Commit message
Description of the change
Updated docking tests.
This MR is based on Jerry's MR [1] with my inline comments taken into account.
1. add new test case dock/cold-plug
2. change depency from dock/docking to dock/cold-plug
3. modify dock/monitor-
4. rename dock/monitor-
5. add new test case dock/monitor-
6. change dependancy of after suspend test cases from dock/suspend-
7. add manual power button test case before and after suspend
8. add category ids
9. add type-c test cases (including storage and dispaly)
10.add mac address passthrougt test case
11.add hot-plug test suite
12.modify dock/suspend-
13.rename dock/audio-
14.rename dock/record-
[1] https:/
Sylvain Pineau (sylvain-pineau) wrote : | # |
There are additional revisions which have not been approved in review. Please seek review and approval of these new revisions.
Preview Diff
1 | === modified file 'providers/plainbox-provider-checkbox/units/dock.pxu' |
2 | --- providers/plainbox-provider-checkbox/units/dock.pxu 2015-05-13 07:33:44 +0000 |
3 | +++ providers/plainbox-provider-checkbox/units/dock.pxu 2016-09-19 03:13:16 +0000 |
4 | @@ -1,4 +1,37 @@ |
5 | +unit: category |
6 | +id: dock |
7 | +_name: Docking station tests |
8 | + |
9 | +unit: category |
10 | +id: dock-display |
11 | +_name: Docking station display tests |
12 | + |
13 | +unit: category |
14 | +id: dock-audio |
15 | +_name: Docking station audio tests |
16 | + |
17 | +unit: category |
18 | +id: dock-network |
19 | +_name: Docking station network tests |
20 | + |
21 | +unit: category |
22 | +id: dock-usb |
23 | +_name: Docking station usb tests |
24 | + |
25 | +unit: category |
26 | +id: dock-hotplug |
27 | +_name: Docking station hotplug tests |
28 | + |
29 | +unit: category |
30 | +id: suspend-undock-resume |
31 | +_name: Docking station functional tests after suspend, undocked, resume. |
32 | + |
33 | +unit: category |
34 | +id: suspend-dock-resume |
35 | +_name: Docking station functional tests after suspend, undocked, docked, resume. |
36 | + |
37 | id: dock/docking |
38 | +category_id: dock |
39 | plugin: manual |
40 | estimated_duration: 30.00 |
41 | _summary: Docking test |
42 | @@ -9,8 +42,37 @@ |
43 | _verification: |
44 | Is the device working as expected after being docked? |
45 | |
46 | +id: dock/cold-plug |
47 | +category_id: dock |
48 | +plugin: manual |
49 | +estimated_duration: 30.00 |
50 | +_summary: Docking test (cold plug) |
51 | +_purpose: |
52 | + To ensure docking station is plugged before system boot up. |
53 | +_steps: |
54 | + 1. shut down system. |
55 | + 2. plug in docking station. |
56 | + 3. boot up system. |
57 | +_verification: |
58 | + Did the system boot up with docking station plugged in? |
59 | + |
60 | +id: dock/power-button |
61 | +category_id: dock |
62 | +depends: dock/cold-plug |
63 | +plugin: manual |
64 | +estimated_duration: 30.00 |
65 | +_summary: Docking test |
66 | +_purpose: |
67 | + This test will test the power button on docking station |
68 | +_steps: |
69 | + Skip this test if your docking station has no power button. |
70 | + 1. press the power button on docking station. |
71 | +_verification: |
72 | + Did the power management prompt pop up? |
73 | + |
74 | id: dock/monitor-displayport |
75 | -depends: dock/docking |
76 | +category_id: dock-display |
77 | +depends: dock/cold-plug |
78 | estimated_duration: 120.0 |
79 | _summary: DisplayPort test on the dock |
80 | plugin: manual |
81 | @@ -24,7 +86,8 @@ |
82 | Was the desktop displayed correctly on both screens? |
83 | |
84 | id: dock/monitor-dvi |
85 | -depends: dock/docking |
86 | +category_id: dock-display |
87 | +depends: dock/cold-plug |
88 | estimated_duration: 120.0 |
89 | _summary: DVI port test on the dock |
90 | plugin: manual |
91 | @@ -38,7 +101,8 @@ |
92 | Was the desktop displayed correctly on both screens? |
93 | |
94 | id: dock/monitor-hdmi |
95 | -depends: dock/docking |
96 | +category_id: dock-display |
97 | +depends: dock/cold-plug |
98 | estimated_duration: 120.0 |
99 | _summary: HDMI port test on the dock |
100 | plugin: manual |
101 | @@ -52,7 +116,8 @@ |
102 | Was the desktop displayed correctly on both screens? |
103 | |
104 | id: dock/monitor-vga |
105 | -depends: dock/docking |
106 | +category_id: dock-display |
107 | +depends: dock/cold-plug |
108 | estimated_duration: 120.0 |
109 | _summary: VGA port test on the dock |
110 | plugin: manual |
111 | @@ -65,15 +130,70 @@ |
112 | _verification: |
113 | Was the desktop displayed correctly on both screens? |
114 | |
115 | -id: dock/monitor-multi-head |
116 | -depends: dock/docking |
117 | +id: dock/monitor_type-c_displayport |
118 | +category_id: dock-display |
119 | +depends: dock/cold-plug |
120 | +estimated_duration: 120 |
121 | +plugin: manual |
122 | +_summary: Display connected via DisplayPort using an USB Type-C port |
123 | +_purpose: |
124 | + This test will check the connection of a screen using a "USB Type-C to DisplayPort" adapter. |
125 | +_steps: |
126 | + Skip this test if the dock does not have a USB Type-C port. |
127 | + 1. Connect a display (if not already connected) to the USB Type-C port on |
128 | + your system using a "USB Type-C to DisplayPort" adapter |
129 | + 2. Switch display modes between in your Display Settings, check if it can be |
130 | + set to mirrored, extended, displayed on external or onboard only |
131 | +_verification: |
132 | + Was the desktop displayed correctly on the screen connected |
133 | + using a "USB Type-C to DisplayPort" adapter in every mode? |
134 | + |
135 | +id: dock/monitor_type-c_hdmi |
136 | +category_id: dock-display |
137 | +depends: dock/cold-plug |
138 | +estimated_duration: 120 |
139 | +plugin: manual |
140 | +_summary: Display connected via HDMI using an USB Type-C port |
141 | +_purpose: |
142 | + This test will check the connection of a screen using a "USB Type-C to HDMI" adapter. |
143 | +_steps: |
144 | + Skip this test if the dock does not have a USB Type-C port. |
145 | + 1. Connect a display (if not already connected) to the USB Type-C port on |
146 | + your system using a "USB Type-C to HDMI" adapter |
147 | + 2. Switch display modes between in your Display Settings, check if it can be |
148 | + set to mirrored, extended, displayed on external or onboard only |
149 | +_verification: |
150 | + Was the desktop displayed correctly on the screen connected |
151 | + using a "USB Type-C to HDMI" adapter in every mode? |
152 | + |
153 | +id: dock/monitor_type-c_vga |
154 | +category_id: dock-display |
155 | +depends: dock/cold-plug |
156 | +estimated_duration: 120 |
157 | +plugin: manual |
158 | +_summary: Display connected via VGA using an USB Type-C port |
159 | +_purpose: |
160 | + This test will check the connection of a screen using a "USB Type-C to VGA" adapter. |
161 | +_steps: |
162 | + Skip this test if the dock does not have a USB Type-C port. |
163 | + 1. Connect a display (if not already connected) to the USB Type-C port on |
164 | + your system using a "USB Type-C to VGA" adapter |
165 | + 2. Switch display modes between in your Display Settings, check if it can be |
166 | + set to mirrored, extended, displayed on external or onboard only |
167 | +_verification: |
168 | + Was the desktop displayed correctly on the screen connected |
169 | + using a "USB Type-C to VGA" adapter in every mode? |
170 | + |
171 | +id: dock/monitor-dual-head |
172 | +category_id: dock-display |
173 | +depends: dock/cold-plug |
174 | estimated_duration: 120.0 |
175 | -_summary: Multiple monitors test while docked |
176 | +_summary: Dual monitors test while docked |
177 | plugin: manual |
178 | _purpose: |
179 | - This test verifies that multi-monitor output works using the dock. You will need at least two external monitors to perform this test. |
180 | + This test verifies that dual-monitor output works using the dock. You will need two external monitors to perform this test. |
181 | _steps: |
182 | - Skip this test if your video card or the dock do not support multiple monitors. |
183 | + Skip this test if your video card or the dock do not support multiple monitors. Use 4K monitors to run this test if the video card and dock both support. |
184 | 1. If your dock provides more than one monitor outputs, connect two monitors |
185 | 2. Open the "Displays" tool (open the dash and search for "Displays") |
186 | 3. Configure your output to provide one desktop across all the monitors |
187 | @@ -81,8 +201,27 @@ |
188 | _verification: |
189 | Was the stretched desktop displayed correctly across all the screens? |
190 | |
191 | +id: dock/monitor-tripple-head |
192 | +category_id: dock-display |
193 | +depends: dock/cold-plug |
194 | +estimated_duration: 120.0 |
195 | +_summary: Tripple monitors test while docked |
196 | +plugin: manual |
197 | +_purpose: |
198 | + This test verifies that tripple-monitor output works using the dock. You will need three external monitors to perform this test. |
199 | +_steps: |
200 | + Skip this test if your video card or the dock do not support multiple monitors. |
201 | + 1. If your dock provides more than one monitor outputs, connect three monitors |
202 | + 2. Open the "Displays" tool (open the dash and search for "Displays") |
203 | + 3. Turn off internal monitor |
204 | + 4. Configure your output to provide one desktop across all the monitors |
205 | + 5. Open any application and drag its window from one monitor to the next. |
206 | +_verification: |
207 | + Was the stretched desktop displayed correctly across all the screens? |
208 | + |
209 | id: dock/keys-video-out |
210 | -depends: dock/docking |
211 | +category_id: dock-display |
212 | +depends: dock/cold-plug |
213 | estimated_duration: 120.0 |
214 | _summary: Video Out hotkey test |
215 | plugin: manual |
216 | @@ -98,9 +237,10 @@ |
217 | |
218 | plugin: shell |
219 | id: dock/audio-list-devices |
220 | +category_id: dock-audio |
221 | estimated_duration: 1.0 |
222 | _summary: List audio devices |
223 | -depends: dock/docking |
224 | +depends: dock/cold-plug |
225 | requires: |
226 | device.category == 'AUDIO' |
227 | package.name == 'alsa-base' |
228 | @@ -108,7 +248,8 @@ |
229 | _description: Test to detect audio devices |
230 | |
231 | id: dock/audio-playback-hdmi |
232 | -depends: dock/docking |
233 | +category_id: dock-audio |
234 | +depends: dock/cold-plug |
235 | requires: |
236 | device.category == 'AUDIO' |
237 | package.name == 'alsa-base' |
238 | @@ -134,7 +275,8 @@ |
239 | Did you hear the sound from the HDMI device? |
240 | |
241 | id: dock/audio-playback-displayport |
242 | -depends: dock/docking |
243 | +category_id: dock-audio |
244 | +depends: dock/cold-plug |
245 | requires: |
246 | device.category == 'AUDIO' |
247 | package.name == 'alsa-base' |
248 | @@ -160,6 +302,7 @@ |
249 | Did you hear the sound from the DisplayPort device? |
250 | |
251 | id: dock/audio-playback-headphones |
252 | +category_id: dock-audio |
253 | plugin: user-interact-verify |
254 | estimated_duration: 30.0 |
255 | _summary: Headphones output test |
256 | @@ -186,6 +329,7 @@ |
257 | Did you hear a sound through the headphones and did the sound play without any distortion, clicks or other strange noises from your headphones? |
258 | |
259 | plugin: user-interact-verify |
260 | +category_id: dock-audio |
261 | id: dock/audio-alsa-record-playback-external |
262 | estimated_duration: 30.0 |
263 | _summary: External microphone plugged to the dock to record sound test |
264 | @@ -214,9 +358,10 @@ |
265 | |
266 | plugin: shell |
267 | id: dock/audio-alsa-info-collect |
268 | +category_id: dock-audio |
269 | estimated_duration: 2.0 |
270 | _summary: Collect audio-related system information |
271 | -depends: dock/docking |
272 | +depends: dock/cold-plug |
273 | command: alsa_info --no-dialog --no-upload --output ${PLAINBOX_SESSION_SHARE}/alsa_info.log |
274 | _description: |
275 | Collect audio-related system information. This data can be used to |
276 | @@ -225,6 +370,7 @@ |
277 | |
278 | plugin: attachment |
279 | id: dock/audio-alsa-info-attachment |
280 | +category_id: dock-audio |
281 | depends: dock/audio-alsa-info-collect |
282 | estimated_duration: 1.0 |
283 | _summary: Attach audio hardware data log to results |
284 | @@ -234,7 +380,8 @@ |
285 | |
286 | plugin: manual |
287 | id: dock/audio-external-lineout |
288 | -depends: dock/docking |
289 | +category_id: dock-audio |
290 | +depends: dock/cold-plug |
291 | estimated_duration: 30.0 |
292 | _summary: Line-out connection test |
293 | _purpose: |
294 | @@ -250,7 +397,8 @@ |
295 | |
296 | plugin: user-interact-verify |
297 | id: dock/audio-external-linein |
298 | -depends: dock/docking |
299 | +category_id: dock-audio |
300 | +depends: dock/cold-plug |
301 | estimated_duration: 120.0 |
302 | _summary: Line-in connection test |
303 | requires: |
304 | @@ -276,8 +424,9 @@ |
305 | Did you hear your recording? |
306 | |
307 | id: dock/audio-speaker-headphone-plug-detection |
308 | +category_id: dock-audio |
309 | plugin: user-interact |
310 | -depends: dock/docking |
311 | +depends: dock/cold-plug |
312 | estimated_duration: 60.0 |
313 | _summary: Headphones recognized when plugged to the dock test |
314 | requires: |
315 | @@ -298,8 +447,9 @@ |
316 | The test times out after 30 seconds (and fails in that case). |
317 | |
318 | id: dock/audio-microphone-plug-detection |
319 | +category_id: dock-audio |
320 | plugin: user-interact |
321 | -depends: dock/docking |
322 | +depends: dock/cold-plug |
323 | estimated_duration: 60.0 |
324 | _summary: Microphone recognized when plugged to the dock test |
325 | requires: |
326 | @@ -324,7 +474,8 @@ |
327 | |
328 | id: dock/networking-gateway-ping |
329 | plugin: user-interact-verify |
330 | -depends: dock/docking ethernet/detect |
331 | +category_id: dock-network |
332 | +depends: dock/cold-plug ethernet/detect |
333 | command: gateway_ping_test |
334 | estimated_duration: 10.00 |
335 | _summary: Ping test using dock's Ethernet connectivity |
336 | @@ -338,8 +489,9 @@ |
337 | Was the test able to ping the network using the Ethernet connection? |
338 | |
339 | id: dock/networking-ntp |
340 | +category_id: dock-network |
341 | plugin: user-interact-verify |
342 | -depends: dock/docking |
343 | +depends: dock/cold-plug |
344 | requires: package.name == 'ntpdate' |
345 | user: root |
346 | command: network_ntp_test |
347 | @@ -354,10 +506,28 @@ |
348 | _verification: |
349 | Was the test able to synchronize system time using the Ethernet connection? |
350 | |
351 | +id: dock/mac-address-pass-through |
352 | +category_id: dock-network |
353 | +plugin: manual |
354 | +depends: dock/cold-plug |
355 | +estimated_duration: 60 |
356 | +_summary: MAC address pass through function test |
357 | +_purpose: |
358 | + Test MAC address pass through function with docking station (Dell Dock specific function, TB15, WD15) |
359 | +_steps: |
360 | + Skip this test if your docking station does not support MAC address pass through. |
361 | + 1. Make sure the dock is connected to network using an Ethernet cable |
362 | + 2. Run 'ifconfig' to get system specific MAC address and IP |
363 | + 3. Ping the IP address from another system |
364 | + 4. Run 'arp -a IP' from another system to get the MAC address of the test unit through dock |
365 | +_verification: |
366 | + Is the MAC address got from arp matching with specific MAC address? |
367 | + |
368 | ### USB Tests ### |
369 | |
370 | plugin: user-interact-verify |
371 | id: dock/usb-HID |
372 | +category_id: dock-usb |
373 | estimated_duration: 20.0 |
374 | _summary: USB HID device test |
375 | command: keyboard_test |
376 | @@ -372,6 +542,7 @@ |
377 | |
378 | plugin: user-interact |
379 | id: dock/usb-insert |
380 | +category_id: dock-usb |
381 | estimated_duration: 10.0 |
382 | _summary: USB drive insertion test |
383 | command: removable_storage_watcher insert usb |
384 | @@ -391,6 +562,7 @@ |
385 | |
386 | plugin: user-interact |
387 | id: dock/usb3-insert |
388 | +category_id: dock-usb |
389 | estimated_duration: 10.0 |
390 | _summary: USB3 drive insertion test |
391 | command: removable_storage_watcher -m 500000000 insert usb |
392 | @@ -409,6 +581,7 @@ |
393 | |
394 | plugin: user-interact |
395 | id: dock/usb-remove |
396 | +category_id: dock-usb |
397 | depends: dock/usb-insert |
398 | estimated_duration: 10.0 |
399 | _summary: USB drive removal test |
400 | @@ -425,6 +598,7 @@ |
401 | |
402 | plugin: user-interact |
403 | id: dock/usb3-remove |
404 | +category_id: dock-usb |
405 | depends: dock/usb3-insert |
406 | estimated_duration: 10.0 |
407 | _summary: USB3 drive removal test |
408 | @@ -441,6 +615,7 @@ |
409 | |
410 | plugin: shell |
411 | id: dock/usb-storage-automated |
412 | +category_id: dock-usb |
413 | depends: dock/usb-insert |
414 | user: root |
415 | estimated_duration: 45.0 |
416 | @@ -451,6 +626,7 @@ |
417 | |
418 | plugin: shell |
419 | id: dock/usb3-storage-automated |
420 | +category_id: dock-usb |
421 | depends: dock/usb3-insert |
422 | user: root |
423 | estimated_duration: 45.0 |
424 | @@ -459,20 +635,364 @@ |
425 | _description: |
426 | This test is automated and executes after the dock/usb3_insert test is run. |
427 | |
428 | +### USB-C tests ### |
429 | + |
430 | +plugin: user-interact |
431 | +category_id: dock-usb |
432 | +id: dock/usb-c/c-to-a-adapter/insert |
433 | +imports: from 2013.com.canonical.plainbox import manifest |
434 | +requires: |
435 | + usb.usb3 == 'supported' |
436 | + manifest.has_usb_type_c == 'True' |
437 | +estimated_duration: 10.0 |
438 | +command: removable_storage_watcher -m 500000000 insert usb |
439 | +_purpose: |
440 | + This test will check that the system correctly detects the insertion of |
441 | + a USB 3 storage device in a USB Type-C connector on the dock using a |
442 | + "Type-C to Type-A" adapter |
443 | +_steps: |
444 | + 1. Click "Test" and insert a USB 3 storage device in a USB Type-C port |
445 | + on the dock using a "USB Type-C to Type-A" adapter. |
446 | + (Note: this test will time-out after 20 seconds.) |
447 | + 2. Do not unplug the device after the test. |
448 | +_verification: |
449 | + The verification of this test is automated. Do not change the |
450 | + automatically selected result. |
451 | + |
452 | +plugin: user-interact |
453 | +category_id: dock-usb |
454 | +id: dock/usb-c/insert |
455 | +imports: from 2013.com.canonical.plainbox import manifest |
456 | +requires: |
457 | + usb.usb3 == 'supported' |
458 | + manifest.has_usb_type_c == 'True' |
459 | +estimated_duration: 10.0 |
460 | +command: removable_storage_watcher -m 500000000 insert usb |
461 | +_purpose: |
462 | + This test will check that the system correctly detects the insertion of |
463 | + a USB 3 storage device in a USB Type-C connector on the dock |
464 | +_steps: |
465 | + 1. Click "Test" and insert a USB 3 storage device in a USB Type-C port |
466 | + on the dock. |
467 | + (Note: this test will time-out after 20 seconds.) |
468 | + 2. Do not unplug the device after the test. |
469 | +_verification: |
470 | + The verification of this test is automated. Do not change the |
471 | + automatically selected result. |
472 | + |
473 | +plugin: user-interact |
474 | +category_id: dock-usb |
475 | +id: dock/usb-c/c-to-a-adapter/remove |
476 | +imports: from 2013.com.canonical.plainbox import manifest |
477 | +depends: dock/usb-c/c-to-a-adapter/insert |
478 | +requires: |
479 | + usb.usb3 == 'supported' |
480 | + manifest.has_usb_type_c == 'True' |
481 | +estimated_duration: 10.0 |
482 | +command: removable_storage_watcher -m 500000000 remove usb |
483 | +_purpose: |
484 | + This test will check that the system correctly detects the removal of |
485 | + a USB 3 storage device connected to a USB Type-C port using a "USB Type-C |
486 | + to Type-A" adapter. |
487 | +_steps: |
488 | + 1. Click "Test" and remove the USB 3 device. |
489 | + (Note: this test will time-out after 20 seconds.) |
490 | +_verification: |
491 | + The verification of this test is automated. Do not change the |
492 | + automatically selected result. |
493 | + |
494 | +plugin: user-interact |
495 | +category_id: dock-usb |
496 | +id: dock/usb-c/remove |
497 | +imports: from 2013.com.canonical.plainbox import manifest |
498 | +depends: dock/usb-c/insert |
499 | +requires: |
500 | + usb.usb3 == 'supported' |
501 | + manifest.has_usb_type_c == 'True' |
502 | +estimated_duration: 10.0 |
503 | +command: removable_storage_watcher -m 500000000 remove usb |
504 | +_purpose: |
505 | + This test will check that the system correctly detects the removal of |
506 | + a USB 3 storage device connected to a USB Type-C port. |
507 | +_steps: |
508 | + 1. Click "Test" and remove the USB 3 device. |
509 | + (Note: this test will time-out after 20 seconds.) |
510 | +_verification: |
511 | + The verification of this test is automated. Do not change the |
512 | + automatically selected result. |
513 | + |
514 | +plugin: shell |
515 | +category_id: dock-usb |
516 | +id: dock/usb-c/c-to-a-adapter/storage-automated |
517 | +imports: from 2013.com.canonical.plainbox import manifest |
518 | +requires: |
519 | + usb.usb3 == 'supported' |
520 | + manifest.has_usb_type_c == 'True' |
521 | +depends: dock/usb-c/c-to-a-adapter/insert |
522 | +user: root |
523 | +estimated_duration: 45.0 |
524 | +command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd |
525 | +_description: |
526 | + This test is automated and executes after the usb-c/c-to-a-adapter/insert test |
527 | + is run. |
528 | + |
529 | +plugin: shell |
530 | +category_id: dock-usb |
531 | +id: dock/usb-c/storage-automated |
532 | +imports: from 2013.com.canonical.plainbox import manifest |
533 | +requires: |
534 | + usb.usb3 == 'supported' |
535 | + manifest.has_usb_type_c == 'True' |
536 | +depends: dock/usb-c/insert |
537 | +user: root |
538 | +estimated_duration: 45.0 |
539 | +command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd |
540 | +_description: |
541 | + This test is automated and executes after the usb-c/insert test |
542 | + is run. |
543 | + |
544 | +plugin: user-interact |
545 | +category_id: dock-usb |
546 | +id: dock/usb-c/c-to-a-adapter/insert-after-suspend |
547 | +depends: suspend/suspend_advanced |
548 | +imports: from 2013.com.canonical.plainbox import manifest |
549 | +requires: |
550 | + usb.usb3 == 'supported' |
551 | + manifest.has_usb_type_c == 'True' |
552 | +estimated_duration: 10.0 |
553 | +command: removable_storage_watcher -m 500000000 insert usb |
554 | +_purpose: |
555 | + This test will check that the system correctly detects the insertion of |
556 | + a USB 3 storage device in a USB Type-C connector on the dock using a |
557 | + "Type-C to Type-A" adapter after suspend |
558 | +_steps: |
559 | + 1. Click "Test" and insert a USB 3 storage device in a USB Type-C port on |
560 | + the dock using a "USB Type-C to Type-A" adapter. |
561 | + (Note: this test will time-out after 20 seconds.) |
562 | + 2. Do not unplug the device after the test. |
563 | +_verification: |
564 | + The verification of this test is automated. Do not change the |
565 | + automatically selected result. |
566 | + |
567 | +plugin: user-interact |
568 | +category_id: dock-usb |
569 | +id: dock/usb-c/insert-after-suspend |
570 | +depends: suspend/suspend_advanced |
571 | +imports: from 2013.com.canonical.plainbox import manifest |
572 | +requires: |
573 | + usb.usb3 == 'supported' |
574 | + manifest.has_usb_type_c == 'True' |
575 | +estimated_duration: 10.0 |
576 | +command: removable_storage_watcher -m 500000000 insert usb |
577 | +_purpose: |
578 | + This test will check that the system correctly detects the insertion of |
579 | + a USB 3 storage device in a USB Type-C connector on the dock after suspend |
580 | +_steps: |
581 | + 1. Click "Test" and insert a USB 3 storage device in a USB Type-C port |
582 | + on the dock. |
583 | + (Note: this test will time-out after 20 seconds.) |
584 | + 2. Do not unplug the device after the test. |
585 | +_verification: |
586 | + The verification of this test is automated. Do not change the |
587 | + automatically selected result. |
588 | + |
589 | +plugin: user-interact |
590 | +category_id: dock-usb |
591 | +id: dock/usb-c/c-to-a-adapter/remove-after-suspend |
592 | +imports: from 2013.com.canonical.plainbox import manifest |
593 | +depends: dock/usb-c/c-to-a-adapter/insert-after-suspend |
594 | +requires: |
595 | + usb.usb3 == 'supported' |
596 | + manifest.has_usb_type_c == 'True' |
597 | +estimated_duration: 10.0 |
598 | +command: removable_storage_watcher -m 500000000 remove usb |
599 | +_purpose: |
600 | + This test will check that the system correctly detects the removal of |
601 | + a USB 3 storage device connected to a USB Type-C port using a "USB Type-C |
602 | + to Type-A" adapter after suspend. |
603 | +_steps: |
604 | + 1. Click "Test" and remove the USB 3 device. |
605 | + (Note: this test will time-out after 20 seconds.) |
606 | +_verification: |
607 | + The verification of this test is automated. Do not change the |
608 | + automatically selected result. |
609 | + |
610 | +plugin: user-interact |
611 | +category_id: dock-usb |
612 | +id: dock/usb-c/remove-after-suspend |
613 | +imports: from 2013.com.canonical.plainbox import manifest |
614 | +depends: dock/usb-c/insert-after-suspend |
615 | +requires: |
616 | + usb.usb3 == 'supported' |
617 | + manifest.has_usb_type_c == 'True' |
618 | +estimated_duration: 10.0 |
619 | +command: removable_storage_watcher -m 500000000 remove usb |
620 | +_purpose: |
621 | + This test will check that the system correctly detects the removal of |
622 | + a USB 3 storage device connected to a USB Type-C port after suspend. |
623 | +_steps: |
624 | + 1. Click "Test" and remove the USB 3 device. |
625 | + (Note: this test will time-out after 20 seconds.) |
626 | +_verification: |
627 | + The verification of this test is automated. Do not change the |
628 | + automatically selected result. |
629 | + |
630 | +plugin: shell |
631 | +category_id: dock-usb |
632 | +id: dock/usb-c/c-to-a-adapter/storage-automated-after-suspend |
633 | +imports: from 2013.com.canonical.plainbox import manifest |
634 | +requires: |
635 | + usb.usb3 == 'supported' |
636 | + manifest.has_usb_type_c == 'True' |
637 | +depends: dock/usb-c/c-to-a-adapter/insert |
638 | +user: root |
639 | +estimated_duration: 45.0 |
640 | +command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd |
641 | +_description: |
642 | + This test is automated and executes after the usb-c/c-to-a-adapter/insert test |
643 | + is run. |
644 | + |
645 | +plugin: shell |
646 | +category_id: dock-usb |
647 | +id: dock/usb-c/storage-automated-after-suspend |
648 | +imports: from 2013.com.canonical.plainbox import manifest |
649 | +requires: |
650 | + usb.usb3 == 'supported' |
651 | + manifest.has_usb_type_c == 'True' |
652 | +depends: dock/usb-c/insert |
653 | +user: root |
654 | +estimated_duration: 45.0 |
655 | +command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd |
656 | +_description: |
657 | + This test is automated and executes after the usb-c/insert test |
658 | + is run. |
659 | + |
660 | ### ACPI ### |
661 | |
662 | id: dock/battery-charging |
663 | +category_id: dock |
664 | _summary: Battery charging when docked test |
665 | plugin: shell |
666 | -depends: dock/docking |
667 | +depends: dock/cold-plug |
668 | estimated_duration: 1.0 |
669 | command: |
670 | if [ "`upower -i /org/freedesktop/UPower/devices/battery_BAT0 | grep "state" | awk '{print $2}'`" = "discharging" ] ; then exit 1 ; fi |
671 | _description: |
672 | This test will make sure the laptop is being charged while connected to the dock. |
673 | |
674 | +### Hot Plug ### |
675 | + |
676 | +id: dock/hot-plug |
677 | +category_id: dock-hotplug |
678 | +plugin: manual |
679 | +estimated_duration: 30.00 |
680 | +_summary: Docking test |
681 | +_purpose: |
682 | + This test will check the device can be used after docking. |
683 | +_steps: |
684 | + 1. Unplug docking station. |
685 | + 2. Replug in docking station. |
686 | +_verification: |
687 | + Is the system working with problem (e.g. system hang) after docking station hot plugged in? |
688 | + |
689 | +plugin: user-interact-verify |
690 | +category_id: dock-hotplug |
691 | +id: dock/hotplug-ethernet |
692 | +depends: dock/hot-plug |
693 | +command: network_check |
694 | +estimated_duration: 10 |
695 | +_description: |
696 | + PURPOSE: |
697 | + This test will check wired connection after hotplug |
698 | + STEPS: |
699 | + 1. Disable WiFi connection |
700 | + 2. Click "Test" to verify that it's possible to establish a HTTP connection |
701 | + VERIFICATION: |
702 | + Did a notification show and was the connection correctly established? |
703 | + |
704 | +plugin: user-interact |
705 | +id: dock/hotplug-usb3-insert |
706 | +category_id: dock-hotplug |
707 | +depends: dock/hot-plug |
708 | +estimated_duration: 10.0 |
709 | +_summary: USB3 drive insertion test |
710 | +command: removable_storage_watcher -m 500000000 insert usb |
711 | +_purpose: |
712 | + This test will check that the system correctly detects the insertion of |
713 | + a USB 3.0 storage device after dock hot plugged in |
714 | +_steps: |
715 | + 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD, |
716 | + in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may |
717 | + be used it might cause performance related tests to fail. |
718 | + (Note: this test will time-out after 20 seconds.) |
719 | + 2. Do not unplug the device after the test. |
720 | +_verification: |
721 | + The verification of this test is automated. Do not change the |
722 | + automatically selected result. |
723 | + |
724 | +plugin: shell |
725 | +id: dock/hotplug-usb3-storage-automated |
726 | +category_id: dock-hotplug |
727 | +depends: dock/hotplug-usb3-insert |
728 | +user: root |
729 | +estimated_duration: 45.0 |
730 | +_summary: USB3 drive storage test |
731 | +command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd |
732 | +_description: |
733 | + This test is automated and executes after the dock/usb3_insert test is run. |
734 | + |
735 | +plugin: user-interact |
736 | +id: dock/hotplug-usb3-remove |
737 | +category_id: dock-hotplug |
738 | +depends: dock/hotplug-usb3-insert |
739 | +estimated_duration: 10.0 |
740 | +_summary: USB3 drive removal test |
741 | +command: removable_storage_watcher -m 500000000 remove usb |
742 | +_purpose: |
743 | + This test will check that the system correctly detects the removal of |
744 | + a USB 3.0 storage device after dock hot plugged in |
745 | +_steps: |
746 | + 1. Click "Test" and remove the USB 3.0 device from the dock. |
747 | + (Note: this test will time-out after 20 seconds.) |
748 | +_verification: |
749 | + The verification of this test is automated. Do not change the |
750 | + automatically selected result. |
751 | + |
752 | +id: dock/hotplug-monitor-displayport |
753 | +category_id: dock-hotplug |
754 | +depends: dock/hot-plug |
755 | +estimated_duration: 120.0 |
756 | +_summary: DisplayPort test on the dock |
757 | +plugin: manual |
758 | +_purpose: |
759 | + This test will check the DisplayPort(s) on the dock after hot plugged in. |
760 | +_steps: |
761 | + Skip this test if the dock does not have a DisplayPort. |
762 | + 1. Connect a display (if not already connected) to the DisplayPort on the dock |
763 | + 2. Repeat step 1 for each additional DisplayPorts, if any |
764 | +_verification: |
765 | + Was the desktop displayed correctly on both screens? |
766 | + |
767 | +id: dock/hotplug-monitor-hdmi |
768 | +category_id: dock-hotplug |
769 | +depends: dock/hot-plug |
770 | +estimated_duration: 120.0 |
771 | +_summary: HDMI port test on the dock |
772 | +plugin: manual |
773 | +_purpose: |
774 | + This test will check the HDMI port(s) on the dock after hot plugged in. |
775 | +_steps: |
776 | + Skip this test if the dock does not have a HDMI port. |
777 | + 1. Connect a display (if not already connected) to the HDMI port on the dock |
778 | + 2. Repeat step 1 for each additional HDMI port, if any |
779 | +_verification: |
780 | + Was the desktop displayed correctly on both screens? |
781 | + |
782 | +### Network ### |
783 | + |
784 | plugin: shell |
785 | id: dock/network-before-suspend |
786 | +category_id: dock-network |
787 | depends: ethernet/detect |
788 | estimated_duration: 1.2 |
789 | _summary: Network status before suspend |
790 | @@ -481,6 +1001,7 @@ |
791 | |
792 | plugin: shell |
793 | id: dock/audio-before-suspend |
794 | +category_id: dock-audio |
795 | estimated_duration: 1.0 |
796 | _summary: Audio status before suspend |
797 | requires: |
798 | @@ -489,23 +1010,12 @@ |
799 | _description: Record mixer settings before suspending. |
800 | command: audio_settings store --file=$PLAINBOX_SESSION_SHARE/audio_settings_before_suspend |
801 | |
802 | -id: dock/suspend-dock-resume |
803 | -plugin: manual |
804 | -estimated_duration: 120.00 |
805 | -_summary: Suspend the device, dock it and resume it |
806 | -_purpose: |
807 | - This test will check the device can be suspended, docked and resumed properly |
808 | -_steps: |
809 | - 1. If the laptop is currently docked, undock it now |
810 | - 2. Suspend the laptop (e.g. by closing its lid) |
811 | - 3. Dock the laptop |
812 | - 4. Resume the laptop (e.g. by pressing the Power button on the dock) |
813 | -_verification: |
814 | - Is the device working as expected after being docked and resumed? |
815 | + |
816 | |
817 | id: dock/networking-gateway-ping-after-suspend |
818 | +category_id: dock-network |
819 | plugin: shell |
820 | -depends: dock/suspend-dock-resume ethernet/detect |
821 | +depends: suspend/suspend_advanced ethernet/detect |
822 | command: gateway_ping_test |
823 | estimated_duration: 2.00 |
824 | _summary: Network gateway ping after suspend |
825 | @@ -513,7 +1023,8 @@ |
826 | |
827 | plugin: user-interact |
828 | id: dock/usb-insert-after-suspend |
829 | -depends: dock/suspend-dock-resume |
830 | +category_id: dock-usb |
831 | +depends: suspend/suspend_advanced |
832 | estimated_duration: 10.0 |
833 | _summary: USB drive insertion after resuming |
834 | command: removable_storage_watcher insert usb |
835 | @@ -531,9 +1042,24 @@ |
836 | The verification of this test is automated. Do not change the |
837 | automatically selected result. |
838 | |
839 | +id: dock/power-button-after-suspend |
840 | +category_id: dock |
841 | +depends: suspend/suspend_advanced |
842 | +plugin: manual |
843 | +estimated_duration: 30.00 |
844 | +_summary: Docking test |
845 | +_purpose: |
846 | + This test will test the power button on docking station after suspend |
847 | +_steps: |
848 | + Skip this test if your docking station has no power button. |
849 | + 1. press the power button on docking station. |
850 | +_verification: |
851 | + Did the power management prompt pop up? |
852 | + |
853 | plugin: user-interact |
854 | id: dock/usb3-insert-after-suspend |
855 | -depends: dock/suspend-dock-resume |
856 | +category_id: dock-usb |
857 | +depends: suspend/suspend_advanced |
858 | estimated_duration: 10.0 |
859 | _summary: USB3 drive insertion after resuming |
860 | command: removable_storage_watcher -m 500000000 insert usb |
861 | @@ -552,6 +1078,7 @@ |
862 | |
863 | plugin: user-interact |
864 | id: dock/usb-remove-after-suspend |
865 | +category_id: dock-usb |
866 | depends: dock/usb-insert-after-suspend |
867 | estimated_duration: 10.0 |
868 | _summary: USB drive removal after resuming |
869 | @@ -568,6 +1095,7 @@ |
870 | |
871 | plugin: user-interact |
872 | id: dock/usb3-remove-after-suspend |
873 | +category_id: dock-usb |
874 | depends: dock/usb3-insert-after-suspend |
875 | estimated_duration: 10.0 |
876 | _summary: USB3 drive removal after resuming |
877 | @@ -584,6 +1112,7 @@ |
878 | |
879 | plugin: shell |
880 | id: dock/usb-storage-automated-after-suspend |
881 | +category_id: dock-usb |
882 | depends: dock/usb-insert-after-suspend |
883 | user: root |
884 | estimated_duration: 45.0 |
885 | @@ -594,6 +1123,7 @@ |
886 | |
887 | plugin: shell |
888 | id: dock/usb3-storage-automated-after-suspend |
889 | +category_id: dock-usb |
890 | depends: dock/usb3-insert-after-suspend |
891 | user: root |
892 | estimated_duration: 45.0 |
893 | @@ -604,7 +1134,8 @@ |
894 | |
895 | plugin: user-interact-verify |
896 | id: dock/usb-HID-after-suspend |
897 | -depends: dock/suspend-dock-resume |
898 | +category_id: dock-usb |
899 | +depends: suspend/suspend_advanced |
900 | estimated_duration: 20.0 |
901 | _summary: USB HID device test after resuming |
902 | command: keyboard_test |
903 | @@ -618,7 +1149,8 @@ |
904 | Did the device work as expected? |
905 | |
906 | id: dock/monitor-displayport-after-suspend |
907 | -depends: dock/suspend-dock-resume |
908 | +category_id: dock-display |
909 | +depends: suspend/suspend_advanced |
910 | estimated_duration: 120.0 |
911 | _summary: DisplayPort test on the dock after resuming |
912 | plugin: manual |
913 | @@ -632,7 +1164,8 @@ |
914 | Was the desktop displayed correctly on both screens? |
915 | |
916 | id: dock/monitor-dvi-after-suspend |
917 | -depends: dock/suspend-dock-resume |
918 | +category_id: dock-display |
919 | +depends: suspend/suspend_advanced |
920 | estimated_duration: 120.0 |
921 | _summary: DVI port test on the dock after resuming |
922 | plugin: manual |
923 | @@ -646,7 +1179,8 @@ |
924 | Was the desktop displayed correctly on both screens? |
925 | |
926 | id: dock/monitor-hdmi-after-suspend |
927 | -depends: dock/suspend-dock-resume |
928 | +category_id: dock-display |
929 | +depends: suspend/suspend_advanced |
930 | estimated_duration: 120.0 |
931 | _summary: HDMI port test on the dock after resuming |
932 | plugin: manual |
933 | @@ -660,7 +1194,8 @@ |
934 | Was the desktop displayed correctly on both screens? |
935 | |
936 | id: dock/monitor-vga-after-suspend |
937 | -depends: dock/suspend-dock-resume |
938 | +category_id: dock-display |
939 | +depends: suspend/suspend_advanced |
940 | estimated_duration: 120.0 |
941 | _summary: VGA port test on the dock after resuming |
942 | plugin: manual |
943 | @@ -673,7 +1208,64 @@ |
944 | _verification: |
945 | Was the desktop displayed correctly on both screens? |
946 | |
947 | +id: dock/monitor_type-c_displayport-after-suspend |
948 | +category_id: dock-display |
949 | +depends: suspend/suspend_advanced |
950 | +estimated_duration: 120 |
951 | +plugin: manual |
952 | +_summary: Display connected via DisplayPort using an USB Type-C port after resuming |
953 | +_purpose: |
954 | + This test will check the connection of a screen using a "USB Type-C to DisplayPort" adapter after resuming. |
955 | +_steps: |
956 | + Skip this test if the dock does not have a USB Type-C port. |
957 | + 1. Connect a display (if not already connected) to the USB Type-C port on |
958 | + your system using a "USB Type-C to DisplayPort" adapter |
959 | + 2. Switch display modes between in your Display Settings, check if it can be |
960 | + set to mirrored, extended, displayed on external or onboard only |
961 | +_verification: |
962 | + Was the desktop displayed correctly on the screen connected |
963 | + using a "USB Type-C to DisplayPort" adapter in every mode? |
964 | + |
965 | +id: dock/monitor_type-c_hdmi-after-suspend |
966 | +category_id: dock-display |
967 | +depends: suspend/suspend_advanced |
968 | +estimated_duration: 120 |
969 | +plugin: manual |
970 | +_summary: Display connected via HDMI using an USB Type-C port after resuming |
971 | +_purpose: |
972 | + This test will check the connection of a screen using a "USB Type-C to HDMI" adapter after resuming. |
973 | +_steps: |
974 | + Skip this test if the dock does not have a USB Type-C port. |
975 | + 1. Connect a display (if not already connected) to the USB Type-C port on |
976 | + your system using a "USB Type-C to HDMI" adapter |
977 | + 2. Switch display modes between in your Display Settings, check if it can be |
978 | + set to mirrored, extended, displayed on external or onboard only |
979 | +_verification: |
980 | + Was the desktop displayed correctly on the screen connected |
981 | + using a "USB Type-C to HDMI" adapter in every mode? |
982 | + |
983 | +id: dock/monitor_type-c_vga-after-suspend |
984 | +category_id: dock-display |
985 | +depends: suspend/suspend_advanced |
986 | +estimated_duration: 120 |
987 | +plugin: manual |
988 | +_summary: Display connected via VGA using an USB Type-C port after resuming |
989 | +_purpose: |
990 | + This test will check the connection of a screen using a "USB Type-C to VGA" adapter after resuming. |
991 | +_steps: |
992 | + Skip this test if the dock does not have a USB Type-C port. |
993 | + 1. Connect a display (if not already connected) to the USB Type-C port on |
994 | + your system using a "USB Type-C to VGA" adapter |
995 | + 2. Switch display modes between in your Display Settings, check if it can be |
996 | + set to mirrored, extended, displayed on external or onboard only |
997 | +_verification: |
998 | + Was the desktop displayed correctly on the screen connected |
999 | + using a "USB Type-C to VGA" adapter in every mode? |
1000 | + |
1001 | +### Suspend, Undocked, Resume ### |
1002 | + |
1003 | id: dock/suspend-undock-resume |
1004 | +category_id: suspend-undock-resume |
1005 | plugin: manual |
1006 | estimated_duration: 120.00 |
1007 | _summary: Suspend the device, undock it and resume it |
1008 | @@ -684,11 +1276,13 @@ |
1009 | 2. Suspend the laptop (e.g. by closing its lid) |
1010 | 3. Undock the laptop |
1011 | 4. Resume the laptop (e.g. by pressing its Power button) |
1012 | + 5. Enable wireless if it was disabled |
1013 | _verification: |
1014 | Is the device working as expected after being undocked and resumed? |
1015 | |
1016 | plugin: shell |
1017 | id: dock/wireless-connection-after-suspend-wpa-bg |
1018 | +category_id: suspend-undock-resume |
1019 | depends: dock/suspend-undock-resume |
1020 | estimated_duration: 20.0 |
1021 | _summary: Wireless connection after suspend (WPA BG) |
1022 | @@ -712,6 +1306,7 @@ |
1023 | |
1024 | plugin: shell |
1025 | id: dock/wireless-connection-after-suspend-open-bg |
1026 | +category_id: suspend-undock-resume |
1027 | depends: dock/suspend-undock-resume |
1028 | estimated_duration: 1.2 |
1029 | _summary: Wireless connection after suspend (Open BG) |
1030 | @@ -735,6 +1330,7 @@ |
1031 | |
1032 | plugin: shell |
1033 | id: dock/wireless-connection-after-suspend-wpa-n |
1034 | +category_id: suspend-undock-resume |
1035 | depends: dock/suspend-undock-resume |
1036 | estimated_duration: 1.2 |
1037 | _summary: Wireless connection after suspend (WPA N) |
1038 | @@ -758,6 +1354,7 @@ |
1039 | |
1040 | plugin: shell |
1041 | id: dock/wireless-connection-after-suspend-open-n |
1042 | +category_id: suspend-undock-resume |
1043 | depends: dock/suspend-undock-resume |
1044 | estimated_duration: 1.2 |
1045 | _summary: Wireless connection after suspend (Open N) |
1046 | @@ -781,6 +1378,7 @@ |
1047 | |
1048 | plugin: shell |
1049 | id: dock/wireless-connection-after-suspend-wpa-ac |
1050 | +category_id: suspend-undock-resume |
1051 | depends: dock/suspend-undock-resume |
1052 | estimated_duration: 1.2 |
1053 | _summary: Wireless connection after suspend (WPA AC) |
1054 | @@ -805,6 +1403,7 @@ |
1055 | |
1056 | plugin: shell |
1057 | id: dock/wireless-connection-after-suspend-open-ac |
1058 | +category_id: suspend-undock-resume |
1059 | depends: dock/suspend-undock-resume |
1060 | estimated_duration: 1.2 |
1061 | _summary: Wireless connection after suspend (Open AC) |
1062 | @@ -828,7 +1427,8 @@ |
1063 | security and the 802.11ac protocol after the system has been suspended. |
1064 | |
1065 | plugin: shell |
1066 | -id: dock/audio-after-suspend |
1067 | +id: dock/audio-after-suspend-undock-resume |
1068 | +category_id: dock-audio |
1069 | estimated_duration: 1.0 |
1070 | _summary: Audio after resuming test |
1071 | requires: |
1072 | @@ -841,7 +1441,8 @@ |
1073 | diff $PLAINBOX_SESSION_SHARE/audio_settings_before_suspend $PLAINBOX_SESSION_SHARE/audio_settings_after_suspend |
1074 | |
1075 | plugin: shell |
1076 | -id: dock/record-playback-after-suspend |
1077 | +id: dock/record-playback-after-suspend-undock-resume |
1078 | +category_id: dock-audio |
1079 | estimated_duration: 10.0 |
1080 | _summary: Record playback after resuming |
1081 | depends: dock/suspend-undock-resume |
1082 | @@ -857,11 +1458,90 @@ |
1083 | _description: |
1084 | This will check to make sure that your audio device works properly after a suspend and resume. This may work fine with speakers and onboard microphone, however, it works best if used with a cable connecting the audio-out jack to the audio-in jack. |
1085 | |
1086 | +plugin: user-interact |
1087 | +id: dock/usb3-insert-after-suspend-undock-resume |
1088 | +category_id: suspend-undock-resume |
1089 | +depends: dock/suspend-undock-resume |
1090 | +estimated_duration: 10.0 |
1091 | +_summary: USB3 drive insertion test |
1092 | +command: removable_storage_watcher -m 500000000 insert usb |
1093 | +_purpose: |
1094 | + This test will check that the system correctly detects the insertion of |
1095 | + a USB 3.0 storage device after suspend, undocked, resume. |
1096 | +_steps: |
1097 | + 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD, |
1098 | + in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may |
1099 | + be used it might cause performance related tests to fail. |
1100 | + (Note: this test will time-out after 20 seconds.) |
1101 | + 2. Do not unplug the device after the test. |
1102 | +_verification: |
1103 | + The verification of this test is automated. Do not change the |
1104 | + automatically selected result. |
1105 | + |
1106 | +plugin: shell |
1107 | +id: dock/usb3-storage-automated-after-suspend-undock-resume |
1108 | +category_id: suspend-undock-resume |
1109 | +depends: dock/usb3-insert-after-suspend-undock-resume |
1110 | +user: root |
1111 | +estimated_duration: 45.0 |
1112 | +_summary: USB3 drive storage test |
1113 | +command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd |
1114 | +_description: |
1115 | + This test is automated and executes after the dock/usb3_insert test is run. |
1116 | + |
1117 | +plugin: user-interact |
1118 | +id: dock/usb3-remove-after-suspend-undock-resume |
1119 | +category_id: suspend-undock-resume |
1120 | +depends: dock/usb3-insert-after-suspend-undock-resume |
1121 | +estimated_duration: 10.0 |
1122 | +_summary: USB3 drive removal test |
1123 | +command: removable_storage_watcher -m 500000000 remove usb |
1124 | +_purpose: |
1125 | + This test will check that the system correctly detects the removal of |
1126 | + a USB 3.0 storage device after suspend, undocked, resume. |
1127 | +_steps: |
1128 | + 1. Click "Test" and remove the USB 3.0 device from the dock. |
1129 | + (Note: this test will time-out after 20 seconds.) |
1130 | +_verification: |
1131 | + The verification of this test is automated. Do not change the |
1132 | + automatically selected result. |
1133 | + |
1134 | +id: dock/monitor-displayport-after-suspend-undock-resume |
1135 | +category_id: suspend-undock-resume |
1136 | +depends: dock/suspend-undock-resume |
1137 | +estimated_duration: 120.0 |
1138 | +_summary: DisplayPort test on the dock |
1139 | +plugin: manual |
1140 | +_purpose: |
1141 | + This test will check the DisplayPort(s) on the system after suspend, undocked, resume. |
1142 | +_steps: |
1143 | + Skip this test if the system does not have a DisplayPort. |
1144 | + 1. Connect a display (if not already connected) to the DisplayPort on the system |
1145 | + 2. Repeat step 1 for each additional DisplayPorts, if any |
1146 | +_verification: |
1147 | + Was the desktop displayed correctly on both screens? |
1148 | + |
1149 | +id: dock/monitor-hdmi-after-suspend-undock-resume |
1150 | +category_id: suspend-undock-resume |
1151 | +depends: dock/suspend-undock-resume |
1152 | +estimated_duration: 120.0 |
1153 | +_summary: HDMI port test on the dock |
1154 | +plugin: manual |
1155 | +_purpose: |
1156 | + This test will check the HDMI port(s) on the system after suspend, undocked, resume. |
1157 | +_steps: |
1158 | + Skip this test if the system does not have a HDMI port. |
1159 | + 1. Connect a display (if not already connected) to the HDMI port on the system |
1160 | + 2. Repeat step 1 for each additional HDMI port, if any |
1161 | +_verification: |
1162 | + Was the desktop displayed correctly on both screens? |
1163 | + |
1164 | plugin: manual |
1165 | id: dock/expresscard-verification |
1166 | +category_id: dock |
1167 | estimated_duration: 10.0 |
1168 | _summary: ExpressCard slot verification |
1169 | -depends: dock/docking |
1170 | +depends: dock/cold-plug |
1171 | _purpose: |
1172 | This will verify that an ExpressCard slot on the dock can detect inserted devices. |
1173 | _steps: |
1174 | @@ -872,9 +1552,10 @@ |
1175 | |
1176 | plugin: user-interact |
1177 | id: dock/firewire-insert |
1178 | +category_id: dock |
1179 | estimated_duration: 20.0 |
1180 | _summary: FireWire HDD insertion test |
1181 | -depends: dock/docking |
1182 | +depends: dock/cold-plug |
1183 | command: removable_storage_watcher insert firewire |
1184 | _purpose: |
1185 | This test will check the system can detect the insertion of a FireWire HDD on the dock |
1186 | @@ -889,9 +1570,10 @@ |
1187 | |
1188 | plugin: shell |
1189 | id: dock/firewire-storage-test |
1190 | +category_id: dock |
1191 | estimated_duration: 45.0 |
1192 | _summary: FireWire HDD storage test |
1193 | -depends: dock/docking dock/firewire-insert |
1194 | +depends: dock/cold-plug dock/firewire-insert |
1195 | user: root |
1196 | command: removable_storage_test -s 268400000 firewire |
1197 | _description: |
1198 | @@ -900,6 +1582,7 @@ |
1199 | |
1200 | plugin: user-interact |
1201 | id: dock/firewire-remove |
1202 | +category_id: dock |
1203 | estimated_duration: 20.0 |
1204 | _summary: FireWire HDD removal test |
1205 | depends: dock/firewire-insert |
1206 | @@ -917,9 +1600,10 @@ |
1207 | |
1208 | plugin: user-interact |
1209 | id: dock/esata-insert |
1210 | +category_id: dock |
1211 | estimated_duration: 20.0 |
1212 | _summary: eSATA HDD insertion test |
1213 | -depends: dock/docking |
1214 | +depends: dock/cold-plug |
1215 | command: removable_storage_watcher insert ata_serial_esata |
1216 | _purpose: |
1217 | This test will check the system can detect the insertion of an eSATA HDD on the dock |
1218 | @@ -934,6 +1618,7 @@ |
1219 | |
1220 | plugin: shell |
1221 | id: dock/esata-storage-test |
1222 | +category_id: dock |
1223 | estimated_duration: 20.0 |
1224 | _summary: eSATA HDD storage test |
1225 | user: root |
1226 | @@ -945,6 +1630,7 @@ |
1227 | |
1228 | plugin: user-interact |
1229 | id: dock/esata-remove |
1230 | +category_id: dock |
1231 | estimated_duration: 20.0 |
1232 | _summary: eSATA HDD removal test |
1233 | depends: dock/esata-insert |
1234 | @@ -961,7 +1647,8 @@ |
1235 | |
1236 | plugin: manual |
1237 | id: dock/optical-read |
1238 | -depends: dock/docking |
1239 | +category_id: dock |
1240 | +depends: dock/cold-plug |
1241 | estimated_duration: 180.0 |
1242 | _summary: Optical media (CD) read test |
1243 | _purpose: |
1244 | @@ -975,6 +1662,7 @@ |
1245 | |
1246 | plugin: manual |
1247 | id: dock/optical-write |
1248 | +category_id: dock |
1249 | depends: dock/optical-read |
1250 | estimated_duration: 300.0 |
1251 | _summary: Optical media (CD-RW, DVD-RW) writing test |
1252 | @@ -991,8 +1679,9 @@ |
1253 | |
1254 | plugin: user-interact |
1255 | id: dock/thunderbolt-insert |
1256 | +category_id: dock |
1257 | estimated_duration: 40.0 |
1258 | -depends: dock/docking |
1259 | +depends: dock/cold-plug |
1260 | command: removable_storage_watcher insert --timeout 40 scsi |
1261 | _summary: Thunderbolt storage insertion detection |
1262 | _purpose: |
1263 | @@ -1008,6 +1697,7 @@ |
1264 | |
1265 | plugin: shell |
1266 | id: dock/thunderbolt-storage-test |
1267 | +category_id: dock |
1268 | estimated_duration: 45.0 |
1269 | user: root |
1270 | depends: dock/thunderbolt-insert |
1271 | @@ -1019,6 +1709,7 @@ |
1272 | |
1273 | plugin: user-interact |
1274 | id: dock/thunderbolt-remove |
1275 | +category_id: dock |
1276 | estimated_duration: 20.0 |
1277 | depends: dock/thunderbolt-insert |
1278 | command: removable_storage_watcher remove scsi |
1279 | @@ -1033,3 +1724,221 @@ |
1280 | The verification of this test is automated. Do not change the automatically |
1281 | selected result |
1282 | |
1283 | +### Hot Plug after suspend ### |
1284 | + |
1285 | +id: dock/hot-plug-after-suspend |
1286 | +category_id: dock-hotplug |
1287 | +plugin: manual |
1288 | +depends: suspend/suspend_advanced |
1289 | +estimated_duration: 30.00 |
1290 | +_summary: Docking test |
1291 | +_purpose: |
1292 | + This test will check the device can be used after docking and system suspend. |
1293 | +_steps: |
1294 | + 1. Unplug docking station. |
1295 | + 2. Replug in docking station. |
1296 | +_verification: |
1297 | + Is the system working with problem (e.g. system hang) after docking station hot plugged in? |
1298 | + |
1299 | +plugin: user-interact-verify |
1300 | +category_id: dock-hotplug |
1301 | +id: dock/hotplug-ethernet-after-suspend |
1302 | +depends: suspend/suspend_advanced |
1303 | +command: network_check |
1304 | +estimated_duration: 10 |
1305 | +_description: |
1306 | + PURPOSE: |
1307 | + This test will check wired connection after hotplug |
1308 | + STEPS: |
1309 | + 1. Disable WiFi connection |
1310 | + 2. Click "Test" to verify that it's possible to establish a HTTP connection |
1311 | + VERIFICATION: |
1312 | + Did a notification show and was the connection correctly established? |
1313 | + |
1314 | +plugin: user-interact |
1315 | +id: dock/hotplug-usb3-insert-after-suspend |
1316 | +category_id: dock-hotplug |
1317 | +depends: dock/hot-plug-after-suspend |
1318 | +estimated_duration: 10.0 |
1319 | +_summary: USB3 drive insertion test |
1320 | +command: removable_storage_watcher -m 500000000 insert usb |
1321 | +_purpose: |
1322 | + This test will check that the system correctly detects the insertion of |
1323 | + a USB 3.0 storage device after dock hot plugged in |
1324 | +_steps: |
1325 | + 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD, |
1326 | + in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may |
1327 | + be used it might cause performance related tests to fail. |
1328 | + (Note: this test will time-out after 20 seconds.) |
1329 | + 2. Do not unplug the device after the test. |
1330 | +_verification: |
1331 | + The verification of this test is automated. Do not change the |
1332 | + automatically selected result. |
1333 | + |
1334 | +plugin: shell |
1335 | +id: dock/hotplug-usb3-storage-automated-after-suspend |
1336 | +category_id: dock-hotplug |
1337 | +depends: dock/hotplug-usb3-insert-after-suspend |
1338 | +user: root |
1339 | +estimated_duration: 45.0 |
1340 | +_summary: USB3 drive storage test |
1341 | +command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd |
1342 | +_description: |
1343 | + This test is automated and executes after the dock/usb3_insert test is run. |
1344 | + |
1345 | +plugin: user-interact |
1346 | +id: dock/hotplug-usb3-remove-after-suspend |
1347 | +category_id: dock-hotplug |
1348 | +depends: dock/hotplug-usb3-insert-after-suspend |
1349 | +estimated_duration: 10.0 |
1350 | +_summary: USB3 drive removal test |
1351 | +command: removable_storage_watcher -m 500000000 remove usb |
1352 | +_purpose: |
1353 | + This test will check that the system correctly detects the removal of |
1354 | + a USB 3.0 storage device after dock hot plugged in |
1355 | +_steps: |
1356 | + 1. Click "Test" and remove the USB 3.0 device from the dock. |
1357 | + (Note: this test will time-out after 20 seconds.) |
1358 | +_verification: |
1359 | + The verification of this test is automated. Do not change the |
1360 | + automatically selected result. |
1361 | + |
1362 | +id: dock/hotplug-monitor-displayport-after-suspend |
1363 | +category_id: dock-hotplug |
1364 | +depends: dock/hot-plug-after-suspend |
1365 | +estimated_duration: 120.0 |
1366 | +_summary: DisplayPort test on the dock |
1367 | +plugin: manual |
1368 | +_purpose: |
1369 | + This test will check the DisplayPort(s) on the dock after hot plugged in. |
1370 | +_steps: |
1371 | + Skip this test if the dock does not have a DisplayPort. |
1372 | + 1. Connect a display (if not already connected) to the DisplayPort on the dock |
1373 | + 2. Repeat step 1 for each additional DisplayPorts, if any |
1374 | +_verification: |
1375 | + Was the desktop displayed correctly on both screens? |
1376 | + |
1377 | +id: dock/hotplug-monitor-hdmi-after-suspend |
1378 | +category_id: dock-hotplug |
1379 | +depends: dock/hot-plug-after-suspend |
1380 | +estimated_duration: 120.0 |
1381 | +_summary: HDMI port test on the dock |
1382 | +plugin: manual |
1383 | +_purpose: |
1384 | + This test will check the HDMI port(s) on the dock after hot plugged in. |
1385 | +_steps: |
1386 | + Skip this test if the dock does not have a HDMI port. |
1387 | + 1. Connect a display (if not already connected) to the HDMI port on the dock |
1388 | + 2. Repeat step 1 for each additional HDMI port, if any |
1389 | +_verification: |
1390 | + Was the desktop displayed correctly on both screens? |
1391 | + |
1392 | +### Suspend, Undocked, Docked, Resume ### |
1393 | + |
1394 | +id: dock/suspend-dock-resume |
1395 | +category_id: suspend-dock-resume |
1396 | +plugin: manual |
1397 | +estimated_duration: 120.00 |
1398 | +_summary: Suspend the device, undock, dock it and resume it |
1399 | +_purpose: |
1400 | + This test will check the device can be suspended, undocked, docked and resumed properly |
1401 | +_steps: |
1402 | + 1. Suspend the laptop (e.g. by closing its lid) |
1403 | + 2. Unplug docking station |
1404 | + 3. Plug in docking station |
1405 | + 4. Resume the laptop (e.g. by pressing the Power button on the dock) |
1406 | +_verification: |
1407 | + Is the device working as expected after being docked and resumed? |
1408 | + |
1409 | +plugin: user-interact-verify |
1410 | +category_id: suspend-dock-resume |
1411 | +id: dock/ethernet-after-suspend-dock-resume |
1412 | +depends: dock/suspend-dock-resume |
1413 | +command: network_check |
1414 | +estimated_duration: 10 |
1415 | +_description: |
1416 | + PURPOSE: |
1417 | + This test will check wired connection after suspend, undocked, docked, resume. |
1418 | + STEPS: |
1419 | + 1. Disable WiFi connection |
1420 | + 2. Click "Test" to verify that it's possible to establish a HTTP connection |
1421 | + VERIFICATION: |
1422 | + Did a notification show and was the connection correctly established? |
1423 | + |
1424 | +plugin: user-interact |
1425 | +id: dock/usb3-insert-after-suspend-dock-resume |
1426 | +category_id: suspend-dock-resume |
1427 | +depends: dock/suspend-dock-resume |
1428 | +estimated_duration: 10.0 |
1429 | +_summary: USB3 drive insertion test |
1430 | +command: removable_storage_watcher -m 500000000 insert usb |
1431 | +_purpose: |
1432 | + This test will check that the system correctly detects the insertion of |
1433 | + a USB 3.0 storage device after suspend, undocked, docked, resume. |
1434 | +_steps: |
1435 | + 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD, |
1436 | + in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may |
1437 | + be used it might cause performance related tests to fail. |
1438 | + (Note: this test will time-out after 20 seconds.) |
1439 | + 2. Do not unplug the device after the test. |
1440 | +_verification: |
1441 | + The verification of this test is automated. Do not change the |
1442 | + automatically selected result. |
1443 | + |
1444 | +plugin: shell |
1445 | +id: dock/usb3-storage-automated-after-suspend-dock-resume |
1446 | +category_id: suspend-dock-resume |
1447 | +depends: dock/usb3-insert-after-suspend-dock-resume |
1448 | +user: root |
1449 | +estimated_duration: 45.0 |
1450 | +_summary: USB3 drive storage test |
1451 | +command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd |
1452 | +_description: |
1453 | + This test is automated and executes after the dock/usb3_insert test is run. |
1454 | + |
1455 | +plugin: user-interact |
1456 | +id: dock/usb3-remove-after-suspend-dock-resume |
1457 | +category_id: suspend-dock-resume |
1458 | +depends: dock/usb3-insert-after-suspend-dock-resume |
1459 | +estimated_duration: 10.0 |
1460 | +_summary: USB3 drive removal test |
1461 | +command: removable_storage_watcher -m 500000000 remove usb |
1462 | +_purpose: |
1463 | + This test will check that the system correctly detects the removal of |
1464 | + a USB 3.0 storage device after suspend, undocked, docked, resume. |
1465 | +_steps: |
1466 | + 1. Click "Test" and remove the USB 3.0 device from the dock. |
1467 | + (Note: this test will time-out after 20 seconds.) |
1468 | +_verification: |
1469 | + The verification of this test is automated. Do not change the |
1470 | + automatically selected result. |
1471 | + |
1472 | +id: dock/monitor-displayport-after-suspend-dock-resume |
1473 | +category_id: suspend-dock-resume |
1474 | +depends: dock/suspend-dock-resume |
1475 | +estimated_duration: 120.0 |
1476 | +_summary: DisplayPort test on the dock |
1477 | +plugin: manual |
1478 | +_purpose: |
1479 | + This test will check the DisplayPort(s) on the dock after suspend, undocked, docked, resume. |
1480 | +_steps: |
1481 | + Skip this test if the dock does not have a DisplayPort. |
1482 | + 1. Connect a display (if not already connected) to the DisplayPort on the dock |
1483 | + 2. Repeat step 1 for each additional DisplayPorts, if any |
1484 | +_verification: |
1485 | + Was the desktop displayed correctly on both screens? |
1486 | + |
1487 | +id: dock/monitor-hdmi-after-suspend-dock-resume |
1488 | +category_id: suspend-dock-resume |
1489 | +depends: dock/suspend-dock-resume |
1490 | +estimated_duration: 120.0 |
1491 | +_summary: HDMI port test on the dock |
1492 | +plugin: manual |
1493 | +_purpose: |
1494 | + This test will check the HDMI port(s) on the dock after suspend, undocked, docked, resume. |
1495 | +_steps: |
1496 | + Skip this test if the dock does not have a HDMI port. |
1497 | + 1. Connect a display (if not already connected) to the HDMI port on the dock |
1498 | + 2. Repeat step 1 for each additional HDMI port, if any |
1499 | +_verification: |
1500 | + Was the desktop displayed correctly on both screens? |
Self-approved since most of this work has already been checked by Jerry and I in his previous MR [1]
[1] https:/ /code.launchpad .net/~jerry. kao/checkbox/ dock/+merge/ 305293