Merge lp:~pieq/checkbox/1624968-updated-docking-tests into lp:checkbox

Proposed by Pierre Equoy
Status: Merged
Approved by: Pierre Equoy
Approved revision: 4488
Merged at revision: 4502
Proposed branch: lp:~pieq/checkbox/1624968-updated-docking-tests
Merge into: lp:checkbox
Diff against target: 1500 lines (+959/-50)
1 file modified
providers/plainbox-provider-checkbox/units/dock.pxu (+959/-50)
To merge this branch: bzr merge lp:~pieq/checkbox/1624968-updated-docking-tests
Reviewer Review Type Date Requested Status
Pierre Equoy Approve
Review via email: mp+306054@code.launchpad.net

Description of the change

Updated docking tests.

This MR is based on Jerry's MR [1] with my inline comments taken into account.

1. add new test case dock/cold-plug
2. change depency from dock/docking to dock/cold-plug
3. modify dock/monitor-multi-head to test 4k monitors if it is supported.
4. rename dock/monitor-multi-head as dock/monitor-dual-head
5. add new test case dock/monitor-tripple-head
6. change dependancy of after suspend test cases from dock/suspend-dock-resume to suspend/suspend_advanced
7. add manual power button test case before and after suspend
8. add category ids
9. add type-c test cases (including storage and dispaly)
10.add mac address passthrougt test case
11.add hot-plug test suite
12.modify dock/suspend-dock-resume and test cases after suspend, undocked, docked, resume.
13.rename dock/audio-after-suspend as dock/audio-after-suspend-undock-resume
14.rename dock/record-playback-after-suspend as dock/record-playback-after-suspend-undock-resume

[1] https://code.launchpad.net/~jerry.kao/checkbox/dock/+merge/305293

To post a comment you must log in.
Revision history for this message
Pierre Equoy (pieq) wrote :

Self-approved since most of this work has already been checked by Jerry and I in his previous MR [1]

[1] https://code.launchpad.net/~jerry.kao/checkbox/dock/+merge/305293

review: Approve
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

There are additional revisions which have not been approved in review. Please seek review and approval of these new revisions.

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1=== modified file 'providers/plainbox-provider-checkbox/units/dock.pxu'
2--- providers/plainbox-provider-checkbox/units/dock.pxu 2015-05-13 07:33:44 +0000
3+++ providers/plainbox-provider-checkbox/units/dock.pxu 2016-09-19 03:13:16 +0000
4@@ -1,4 +1,37 @@
5+unit: category
6+id: dock
7+_name: Docking station tests
8+
9+unit: category
10+id: dock-display
11+_name: Docking station display tests
12+
13+unit: category
14+id: dock-audio
15+_name: Docking station audio tests
16+
17+unit: category
18+id: dock-network
19+_name: Docking station network tests
20+
21+unit: category
22+id: dock-usb
23+_name: Docking station usb tests
24+
25+unit: category
26+id: dock-hotplug
27+_name: Docking station hotplug tests
28+
29+unit: category
30+id: suspend-undock-resume
31+_name: Docking station functional tests after suspend, undocked, resume.
32+
33+unit: category
34+id: suspend-dock-resume
35+_name: Docking station functional tests after suspend, undocked, docked, resume.
36+
37 id: dock/docking
38+category_id: dock
39 plugin: manual
40 estimated_duration: 30.00
41 _summary: Docking test
42@@ -9,8 +42,37 @@
43 _verification:
44 Is the device working as expected after being docked?
45
46+id: dock/cold-plug
47+category_id: dock
48+plugin: manual
49+estimated_duration: 30.00
50+_summary: Docking test (cold plug)
51+_purpose:
52+ To ensure docking station is plugged before system boot up.
53+_steps:
54+ 1. shut down system.
55+ 2. plug in docking station.
56+ 3. boot up system.
57+_verification:
58+ Did the system boot up with docking station plugged in?
59+
60+id: dock/power-button
61+category_id: dock
62+depends: dock/cold-plug
63+plugin: manual
64+estimated_duration: 30.00
65+_summary: Docking test
66+_purpose:
67+ This test will test the power button on docking station
68+_steps:
69+ Skip this test if your docking station has no power button.
70+ 1. press the power button on docking station.
71+_verification:
72+ Did the power management prompt pop up?
73+
74 id: dock/monitor-displayport
75-depends: dock/docking
76+category_id: dock-display
77+depends: dock/cold-plug
78 estimated_duration: 120.0
79 _summary: DisplayPort test on the dock
80 plugin: manual
81@@ -24,7 +86,8 @@
82 Was the desktop displayed correctly on both screens?
83
84 id: dock/monitor-dvi
85-depends: dock/docking
86+category_id: dock-display
87+depends: dock/cold-plug
88 estimated_duration: 120.0
89 _summary: DVI port test on the dock
90 plugin: manual
91@@ -38,7 +101,8 @@
92 Was the desktop displayed correctly on both screens?
93
94 id: dock/monitor-hdmi
95-depends: dock/docking
96+category_id: dock-display
97+depends: dock/cold-plug
98 estimated_duration: 120.0
99 _summary: HDMI port test on the dock
100 plugin: manual
101@@ -52,7 +116,8 @@
102 Was the desktop displayed correctly on both screens?
103
104 id: dock/monitor-vga
105-depends: dock/docking
106+category_id: dock-display
107+depends: dock/cold-plug
108 estimated_duration: 120.0
109 _summary: VGA port test on the dock
110 plugin: manual
111@@ -65,15 +130,70 @@
112 _verification:
113 Was the desktop displayed correctly on both screens?
114
115-id: dock/monitor-multi-head
116-depends: dock/docking
117+id: dock/monitor_type-c_displayport
118+category_id: dock-display
119+depends: dock/cold-plug
120+estimated_duration: 120
121+plugin: manual
122+_summary: Display connected via DisplayPort using an USB Type-C port
123+_purpose:
124+ This test will check the connection of a screen using a "USB Type-C to DisplayPort" adapter.
125+_steps:
126+ Skip this test if the dock does not have a USB Type-C port.
127+ 1. Connect a display (if not already connected) to the USB Type-C port on
128+ your system using a "USB Type-C to DisplayPort" adapter
129+ 2. Switch display modes between in your Display Settings, check if it can be
130+ set to mirrored, extended, displayed on external or onboard only
131+_verification:
132+ Was the desktop displayed correctly on the screen connected
133+ using a "USB Type-C to DisplayPort" adapter in every mode?
134+
135+id: dock/monitor_type-c_hdmi
136+category_id: dock-display
137+depends: dock/cold-plug
138+estimated_duration: 120
139+plugin: manual
140+_summary: Display connected via HDMI using an USB Type-C port
141+_purpose:
142+ This test will check the connection of a screen using a "USB Type-C to HDMI" adapter.
143+_steps:
144+ Skip this test if the dock does not have a USB Type-C port.
145+ 1. Connect a display (if not already connected) to the USB Type-C port on
146+ your system using a "USB Type-C to HDMI" adapter
147+ 2. Switch display modes between in your Display Settings, check if it can be
148+ set to mirrored, extended, displayed on external or onboard only
149+_verification:
150+ Was the desktop displayed correctly on the screen connected
151+ using a "USB Type-C to HDMI" adapter in every mode?
152+
153+id: dock/monitor_type-c_vga
154+category_id: dock-display
155+depends: dock/cold-plug
156+estimated_duration: 120
157+plugin: manual
158+_summary: Display connected via VGA using an USB Type-C port
159+_purpose:
160+ This test will check the connection of a screen using a "USB Type-C to VGA" adapter.
161+_steps:
162+ Skip this test if the dock does not have a USB Type-C port.
163+ 1. Connect a display (if not already connected) to the USB Type-C port on
164+ your system using a "USB Type-C to VGA" adapter
165+ 2. Switch display modes between in your Display Settings, check if it can be
166+ set to mirrored, extended, displayed on external or onboard only
167+_verification:
168+ Was the desktop displayed correctly on the screen connected
169+ using a "USB Type-C to VGA" adapter in every mode?
170+
171+id: dock/monitor-dual-head
172+category_id: dock-display
173+depends: dock/cold-plug
174 estimated_duration: 120.0
175-_summary: Multiple monitors test while docked
176+_summary: Dual monitors test while docked
177 plugin: manual
178 _purpose:
179- This test verifies that multi-monitor output works using the dock. You will need at least two external monitors to perform this test.
180+ This test verifies that dual-monitor output works using the dock. You will need two external monitors to perform this test.
181 _steps:
182- Skip this test if your video card or the dock do not support multiple monitors.
183+ Skip this test if your video card or the dock do not support multiple monitors. Use 4K monitors to run this test if the video card and dock both support.
184 1. If your dock provides more than one monitor outputs, connect two monitors
185 2. Open the "Displays" tool (open the dash and search for "Displays")
186 3. Configure your output to provide one desktop across all the monitors
187@@ -81,8 +201,27 @@
188 _verification:
189 Was the stretched desktop displayed correctly across all the screens?
190
191+id: dock/monitor-tripple-head
192+category_id: dock-display
193+depends: dock/cold-plug
194+estimated_duration: 120.0
195+_summary: Tripple monitors test while docked
196+plugin: manual
197+_purpose:
198+ This test verifies that tripple-monitor output works using the dock. You will need three external monitors to perform this test.
199+_steps:
200+ Skip this test if your video card or the dock do not support multiple monitors.
201+ 1. If your dock provides more than one monitor outputs, connect three monitors
202+ 2. Open the "Displays" tool (open the dash and search for "Displays")
203+ 3. Turn off internal monitor
204+ 4. Configure your output to provide one desktop across all the monitors
205+ 5. Open any application and drag its window from one monitor to the next.
206+_verification:
207+ Was the stretched desktop displayed correctly across all the screens?
208+
209 id: dock/keys-video-out
210-depends: dock/docking
211+category_id: dock-display
212+depends: dock/cold-plug
213 estimated_duration: 120.0
214 _summary: Video Out hotkey test
215 plugin: manual
216@@ -98,9 +237,10 @@
217
218 plugin: shell
219 id: dock/audio-list-devices
220+category_id: dock-audio
221 estimated_duration: 1.0
222 _summary: List audio devices
223-depends: dock/docking
224+depends: dock/cold-plug
225 requires:
226 device.category == 'AUDIO'
227 package.name == 'alsa-base'
228@@ -108,7 +248,8 @@
229 _description: Test to detect audio devices
230
231 id: dock/audio-playback-hdmi
232-depends: dock/docking
233+category_id: dock-audio
234+depends: dock/cold-plug
235 requires:
236 device.category == 'AUDIO'
237 package.name == 'alsa-base'
238@@ -134,7 +275,8 @@
239 Did you hear the sound from the HDMI device?
240
241 id: dock/audio-playback-displayport
242-depends: dock/docking
243+category_id: dock-audio
244+depends: dock/cold-plug
245 requires:
246 device.category == 'AUDIO'
247 package.name == 'alsa-base'
248@@ -160,6 +302,7 @@
249 Did you hear the sound from the DisplayPort device?
250
251 id: dock/audio-playback-headphones
252+category_id: dock-audio
253 plugin: user-interact-verify
254 estimated_duration: 30.0
255 _summary: Headphones output test
256@@ -186,6 +329,7 @@
257 Did you hear a sound through the headphones and did the sound play without any distortion, clicks or other strange noises from your headphones?
258
259 plugin: user-interact-verify
260+category_id: dock-audio
261 id: dock/audio-alsa-record-playback-external
262 estimated_duration: 30.0
263 _summary: External microphone plugged to the dock to record sound test
264@@ -214,9 +358,10 @@
265
266 plugin: shell
267 id: dock/audio-alsa-info-collect
268+category_id: dock-audio
269 estimated_duration: 2.0
270 _summary: Collect audio-related system information
271-depends: dock/docking
272+depends: dock/cold-plug
273 command: alsa_info --no-dialog --no-upload --output ${PLAINBOX_SESSION_SHARE}/alsa_info.log
274 _description:
275 Collect audio-related system information. This data can be used to
276@@ -225,6 +370,7 @@
277
278 plugin: attachment
279 id: dock/audio-alsa-info-attachment
280+category_id: dock-audio
281 depends: dock/audio-alsa-info-collect
282 estimated_duration: 1.0
283 _summary: Attach audio hardware data log to results
284@@ -234,7 +380,8 @@
285
286 plugin: manual
287 id: dock/audio-external-lineout
288-depends: dock/docking
289+category_id: dock-audio
290+depends: dock/cold-plug
291 estimated_duration: 30.0
292 _summary: Line-out connection test
293 _purpose:
294@@ -250,7 +397,8 @@
295
296 plugin: user-interact-verify
297 id: dock/audio-external-linein
298-depends: dock/docking
299+category_id: dock-audio
300+depends: dock/cold-plug
301 estimated_duration: 120.0
302 _summary: Line-in connection test
303 requires:
304@@ -276,8 +424,9 @@
305 Did you hear your recording?
306
307 id: dock/audio-speaker-headphone-plug-detection
308+category_id: dock-audio
309 plugin: user-interact
310-depends: dock/docking
311+depends: dock/cold-plug
312 estimated_duration: 60.0
313 _summary: Headphones recognized when plugged to the dock test
314 requires:
315@@ -298,8 +447,9 @@
316 The test times out after 30 seconds (and fails in that case).
317
318 id: dock/audio-microphone-plug-detection
319+category_id: dock-audio
320 plugin: user-interact
321-depends: dock/docking
322+depends: dock/cold-plug
323 estimated_duration: 60.0
324 _summary: Microphone recognized when plugged to the dock test
325 requires:
326@@ -324,7 +474,8 @@
327
328 id: dock/networking-gateway-ping
329 plugin: user-interact-verify
330-depends: dock/docking ethernet/detect
331+category_id: dock-network
332+depends: dock/cold-plug ethernet/detect
333 command: gateway_ping_test
334 estimated_duration: 10.00
335 _summary: Ping test using dock's Ethernet connectivity
336@@ -338,8 +489,9 @@
337 Was the test able to ping the network using the Ethernet connection?
338
339 id: dock/networking-ntp
340+category_id: dock-network
341 plugin: user-interact-verify
342-depends: dock/docking
343+depends: dock/cold-plug
344 requires: package.name == 'ntpdate'
345 user: root
346 command: network_ntp_test
347@@ -354,10 +506,28 @@
348 _verification:
349 Was the test able to synchronize system time using the Ethernet connection?
350
351+id: dock/mac-address-pass-through
352+category_id: dock-network
353+plugin: manual
354+depends: dock/cold-plug
355+estimated_duration: 60
356+_summary: MAC address pass through function test
357+_purpose:
358+ Test MAC address pass through function with docking station (Dell Dock specific function, TB15, WD15)
359+_steps:
360+ Skip this test if your docking station does not support MAC address pass through.
361+ 1. Make sure the dock is connected to network using an Ethernet cable
362+ 2. Run 'ifconfig' to get system specific MAC address and IP
363+ 3. Ping the IP address from another system
364+ 4. Run 'arp -a IP' from another system to get the MAC address of the test unit through dock
365+_verification:
366+ Is the MAC address got from arp matching with specific MAC address?
367+
368 ### USB Tests ###
369
370 plugin: user-interact-verify
371 id: dock/usb-HID
372+category_id: dock-usb
373 estimated_duration: 20.0
374 _summary: USB HID device test
375 command: keyboard_test
376@@ -372,6 +542,7 @@
377
378 plugin: user-interact
379 id: dock/usb-insert
380+category_id: dock-usb
381 estimated_duration: 10.0
382 _summary: USB drive insertion test
383 command: removable_storage_watcher insert usb
384@@ -391,6 +562,7 @@
385
386 plugin: user-interact
387 id: dock/usb3-insert
388+category_id: dock-usb
389 estimated_duration: 10.0
390 _summary: USB3 drive insertion test
391 command: removable_storage_watcher -m 500000000 insert usb
392@@ -409,6 +581,7 @@
393
394 plugin: user-interact
395 id: dock/usb-remove
396+category_id: dock-usb
397 depends: dock/usb-insert
398 estimated_duration: 10.0
399 _summary: USB drive removal test
400@@ -425,6 +598,7 @@
401
402 plugin: user-interact
403 id: dock/usb3-remove
404+category_id: dock-usb
405 depends: dock/usb3-insert
406 estimated_duration: 10.0
407 _summary: USB3 drive removal test
408@@ -441,6 +615,7 @@
409
410 plugin: shell
411 id: dock/usb-storage-automated
412+category_id: dock-usb
413 depends: dock/usb-insert
414 user: root
415 estimated_duration: 45.0
416@@ -451,6 +626,7 @@
417
418 plugin: shell
419 id: dock/usb3-storage-automated
420+category_id: dock-usb
421 depends: dock/usb3-insert
422 user: root
423 estimated_duration: 45.0
424@@ -459,20 +635,364 @@
425 _description:
426 This test is automated and executes after the dock/usb3_insert test is run.
427
428+### USB-C tests ###
429+
430+plugin: user-interact
431+category_id: dock-usb
432+id: dock/usb-c/c-to-a-adapter/insert
433+imports: from 2013.com.canonical.plainbox import manifest
434+requires:
435+ usb.usb3 == 'supported'
436+ manifest.has_usb_type_c == 'True'
437+estimated_duration: 10.0
438+command: removable_storage_watcher -m 500000000 insert usb
439+_purpose:
440+ This test will check that the system correctly detects the insertion of
441+ a USB 3 storage device in a USB Type-C connector on the dock using a
442+ "Type-C to Type-A" adapter
443+_steps:
444+ 1. Click "Test" and insert a USB 3 storage device in a USB Type-C port
445+ on the dock using a "USB Type-C to Type-A" adapter.
446+ (Note: this test will time-out after 20 seconds.)
447+ 2. Do not unplug the device after the test.
448+_verification:
449+ The verification of this test is automated. Do not change the
450+ automatically selected result.
451+
452+plugin: user-interact
453+category_id: dock-usb
454+id: dock/usb-c/insert
455+imports: from 2013.com.canonical.plainbox import manifest
456+requires:
457+ usb.usb3 == 'supported'
458+ manifest.has_usb_type_c == 'True'
459+estimated_duration: 10.0
460+command: removable_storage_watcher -m 500000000 insert usb
461+_purpose:
462+ This test will check that the system correctly detects the insertion of
463+ a USB 3 storage device in a USB Type-C connector on the dock
464+_steps:
465+ 1. Click "Test" and insert a USB 3 storage device in a USB Type-C port
466+ on the dock.
467+ (Note: this test will time-out after 20 seconds.)
468+ 2. Do not unplug the device after the test.
469+_verification:
470+ The verification of this test is automated. Do not change the
471+ automatically selected result.
472+
473+plugin: user-interact
474+category_id: dock-usb
475+id: dock/usb-c/c-to-a-adapter/remove
476+imports: from 2013.com.canonical.plainbox import manifest
477+depends: dock/usb-c/c-to-a-adapter/insert
478+requires:
479+ usb.usb3 == 'supported'
480+ manifest.has_usb_type_c == 'True'
481+estimated_duration: 10.0
482+command: removable_storage_watcher -m 500000000 remove usb
483+_purpose:
484+ This test will check that the system correctly detects the removal of
485+ a USB 3 storage device connected to a USB Type-C port using a "USB Type-C
486+ to Type-A" adapter.
487+_steps:
488+ 1. Click "Test" and remove the USB 3 device.
489+ (Note: this test will time-out after 20 seconds.)
490+_verification:
491+ The verification of this test is automated. Do not change the
492+ automatically selected result.
493+
494+plugin: user-interact
495+category_id: dock-usb
496+id: dock/usb-c/remove
497+imports: from 2013.com.canonical.plainbox import manifest
498+depends: dock/usb-c/insert
499+requires:
500+ usb.usb3 == 'supported'
501+ manifest.has_usb_type_c == 'True'
502+estimated_duration: 10.0
503+command: removable_storage_watcher -m 500000000 remove usb
504+_purpose:
505+ This test will check that the system correctly detects the removal of
506+ a USB 3 storage device connected to a USB Type-C port.
507+_steps:
508+ 1. Click "Test" and remove the USB 3 device.
509+ (Note: this test will time-out after 20 seconds.)
510+_verification:
511+ The verification of this test is automated. Do not change the
512+ automatically selected result.
513+
514+plugin: shell
515+category_id: dock-usb
516+id: dock/usb-c/c-to-a-adapter/storage-automated
517+imports: from 2013.com.canonical.plainbox import manifest
518+requires:
519+ usb.usb3 == 'supported'
520+ manifest.has_usb_type_c == 'True'
521+depends: dock/usb-c/c-to-a-adapter/insert
522+user: root
523+estimated_duration: 45.0
524+command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
525+_description:
526+ This test is automated and executes after the usb-c/c-to-a-adapter/insert test
527+ is run.
528+
529+plugin: shell
530+category_id: dock-usb
531+id: dock/usb-c/storage-automated
532+imports: from 2013.com.canonical.plainbox import manifest
533+requires:
534+ usb.usb3 == 'supported'
535+ manifest.has_usb_type_c == 'True'
536+depends: dock/usb-c/insert
537+user: root
538+estimated_duration: 45.0
539+command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
540+_description:
541+ This test is automated and executes after the usb-c/insert test
542+ is run.
543+
544+plugin: user-interact
545+category_id: dock-usb
546+id: dock/usb-c/c-to-a-adapter/insert-after-suspend
547+depends: suspend/suspend_advanced
548+imports: from 2013.com.canonical.plainbox import manifest
549+requires:
550+ usb.usb3 == 'supported'
551+ manifest.has_usb_type_c == 'True'
552+estimated_duration: 10.0
553+command: removable_storage_watcher -m 500000000 insert usb
554+_purpose:
555+ This test will check that the system correctly detects the insertion of
556+ a USB 3 storage device in a USB Type-C connector on the dock using a
557+ "Type-C to Type-A" adapter after suspend
558+_steps:
559+ 1. Click "Test" and insert a USB 3 storage device in a USB Type-C port on
560+ the dock using a "USB Type-C to Type-A" adapter.
561+ (Note: this test will time-out after 20 seconds.)
562+ 2. Do not unplug the device after the test.
563+_verification:
564+ The verification of this test is automated. Do not change the
565+ automatically selected result.
566+
567+plugin: user-interact
568+category_id: dock-usb
569+id: dock/usb-c/insert-after-suspend
570+depends: suspend/suspend_advanced
571+imports: from 2013.com.canonical.plainbox import manifest
572+requires:
573+ usb.usb3 == 'supported'
574+ manifest.has_usb_type_c == 'True'
575+estimated_duration: 10.0
576+command: removable_storage_watcher -m 500000000 insert usb
577+_purpose:
578+ This test will check that the system correctly detects the insertion of
579+ a USB 3 storage device in a USB Type-C connector on the dock after suspend
580+_steps:
581+ 1. Click "Test" and insert a USB 3 storage device in a USB Type-C port
582+ on the dock.
583+ (Note: this test will time-out after 20 seconds.)
584+ 2. Do not unplug the device after the test.
585+_verification:
586+ The verification of this test is automated. Do not change the
587+ automatically selected result.
588+
589+plugin: user-interact
590+category_id: dock-usb
591+id: dock/usb-c/c-to-a-adapter/remove-after-suspend
592+imports: from 2013.com.canonical.plainbox import manifest
593+depends: dock/usb-c/c-to-a-adapter/insert-after-suspend
594+requires:
595+ usb.usb3 == 'supported'
596+ manifest.has_usb_type_c == 'True'
597+estimated_duration: 10.0
598+command: removable_storage_watcher -m 500000000 remove usb
599+_purpose:
600+ This test will check that the system correctly detects the removal of
601+ a USB 3 storage device connected to a USB Type-C port using a "USB Type-C
602+ to Type-A" adapter after suspend.
603+_steps:
604+ 1. Click "Test" and remove the USB 3 device.
605+ (Note: this test will time-out after 20 seconds.)
606+_verification:
607+ The verification of this test is automated. Do not change the
608+ automatically selected result.
609+
610+plugin: user-interact
611+category_id: dock-usb
612+id: dock/usb-c/remove-after-suspend
613+imports: from 2013.com.canonical.plainbox import manifest
614+depends: dock/usb-c/insert-after-suspend
615+requires:
616+ usb.usb3 == 'supported'
617+ manifest.has_usb_type_c == 'True'
618+estimated_duration: 10.0
619+command: removable_storage_watcher -m 500000000 remove usb
620+_purpose:
621+ This test will check that the system correctly detects the removal of
622+ a USB 3 storage device connected to a USB Type-C port after suspend.
623+_steps:
624+ 1. Click "Test" and remove the USB 3 device.
625+ (Note: this test will time-out after 20 seconds.)
626+_verification:
627+ The verification of this test is automated. Do not change the
628+ automatically selected result.
629+
630+plugin: shell
631+category_id: dock-usb
632+id: dock/usb-c/c-to-a-adapter/storage-automated-after-suspend
633+imports: from 2013.com.canonical.plainbox import manifest
634+requires:
635+ usb.usb3 == 'supported'
636+ manifest.has_usb_type_c == 'True'
637+depends: dock/usb-c/c-to-a-adapter/insert
638+user: root
639+estimated_duration: 45.0
640+command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
641+_description:
642+ This test is automated and executes after the usb-c/c-to-a-adapter/insert test
643+ is run.
644+
645+plugin: shell
646+category_id: dock-usb
647+id: dock/usb-c/storage-automated-after-suspend
648+imports: from 2013.com.canonical.plainbox import manifest
649+requires:
650+ usb.usb3 == 'supported'
651+ manifest.has_usb_type_c == 'True'
652+depends: dock/usb-c/insert
653+user: root
654+estimated_duration: 45.0
655+command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
656+_description:
657+ This test is automated and executes after the usb-c/insert test
658+ is run.
659+
660 ### ACPI ###
661
662 id: dock/battery-charging
663+category_id: dock
664 _summary: Battery charging when docked test
665 plugin: shell
666-depends: dock/docking
667+depends: dock/cold-plug
668 estimated_duration: 1.0
669 command:
670 if [ "`upower -i /org/freedesktop/UPower/devices/battery_BAT0 | grep "state" | awk '{print $2}'`" = "discharging" ] ; then exit 1 ; fi
671 _description:
672 This test will make sure the laptop is being charged while connected to the dock.
673
674+### Hot Plug ###
675+
676+id: dock/hot-plug
677+category_id: dock-hotplug
678+plugin: manual
679+estimated_duration: 30.00
680+_summary: Docking test
681+_purpose:
682+ This test will check the device can be used after docking.
683+_steps:
684+ 1. Unplug docking station.
685+ 2. Replug in docking station.
686+_verification:
687+ Is the system working with problem (e.g. system hang) after docking station hot plugged in?
688+
689+plugin: user-interact-verify
690+category_id: dock-hotplug
691+id: dock/hotplug-ethernet
692+depends: dock/hot-plug
693+command: network_check
694+estimated_duration: 10
695+_description:
696+ PURPOSE:
697+ This test will check wired connection after hotplug
698+ STEPS:
699+ 1. Disable WiFi connection
700+ 2. Click "Test" to verify that it's possible to establish a HTTP connection
701+ VERIFICATION:
702+ Did a notification show and was the connection correctly established?
703+
704+plugin: user-interact
705+id: dock/hotplug-usb3-insert
706+category_id: dock-hotplug
707+depends: dock/hot-plug
708+estimated_duration: 10.0
709+_summary: USB3 drive insertion test
710+command: removable_storage_watcher -m 500000000 insert usb
711+_purpose:
712+ This test will check that the system correctly detects the insertion of
713+ a USB 3.0 storage device after dock hot plugged in
714+_steps:
715+ 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD,
716+ in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may
717+ be used it might cause performance related tests to fail.
718+ (Note: this test will time-out after 20 seconds.)
719+ 2. Do not unplug the device after the test.
720+_verification:
721+ The verification of this test is automated. Do not change the
722+ automatically selected result.
723+
724+plugin: shell
725+id: dock/hotplug-usb3-storage-automated
726+category_id: dock-hotplug
727+depends: dock/hotplug-usb3-insert
728+user: root
729+estimated_duration: 45.0
730+_summary: USB3 drive storage test
731+command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
732+_description:
733+ This test is automated and executes after the dock/usb3_insert test is run.
734+
735+plugin: user-interact
736+id: dock/hotplug-usb3-remove
737+category_id: dock-hotplug
738+depends: dock/hotplug-usb3-insert
739+estimated_duration: 10.0
740+_summary: USB3 drive removal test
741+command: removable_storage_watcher -m 500000000 remove usb
742+_purpose:
743+ This test will check that the system correctly detects the removal of
744+ a USB 3.0 storage device after dock hot plugged in
745+_steps:
746+ 1. Click "Test" and remove the USB 3.0 device from the dock.
747+ (Note: this test will time-out after 20 seconds.)
748+_verification:
749+ The verification of this test is automated. Do not change the
750+ automatically selected result.
751+
752+id: dock/hotplug-monitor-displayport
753+category_id: dock-hotplug
754+depends: dock/hot-plug
755+estimated_duration: 120.0
756+_summary: DisplayPort test on the dock
757+plugin: manual
758+_purpose:
759+ This test will check the DisplayPort(s) on the dock after hot plugged in.
760+_steps:
761+ Skip this test if the dock does not have a DisplayPort.
762+ 1. Connect a display (if not already connected) to the DisplayPort on the dock
763+ 2. Repeat step 1 for each additional DisplayPorts, if any
764+_verification:
765+ Was the desktop displayed correctly on both screens?
766+
767+id: dock/hotplug-monitor-hdmi
768+category_id: dock-hotplug
769+depends: dock/hot-plug
770+estimated_duration: 120.0
771+_summary: HDMI port test on the dock
772+plugin: manual
773+_purpose:
774+ This test will check the HDMI port(s) on the dock after hot plugged in.
775+_steps:
776+ Skip this test if the dock does not have a HDMI port.
777+ 1. Connect a display (if not already connected) to the HDMI port on the dock
778+ 2. Repeat step 1 for each additional HDMI port, if any
779+_verification:
780+ Was the desktop displayed correctly on both screens?
781+
782+### Network ###
783+
784 plugin: shell
785 id: dock/network-before-suspend
786+category_id: dock-network
787 depends: ethernet/detect
788 estimated_duration: 1.2
789 _summary: Network status before suspend
790@@ -481,6 +1001,7 @@
791
792 plugin: shell
793 id: dock/audio-before-suspend
794+category_id: dock-audio
795 estimated_duration: 1.0
796 _summary: Audio status before suspend
797 requires:
798@@ -489,23 +1010,12 @@
799 _description: Record mixer settings before suspending.
800 command: audio_settings store --file=$PLAINBOX_SESSION_SHARE/audio_settings_before_suspend
801
802-id: dock/suspend-dock-resume
803-plugin: manual
804-estimated_duration: 120.00
805-_summary: Suspend the device, dock it and resume it
806-_purpose:
807- This test will check the device can be suspended, docked and resumed properly
808-_steps:
809- 1. If the laptop is currently docked, undock it now
810- 2. Suspend the laptop (e.g. by closing its lid)
811- 3. Dock the laptop
812- 4. Resume the laptop (e.g. by pressing the Power button on the dock)
813-_verification:
814- Is the device working as expected after being docked and resumed?
815+
816
817 id: dock/networking-gateway-ping-after-suspend
818+category_id: dock-network
819 plugin: shell
820-depends: dock/suspend-dock-resume ethernet/detect
821+depends: suspend/suspend_advanced ethernet/detect
822 command: gateway_ping_test
823 estimated_duration: 2.00
824 _summary: Network gateway ping after suspend
825@@ -513,7 +1023,8 @@
826
827 plugin: user-interact
828 id: dock/usb-insert-after-suspend
829-depends: dock/suspend-dock-resume
830+category_id: dock-usb
831+depends: suspend/suspend_advanced
832 estimated_duration: 10.0
833 _summary: USB drive insertion after resuming
834 command: removable_storage_watcher insert usb
835@@ -531,9 +1042,24 @@
836 The verification of this test is automated. Do not change the
837 automatically selected result.
838
839+id: dock/power-button-after-suspend
840+category_id: dock
841+depends: suspend/suspend_advanced
842+plugin: manual
843+estimated_duration: 30.00
844+_summary: Docking test
845+_purpose:
846+ This test will test the power button on docking station after suspend
847+_steps:
848+ Skip this test if your docking station has no power button.
849+ 1. press the power button on docking station.
850+_verification:
851+ Did the power management prompt pop up?
852+
853 plugin: user-interact
854 id: dock/usb3-insert-after-suspend
855-depends: dock/suspend-dock-resume
856+category_id: dock-usb
857+depends: suspend/suspend_advanced
858 estimated_duration: 10.0
859 _summary: USB3 drive insertion after resuming
860 command: removable_storage_watcher -m 500000000 insert usb
861@@ -552,6 +1078,7 @@
862
863 plugin: user-interact
864 id: dock/usb-remove-after-suspend
865+category_id: dock-usb
866 depends: dock/usb-insert-after-suspend
867 estimated_duration: 10.0
868 _summary: USB drive removal after resuming
869@@ -568,6 +1095,7 @@
870
871 plugin: user-interact
872 id: dock/usb3-remove-after-suspend
873+category_id: dock-usb
874 depends: dock/usb3-insert-after-suspend
875 estimated_duration: 10.0
876 _summary: USB3 drive removal after resuming
877@@ -584,6 +1112,7 @@
878
879 plugin: shell
880 id: dock/usb-storage-automated-after-suspend
881+category_id: dock-usb
882 depends: dock/usb-insert-after-suspend
883 user: root
884 estimated_duration: 45.0
885@@ -594,6 +1123,7 @@
886
887 plugin: shell
888 id: dock/usb3-storage-automated-after-suspend
889+category_id: dock-usb
890 depends: dock/usb3-insert-after-suspend
891 user: root
892 estimated_duration: 45.0
893@@ -604,7 +1134,8 @@
894
895 plugin: user-interact-verify
896 id: dock/usb-HID-after-suspend
897-depends: dock/suspend-dock-resume
898+category_id: dock-usb
899+depends: suspend/suspend_advanced
900 estimated_duration: 20.0
901 _summary: USB HID device test after resuming
902 command: keyboard_test
903@@ -618,7 +1149,8 @@
904 Did the device work as expected?
905
906 id: dock/monitor-displayport-after-suspend
907-depends: dock/suspend-dock-resume
908+category_id: dock-display
909+depends: suspend/suspend_advanced
910 estimated_duration: 120.0
911 _summary: DisplayPort test on the dock after resuming
912 plugin: manual
913@@ -632,7 +1164,8 @@
914 Was the desktop displayed correctly on both screens?
915
916 id: dock/monitor-dvi-after-suspend
917-depends: dock/suspend-dock-resume
918+category_id: dock-display
919+depends: suspend/suspend_advanced
920 estimated_duration: 120.0
921 _summary: DVI port test on the dock after resuming
922 plugin: manual
923@@ -646,7 +1179,8 @@
924 Was the desktop displayed correctly on both screens?
925
926 id: dock/monitor-hdmi-after-suspend
927-depends: dock/suspend-dock-resume
928+category_id: dock-display
929+depends: suspend/suspend_advanced
930 estimated_duration: 120.0
931 _summary: HDMI port test on the dock after resuming
932 plugin: manual
933@@ -660,7 +1194,8 @@
934 Was the desktop displayed correctly on both screens?
935
936 id: dock/monitor-vga-after-suspend
937-depends: dock/suspend-dock-resume
938+category_id: dock-display
939+depends: suspend/suspend_advanced
940 estimated_duration: 120.0
941 _summary: VGA port test on the dock after resuming
942 plugin: manual
943@@ -673,7 +1208,64 @@
944 _verification:
945 Was the desktop displayed correctly on both screens?
946
947+id: dock/monitor_type-c_displayport-after-suspend
948+category_id: dock-display
949+depends: suspend/suspend_advanced
950+estimated_duration: 120
951+plugin: manual
952+_summary: Display connected via DisplayPort using an USB Type-C port after resuming
953+_purpose:
954+ This test will check the connection of a screen using a "USB Type-C to DisplayPort" adapter after resuming.
955+_steps:
956+ Skip this test if the dock does not have a USB Type-C port.
957+ 1. Connect a display (if not already connected) to the USB Type-C port on
958+ your system using a "USB Type-C to DisplayPort" adapter
959+ 2. Switch display modes between in your Display Settings, check if it can be
960+ set to mirrored, extended, displayed on external or onboard only
961+_verification:
962+ Was the desktop displayed correctly on the screen connected
963+ using a "USB Type-C to DisplayPort" adapter in every mode?
964+
965+id: dock/monitor_type-c_hdmi-after-suspend
966+category_id: dock-display
967+depends: suspend/suspend_advanced
968+estimated_duration: 120
969+plugin: manual
970+_summary: Display connected via HDMI using an USB Type-C port after resuming
971+_purpose:
972+ This test will check the connection of a screen using a "USB Type-C to HDMI" adapter after resuming.
973+_steps:
974+ Skip this test if the dock does not have a USB Type-C port.
975+ 1. Connect a display (if not already connected) to the USB Type-C port on
976+ your system using a "USB Type-C to HDMI" adapter
977+ 2. Switch display modes between in your Display Settings, check if it can be
978+ set to mirrored, extended, displayed on external or onboard only
979+_verification:
980+ Was the desktop displayed correctly on the screen connected
981+ using a "USB Type-C to HDMI" adapter in every mode?
982+
983+id: dock/monitor_type-c_vga-after-suspend
984+category_id: dock-display
985+depends: suspend/suspend_advanced
986+estimated_duration: 120
987+plugin: manual
988+_summary: Display connected via VGA using an USB Type-C port after resuming
989+_purpose:
990+ This test will check the connection of a screen using a "USB Type-C to VGA" adapter after resuming.
991+_steps:
992+ Skip this test if the dock does not have a USB Type-C port.
993+ 1. Connect a display (if not already connected) to the USB Type-C port on
994+ your system using a "USB Type-C to VGA" adapter
995+ 2. Switch display modes between in your Display Settings, check if it can be
996+ set to mirrored, extended, displayed on external or onboard only
997+_verification:
998+ Was the desktop displayed correctly on the screen connected
999+ using a "USB Type-C to VGA" adapter in every mode?
1000+
1001+### Suspend, Undocked, Resume ###
1002+
1003 id: dock/suspend-undock-resume
1004+category_id: suspend-undock-resume
1005 plugin: manual
1006 estimated_duration: 120.00
1007 _summary: Suspend the device, undock it and resume it
1008@@ -684,11 +1276,13 @@
1009 2. Suspend the laptop (e.g. by closing its lid)
1010 3. Undock the laptop
1011 4. Resume the laptop (e.g. by pressing its Power button)
1012+ 5. Enable wireless if it was disabled
1013 _verification:
1014 Is the device working as expected after being undocked and resumed?
1015
1016 plugin: shell
1017 id: dock/wireless-connection-after-suspend-wpa-bg
1018+category_id: suspend-undock-resume
1019 depends: dock/suspend-undock-resume
1020 estimated_duration: 20.0
1021 _summary: Wireless connection after suspend (WPA BG)
1022@@ -712,6 +1306,7 @@
1023
1024 plugin: shell
1025 id: dock/wireless-connection-after-suspend-open-bg
1026+category_id: suspend-undock-resume
1027 depends: dock/suspend-undock-resume
1028 estimated_duration: 1.2
1029 _summary: Wireless connection after suspend (Open BG)
1030@@ -735,6 +1330,7 @@
1031
1032 plugin: shell
1033 id: dock/wireless-connection-after-suspend-wpa-n
1034+category_id: suspend-undock-resume
1035 depends: dock/suspend-undock-resume
1036 estimated_duration: 1.2
1037 _summary: Wireless connection after suspend (WPA N)
1038@@ -758,6 +1354,7 @@
1039
1040 plugin: shell
1041 id: dock/wireless-connection-after-suspend-open-n
1042+category_id: suspend-undock-resume
1043 depends: dock/suspend-undock-resume
1044 estimated_duration: 1.2
1045 _summary: Wireless connection after suspend (Open N)
1046@@ -781,6 +1378,7 @@
1047
1048 plugin: shell
1049 id: dock/wireless-connection-after-suspend-wpa-ac
1050+category_id: suspend-undock-resume
1051 depends: dock/suspend-undock-resume
1052 estimated_duration: 1.2
1053 _summary: Wireless connection after suspend (WPA AC)
1054@@ -805,6 +1403,7 @@
1055
1056 plugin: shell
1057 id: dock/wireless-connection-after-suspend-open-ac
1058+category_id: suspend-undock-resume
1059 depends: dock/suspend-undock-resume
1060 estimated_duration: 1.2
1061 _summary: Wireless connection after suspend (Open AC)
1062@@ -828,7 +1427,8 @@
1063 security and the 802.11ac protocol after the system has been suspended.
1064
1065 plugin: shell
1066-id: dock/audio-after-suspend
1067+id: dock/audio-after-suspend-undock-resume
1068+category_id: dock-audio
1069 estimated_duration: 1.0
1070 _summary: Audio after resuming test
1071 requires:
1072@@ -841,7 +1441,8 @@
1073 diff $PLAINBOX_SESSION_SHARE/audio_settings_before_suspend $PLAINBOX_SESSION_SHARE/audio_settings_after_suspend
1074
1075 plugin: shell
1076-id: dock/record-playback-after-suspend
1077+id: dock/record-playback-after-suspend-undock-resume
1078+category_id: dock-audio
1079 estimated_duration: 10.0
1080 _summary: Record playback after resuming
1081 depends: dock/suspend-undock-resume
1082@@ -857,11 +1458,90 @@
1083 _description:
1084 This will check to make sure that your audio device works properly after a suspend and resume. This may work fine with speakers and onboard microphone, however, it works best if used with a cable connecting the audio-out jack to the audio-in jack.
1085
1086+plugin: user-interact
1087+id: dock/usb3-insert-after-suspend-undock-resume
1088+category_id: suspend-undock-resume
1089+depends: dock/suspend-undock-resume
1090+estimated_duration: 10.0
1091+_summary: USB3 drive insertion test
1092+command: removable_storage_watcher -m 500000000 insert usb
1093+_purpose:
1094+ This test will check that the system correctly detects the insertion of
1095+ a USB 3.0 storage device after suspend, undocked, resume.
1096+_steps:
1097+ 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD,
1098+ in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may
1099+ be used it might cause performance related tests to fail.
1100+ (Note: this test will time-out after 20 seconds.)
1101+ 2. Do not unplug the device after the test.
1102+_verification:
1103+ The verification of this test is automated. Do not change the
1104+ automatically selected result.
1105+
1106+plugin: shell
1107+id: dock/usb3-storage-automated-after-suspend-undock-resume
1108+category_id: suspend-undock-resume
1109+depends: dock/usb3-insert-after-suspend-undock-resume
1110+user: root
1111+estimated_duration: 45.0
1112+_summary: USB3 drive storage test
1113+command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
1114+_description:
1115+ This test is automated and executes after the dock/usb3_insert test is run.
1116+
1117+plugin: user-interact
1118+id: dock/usb3-remove-after-suspend-undock-resume
1119+category_id: suspend-undock-resume
1120+depends: dock/usb3-insert-after-suspend-undock-resume
1121+estimated_duration: 10.0
1122+_summary: USB3 drive removal test
1123+command: removable_storage_watcher -m 500000000 remove usb
1124+_purpose:
1125+ This test will check that the system correctly detects the removal of
1126+ a USB 3.0 storage device after suspend, undocked, resume.
1127+_steps:
1128+ 1. Click "Test" and remove the USB 3.0 device from the dock.
1129+ (Note: this test will time-out after 20 seconds.)
1130+_verification:
1131+ The verification of this test is automated. Do not change the
1132+ automatically selected result.
1133+
1134+id: dock/monitor-displayport-after-suspend-undock-resume
1135+category_id: suspend-undock-resume
1136+depends: dock/suspend-undock-resume
1137+estimated_duration: 120.0
1138+_summary: DisplayPort test on the dock
1139+plugin: manual
1140+_purpose:
1141+ This test will check the DisplayPort(s) on the system after suspend, undocked, resume.
1142+_steps:
1143+ Skip this test if the system does not have a DisplayPort.
1144+ 1. Connect a display (if not already connected) to the DisplayPort on the system
1145+ 2. Repeat step 1 for each additional DisplayPorts, if any
1146+_verification:
1147+ Was the desktop displayed correctly on both screens?
1148+
1149+id: dock/monitor-hdmi-after-suspend-undock-resume
1150+category_id: suspend-undock-resume
1151+depends: dock/suspend-undock-resume
1152+estimated_duration: 120.0
1153+_summary: HDMI port test on the dock
1154+plugin: manual
1155+_purpose:
1156+ This test will check the HDMI port(s) on the system after suspend, undocked, resume.
1157+_steps:
1158+ Skip this test if the system does not have a HDMI port.
1159+ 1. Connect a display (if not already connected) to the HDMI port on the system
1160+ 2. Repeat step 1 for each additional HDMI port, if any
1161+_verification:
1162+ Was the desktop displayed correctly on both screens?
1163+
1164 plugin: manual
1165 id: dock/expresscard-verification
1166+category_id: dock
1167 estimated_duration: 10.0
1168 _summary: ExpressCard slot verification
1169-depends: dock/docking
1170+depends: dock/cold-plug
1171 _purpose:
1172 This will verify that an ExpressCard slot on the dock can detect inserted devices.
1173 _steps:
1174@@ -872,9 +1552,10 @@
1175
1176 plugin: user-interact
1177 id: dock/firewire-insert
1178+category_id: dock
1179 estimated_duration: 20.0
1180 _summary: FireWire HDD insertion test
1181-depends: dock/docking
1182+depends: dock/cold-plug
1183 command: removable_storage_watcher insert firewire
1184 _purpose:
1185 This test will check the system can detect the insertion of a FireWire HDD on the dock
1186@@ -889,9 +1570,10 @@
1187
1188 plugin: shell
1189 id: dock/firewire-storage-test
1190+category_id: dock
1191 estimated_duration: 45.0
1192 _summary: FireWire HDD storage test
1193-depends: dock/docking dock/firewire-insert
1194+depends: dock/cold-plug dock/firewire-insert
1195 user: root
1196 command: removable_storage_test -s 268400000 firewire
1197 _description:
1198@@ -900,6 +1582,7 @@
1199
1200 plugin: user-interact
1201 id: dock/firewire-remove
1202+category_id: dock
1203 estimated_duration: 20.0
1204 _summary: FireWire HDD removal test
1205 depends: dock/firewire-insert
1206@@ -917,9 +1600,10 @@
1207
1208 plugin: user-interact
1209 id: dock/esata-insert
1210+category_id: dock
1211 estimated_duration: 20.0
1212 _summary: eSATA HDD insertion test
1213-depends: dock/docking
1214+depends: dock/cold-plug
1215 command: removable_storage_watcher insert ata_serial_esata
1216 _purpose:
1217 This test will check the system can detect the insertion of an eSATA HDD on the dock
1218@@ -934,6 +1618,7 @@
1219
1220 plugin: shell
1221 id: dock/esata-storage-test
1222+category_id: dock
1223 estimated_duration: 20.0
1224 _summary: eSATA HDD storage test
1225 user: root
1226@@ -945,6 +1630,7 @@
1227
1228 plugin: user-interact
1229 id: dock/esata-remove
1230+category_id: dock
1231 estimated_duration: 20.0
1232 _summary: eSATA HDD removal test
1233 depends: dock/esata-insert
1234@@ -961,7 +1647,8 @@
1235
1236 plugin: manual
1237 id: dock/optical-read
1238-depends: dock/docking
1239+category_id: dock
1240+depends: dock/cold-plug
1241 estimated_duration: 180.0
1242 _summary: Optical media (CD) read test
1243 _purpose:
1244@@ -975,6 +1662,7 @@
1245
1246 plugin: manual
1247 id: dock/optical-write
1248+category_id: dock
1249 depends: dock/optical-read
1250 estimated_duration: 300.0
1251 _summary: Optical media (CD-RW, DVD-RW) writing test
1252@@ -991,8 +1679,9 @@
1253
1254 plugin: user-interact
1255 id: dock/thunderbolt-insert
1256+category_id: dock
1257 estimated_duration: 40.0
1258-depends: dock/docking
1259+depends: dock/cold-plug
1260 command: removable_storage_watcher insert --timeout 40 scsi
1261 _summary: Thunderbolt storage insertion detection
1262 _purpose:
1263@@ -1008,6 +1697,7 @@
1264
1265 plugin: shell
1266 id: dock/thunderbolt-storage-test
1267+category_id: dock
1268 estimated_duration: 45.0
1269 user: root
1270 depends: dock/thunderbolt-insert
1271@@ -1019,6 +1709,7 @@
1272
1273 plugin: user-interact
1274 id: dock/thunderbolt-remove
1275+category_id: dock
1276 estimated_duration: 20.0
1277 depends: dock/thunderbolt-insert
1278 command: removable_storage_watcher remove scsi
1279@@ -1033,3 +1724,221 @@
1280 The verification of this test is automated. Do not change the automatically
1281 selected result
1282
1283+### Hot Plug after suspend ###
1284+
1285+id: dock/hot-plug-after-suspend
1286+category_id: dock-hotplug
1287+plugin: manual
1288+depends: suspend/suspend_advanced
1289+estimated_duration: 30.00
1290+_summary: Docking test
1291+_purpose:
1292+ This test will check the device can be used after docking and system suspend.
1293+_steps:
1294+ 1. Unplug docking station.
1295+ 2. Replug in docking station.
1296+_verification:
1297+ Is the system working with problem (e.g. system hang) after docking station hot plugged in?
1298+
1299+plugin: user-interact-verify
1300+category_id: dock-hotplug
1301+id: dock/hotplug-ethernet-after-suspend
1302+depends: suspend/suspend_advanced
1303+command: network_check
1304+estimated_duration: 10
1305+_description:
1306+ PURPOSE:
1307+ This test will check wired connection after hotplug
1308+ STEPS:
1309+ 1. Disable WiFi connection
1310+ 2. Click "Test" to verify that it's possible to establish a HTTP connection
1311+ VERIFICATION:
1312+ Did a notification show and was the connection correctly established?
1313+
1314+plugin: user-interact
1315+id: dock/hotplug-usb3-insert-after-suspend
1316+category_id: dock-hotplug
1317+depends: dock/hot-plug-after-suspend
1318+estimated_duration: 10.0
1319+_summary: USB3 drive insertion test
1320+command: removable_storage_watcher -m 500000000 insert usb
1321+_purpose:
1322+ This test will check that the system correctly detects the insertion of
1323+ a USB 3.0 storage device after dock hot plugged in
1324+_steps:
1325+ 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD,
1326+ in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may
1327+ be used it might cause performance related tests to fail.
1328+ (Note: this test will time-out after 20 seconds.)
1329+ 2. Do not unplug the device after the test.
1330+_verification:
1331+ The verification of this test is automated. Do not change the
1332+ automatically selected result.
1333+
1334+plugin: shell
1335+id: dock/hotplug-usb3-storage-automated-after-suspend
1336+category_id: dock-hotplug
1337+depends: dock/hotplug-usb3-insert-after-suspend
1338+user: root
1339+estimated_duration: 45.0
1340+_summary: USB3 drive storage test
1341+command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
1342+_description:
1343+ This test is automated and executes after the dock/usb3_insert test is run.
1344+
1345+plugin: user-interact
1346+id: dock/hotplug-usb3-remove-after-suspend
1347+category_id: dock-hotplug
1348+depends: dock/hotplug-usb3-insert-after-suspend
1349+estimated_duration: 10.0
1350+_summary: USB3 drive removal test
1351+command: removable_storage_watcher -m 500000000 remove usb
1352+_purpose:
1353+ This test will check that the system correctly detects the removal of
1354+ a USB 3.0 storage device after dock hot plugged in
1355+_steps:
1356+ 1. Click "Test" and remove the USB 3.0 device from the dock.
1357+ (Note: this test will time-out after 20 seconds.)
1358+_verification:
1359+ The verification of this test is automated. Do not change the
1360+ automatically selected result.
1361+
1362+id: dock/hotplug-monitor-displayport-after-suspend
1363+category_id: dock-hotplug
1364+depends: dock/hot-plug-after-suspend
1365+estimated_duration: 120.0
1366+_summary: DisplayPort test on the dock
1367+plugin: manual
1368+_purpose:
1369+ This test will check the DisplayPort(s) on the dock after hot plugged in.
1370+_steps:
1371+ Skip this test if the dock does not have a DisplayPort.
1372+ 1. Connect a display (if not already connected) to the DisplayPort on the dock
1373+ 2. Repeat step 1 for each additional DisplayPorts, if any
1374+_verification:
1375+ Was the desktop displayed correctly on both screens?
1376+
1377+id: dock/hotplug-monitor-hdmi-after-suspend
1378+category_id: dock-hotplug
1379+depends: dock/hot-plug-after-suspend
1380+estimated_duration: 120.0
1381+_summary: HDMI port test on the dock
1382+plugin: manual
1383+_purpose:
1384+ This test will check the HDMI port(s) on the dock after hot plugged in.
1385+_steps:
1386+ Skip this test if the dock does not have a HDMI port.
1387+ 1. Connect a display (if not already connected) to the HDMI port on the dock
1388+ 2. Repeat step 1 for each additional HDMI port, if any
1389+_verification:
1390+ Was the desktop displayed correctly on both screens?
1391+
1392+### Suspend, Undocked, Docked, Resume ###
1393+
1394+id: dock/suspend-dock-resume
1395+category_id: suspend-dock-resume
1396+plugin: manual
1397+estimated_duration: 120.00
1398+_summary: Suspend the device, undock, dock it and resume it
1399+_purpose:
1400+ This test will check the device can be suspended, undocked, docked and resumed properly
1401+_steps:
1402+ 1. Suspend the laptop (e.g. by closing its lid)
1403+ 2. Unplug docking station
1404+ 3. Plug in docking station
1405+ 4. Resume the laptop (e.g. by pressing the Power button on the dock)
1406+_verification:
1407+ Is the device working as expected after being docked and resumed?
1408+
1409+plugin: user-interact-verify
1410+category_id: suspend-dock-resume
1411+id: dock/ethernet-after-suspend-dock-resume
1412+depends: dock/suspend-dock-resume
1413+command: network_check
1414+estimated_duration: 10
1415+_description:
1416+ PURPOSE:
1417+ This test will check wired connection after suspend, undocked, docked, resume.
1418+ STEPS:
1419+ 1. Disable WiFi connection
1420+ 2. Click "Test" to verify that it's possible to establish a HTTP connection
1421+ VERIFICATION:
1422+ Did a notification show and was the connection correctly established?
1423+
1424+plugin: user-interact
1425+id: dock/usb3-insert-after-suspend-dock-resume
1426+category_id: suspend-dock-resume
1427+depends: dock/suspend-dock-resume
1428+estimated_duration: 10.0
1429+_summary: USB3 drive insertion test
1430+command: removable_storage_watcher -m 500000000 insert usb
1431+_purpose:
1432+ This test will check that the system correctly detects the insertion of
1433+ a USB 3.0 storage device after suspend, undocked, docked, resume.
1434+_steps:
1435+ 1. Click "Test" and insert a USB 3.0 storage device, preferably a HDD,
1436+ in one of the dock's USB 3.0 port. Although a USB 3.0 pen drive may
1437+ be used it might cause performance related tests to fail.
1438+ (Note: this test will time-out after 20 seconds.)
1439+ 2. Do not unplug the device after the test.
1440+_verification:
1441+ The verification of this test is automated. Do not change the
1442+ automatically selected result.
1443+
1444+plugin: shell
1445+id: dock/usb3-storage-automated-after-suspend-dock-resume
1446+category_id: suspend-dock-resume
1447+depends: dock/usb3-insert-after-suspend-dock-resume
1448+user: root
1449+estimated_duration: 45.0
1450+_summary: USB3 drive storage test
1451+command: removable_storage_test -s 268400000 -m 500000000 usb --driver xhci_hcd
1452+_description:
1453+ This test is automated and executes after the dock/usb3_insert test is run.
1454+
1455+plugin: user-interact
1456+id: dock/usb3-remove-after-suspend-dock-resume
1457+category_id: suspend-dock-resume
1458+depends: dock/usb3-insert-after-suspend-dock-resume
1459+estimated_duration: 10.0
1460+_summary: USB3 drive removal test
1461+command: removable_storage_watcher -m 500000000 remove usb
1462+_purpose:
1463+ This test will check that the system correctly detects the removal of
1464+ a USB 3.0 storage device after suspend, undocked, docked, resume.
1465+_steps:
1466+ 1. Click "Test" and remove the USB 3.0 device from the dock.
1467+ (Note: this test will time-out after 20 seconds.)
1468+_verification:
1469+ The verification of this test is automated. Do not change the
1470+ automatically selected result.
1471+
1472+id: dock/monitor-displayport-after-suspend-dock-resume
1473+category_id: suspend-dock-resume
1474+depends: dock/suspend-dock-resume
1475+estimated_duration: 120.0
1476+_summary: DisplayPort test on the dock
1477+plugin: manual
1478+_purpose:
1479+ This test will check the DisplayPort(s) on the dock after suspend, undocked, docked, resume.
1480+_steps:
1481+ Skip this test if the dock does not have a DisplayPort.
1482+ 1. Connect a display (if not already connected) to the DisplayPort on the dock
1483+ 2. Repeat step 1 for each additional DisplayPorts, if any
1484+_verification:
1485+ Was the desktop displayed correctly on both screens?
1486+
1487+id: dock/monitor-hdmi-after-suspend-dock-resume
1488+category_id: suspend-dock-resume
1489+depends: dock/suspend-dock-resume
1490+estimated_duration: 120.0
1491+_summary: HDMI port test on the dock
1492+plugin: manual
1493+_purpose:
1494+ This test will check the HDMI port(s) on the dock after suspend, undocked, docked, resume.
1495+_steps:
1496+ Skip this test if the dock does not have a HDMI port.
1497+ 1. Connect a display (if not already connected) to the HDMI port on the dock
1498+ 2. Repeat step 1 for each additional HDMI port, if any
1499+_verification:
1500+ Was the desktop displayed correctly on both screens?

Subscribers

People subscribed via source and target branches