Merge ~sylvain-pineau/plainbox-provider-checkbox:blockers-auto-nested-parts into plainbox-provider-checkbox:master

Proposed by Sylvain Pineau
Status: Merged
Approved by: Sylvain Pineau
Approved revision: 704d45e3a86d7efc226685da2cf065ab4cc77442
Merged at revision: 1b90e960b7096bd2d30e5a2c28381f11fcd6f0dc
Proposed branch: ~sylvain-pineau/plainbox-provider-checkbox:blockers-auto-nested-parts
Merge into: plainbox-provider-checkbox:master
Diff against target: 940 lines (+655/-23)
25 files modified
units/audio/test-plan.pxu (+37/-0)
units/bluetooth/test-plan.pxu (+15/-0)
units/camera/test-plan.pxu (+26/-0)
units/cpu/test-plan.pxu (+25/-3)
units/disk/test-plan.pxu (+9/-0)
units/esata/test-plan.pxu (+9/-0)
units/firewire/test-plan.pxu (+9/-0)
units/graphics/test-plan.pxu (+66/-0)
units/hibernate/test-plan.pxu (+1/-1)
units/input/test-plan.pxu (+17/-0)
units/keys/test-plan.pxu (+17/-0)
units/mediacard/test-plan.pxu (+24/-0)
units/miscellanea/test-plan.pxu (+25/-0)
units/mobilebroadband/test-plan.pxu (+8/-0)
units/monitor/test-plan.pxu (+39/-0)
units/networking/test-plan.pxu (+25/-0)
units/optical/test-plan.pxu (+14/-0)
units/power-management/test-plan.pxu (+43/-3)
units/stress/test-plan.pxu (+49/-5)
units/suspend/test-plan.pxu (+57/-8)
units/thunderbolt/test-plan.pxu (+9/-0)
units/touchpad/test-plan.pxu (+38/-0)
units/touchscreen/test-plan.pxu (+10/-0)
units/usb/test-plan.pxu (+38/-0)
units/wireless/test-plan.pxu (+45/-3)
Reviewer Review Type Date Requested Status
Sylvain Pineau (community) Approve
Review via email: mp+331290@code.launchpad.net

Description of the change

This MR adds several new test plans meant to be used to create fully automated and certification blockers only test plans.

Provider validation passes (no clashes with other providers units).

To post a comment you must log in.
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

I'm merging this one, main use will be oem provider updates.

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
diff --git a/units/audio/test-plan.pxu b/units/audio/test-plan.pxu
index a1c298e..b425c57 100644
--- a/units/audio/test-plan.pxu
+++ b/units/audio/test-plan.pxu
@@ -27,3 +27,40 @@ include:
27 suspend/microphone-plug-detection-after-suspend certification-status=blocker27 suspend/microphone-plug-detection-after-suspend certification-status=blocker
28 suspend/playback_headphones-after-suspend certification-status=blocker28 suspend/playback_headphones-after-suspend certification-status=blocker
29 suspend/alsa_record_playback_external-after-suspend certification-status=blocker29 suspend/alsa_record_playback_external-after-suspend certification-status=blocker
30
31id: audio-cert-automated
32unit: test plan
33_name: Audio tests (automated)
34_description:
35 Audio tests (automated)
36include:
37 audio/alsa_info_collect
38 audio/alsa_info_attachment
39 audio/list_devices
40
41id: audio-cert-blockers
42unit: test plan
43_name: Audio tests (certification blockers only)
44_description:
45 Audio tests (certification blockers only)
46 See Monitor / Graphic test plans for hybrid-graphic monitor audio tests
47include:
48 audio/alsa_info_collect
49 audio/alsa_info_attachment
50 audio/list_devices
51 audio/speaker-headphone-plug-detection certification-status=blocker
52 audio/microphone-plug-detection certification-status=blocker
53 audio/playback_headphones certification-status=blocker
54 audio/alsa_record_playback_external certification-status=blocker
55 audio/playback_auto certification-status=blocker
56 audio/alsa_record_playback_internal certification-status=blocker
57
58id: after-suspend-audio-cert-blockers
59unit: test plan
60_name: Audio tests (after suspend, certification blockers only)
61_description: Audio tests (after suspend, certification blockers only)
62include:
63 suspend/speaker-headphone-plug-detection-after-suspend certification-status=blocker
64 suspend/microphone-plug-detection-after-suspend certification-status=blocker
65 suspend/playback_headphones-after-suspend certification-status=blocker
66 suspend/alsa_record_playback_external-after-suspend certification-status=blocker
diff --git a/units/bluetooth/test-plan.pxu b/units/bluetooth/test-plan.pxu
index ded7c5b..e6d64e9 100644
--- a/units/bluetooth/test-plan.pxu
+++ b/units/bluetooth/test-plan.pxu
@@ -10,3 +10,18 @@ include:
10 bluetooth/HID10 bluetooth/HID
11 bluetooth4/HOGP-mouse certification-status=blocker11 bluetooth4/HOGP-mouse certification-status=blocker
12 bluetooth4/HOGP-keyboard certification-status=blocker12 bluetooth4/HOGP-keyboard certification-status=blocker
13
14id: bluetooth-cert-automated
15unit: test plan
16_name: Bluetooth tests (automated)
17_description: Bluetooth tests (automated)
18include:
19 bluetooth/detect-output
20
21id: bluetooth-cert-blockers
22unit: test plan
23_name: Bluetooth tests (certification blockers only)
24_description: Bluetooth tests (certification blockers only)
25include:
26 bluetooth4/HOGP-mouse certification-status=blocker
27 bluetooth4/HOGP-keyboard certification-status=blocker
diff --git a/units/camera/test-plan.pxu b/units/camera/test-plan.pxu
index 998be60..2cf5550 100644
--- a/units/camera/test-plan.pxu
+++ b/units/camera/test-plan.pxu
@@ -15,3 +15,29 @@ _description: Camera tests (after suspend)
15include:15include:
16 camera/display_after_suspend certification-status=blocker16 camera/display_after_suspend certification-status=blocker
17 camera/still_after_suspend certification-status=blocker17 camera/still_after_suspend certification-status=blocker
18
19id: camera-cert-automated
20unit: test plan
21_name: Camera tests (automated)
22_description: Camera tests (automated)
23include:
24 camera/detect certification-status=blocker
25 camera/multiple-resolution-images certification-status=blocker
26
27id: camera-cert-blockers
28unit: test plan
29_name: Camera tests (certification blockers only)
30_description: Camera tests (certification blockers only)
31include:
32 camera/detect certification-status=blocker
33 camera/still certification-status=blocker
34 camera/display certification-status=blocker
35 camera/multiple-resolution-images certification-status=blocker
36
37id: after-suspend-camera-cert-blockers
38unit: test plan
39_name: Camera tests (after suspend, certification blockers only)
40_description: Camera tests (after suspend, certification blockers only)
41include:
42 camera/display_after_suspend certification-status=blocker
43 camera/still_after_suspend certification-status=blocker
diff --git a/units/cpu/test-plan.pxu b/units/cpu/test-plan.pxu
index c6b6fd7..2678c31 100644
--- a/units/cpu/test-plan.pxu
+++ b/units/cpu/test-plan.pxu
@@ -3,12 +3,34 @@ unit: test plan
3_name: CPU tests3_name: CPU tests
4_description: CPU tests4_description: CPU tests
5include:5include:
6nested_part:
7 cpu-cert-automated
8
9id: cpu-cert-automated
10unit: test plan
11_name: CPU tests (automated)
12_description: CPU tests (automated)
13include:
6 cpu/cstates certification-status=blocker14 cpu/cstates certification-status=blocker
7 cpu/cstates_results.log 15 cpu/cstates_results.log
8 cpu/scaling_test certification-status=blocker16 cpu/scaling_test certification-status=blocker
9 cpu/scaling_test-log-attach 17 cpu/scaling_test-log-attach
10 cpu/maxfreq_test certification-status=blocker18 cpu/maxfreq_test certification-status=blocker
11 cpu/maxfreq_test-log-attach 19 cpu/maxfreq_test-log-attach
12 cpu/offlining_test certification-status=blocker20 cpu/offlining_test certification-status=blocker
13 cpu/topology certification-status=blocker21 cpu/topology certification-status=blocker
14 cpu/clocktest22 cpu/clocktest
23
24id: cpu-cert-blockers
25unit: test plan
26_name: CPU tests (certification blockers only)
27_description: CPU tests (certification blockers only)
28include:
29 cpu/cstates certification-status=blocker
30 cpu/cstates_results.log
31 cpu/scaling_test certification-status=blocker
32 cpu/scaling_test-log-attach
33 cpu/maxfreq_test certification-status=blocker
34 cpu/maxfreq_test-log-attach
35 cpu/offlining_test certification-status=blocker
36 cpu/topology certification-status=blocker
diff --git a/units/disk/test-plan.pxu b/units/disk/test-plan.pxu
index cc7f176..08974cb 100644
--- a/units/disk/test-plan.pxu
+++ b/units/disk/test-plan.pxu
@@ -18,3 +18,12 @@ include:
18 benchmarks/disk/hdparm-read_.*18 benchmarks/disk/hdparm-read_.*
19 benchmarks/disk/hdparm-cache-read_.*19 benchmarks/disk/hdparm-cache-read_.*
20 disk/apste_support_on_.*20 disk/apste_support_on_.*
21
22id: disk-cert-blockers
23unit: test plan
24_name: Disk tests (certification blockers only)
25_description: Disk tests (certification blockers only)
26include:
27 disk/detect certification-status=blocker
28 disk/read_performance_.* certification-status=blocker
29 disk/storage_device_.* certification-status=blocker
diff --git a/units/esata/test-plan.pxu b/units/esata/test-plan.pxu
index ef30569..b7e59cd 100644
--- a/units/esata/test-plan.pxu
+++ b/units/esata/test-plan.pxu
@@ -6,3 +6,12 @@ include:
6 esata/insert certification-status=blocker6 esata/insert certification-status=blocker
7 esata/storage-test certification-status=blocker7 esata/storage-test certification-status=blocker
8 esata/remove certification-status=blocker8 esata/remove certification-status=blocker
9
10id: esata-cert-blockers
11unit: test plan
12_name: eSATA tests (certification blockers only)
13_description: eSATA tests (certification blockers only)
14include:
15 esata/insert certification-status=blocker
16 esata/storage-test certification-status=blocker
17 esata/remove certification-status=blocker
diff --git a/units/firewire/test-plan.pxu b/units/firewire/test-plan.pxu
index 5409e06..ecb6084 100644
--- a/units/firewire/test-plan.pxu
+++ b/units/firewire/test-plan.pxu
@@ -6,3 +6,12 @@ include:
6 firewire/insert certification-status=blocker6 firewire/insert certification-status=blocker
7 firewire/storage-test certification-status=blocker7 firewire/storage-test certification-status=blocker
8 firewire/remove certification-status=blocker8 firewire/remove certification-status=blocker
9
10id: firewire-cert-blockers
11unit: test plan
12_name: Firewire tests (certification blockers only)
13_description: Firewire tests (certification blockers only)
14include:
15 firewire/insert certification-status=blocker
16 firewire/storage-test certification-status=blocker
17 firewire/remove certification-status=blocker
diff --git a/units/graphics/test-plan.pxu b/units/graphics/test-plan.pxu
index d292060..a85b194 100644
--- a/units/graphics/test-plan.pxu
+++ b/units/graphics/test-plan.pxu
@@ -76,3 +76,69 @@ include:
76 suspend/2_video_after_suspend_.*_xenial certification-status=blocker76 suspend/2_video_after_suspend_.*_xenial certification-status=blocker
77 suspend/2_cycle_resolutions_after_suspend_.*_xenial certification-status=non-blocker77 suspend/2_cycle_resolutions_after_suspend_.*_xenial certification-status=non-blocker
78 suspend/2_xrandr_screens_after_suspend_.*.tar.gz_xenial78 suspend/2_xrandr_screens_after_suspend_.*.tar.gz_xenial
79
80id: graphics-integrated-gpu-cert-blockers
81unit: test plan
82_name: Graphics tests (integrated GPU, certification blockers only)
83_description: Graphics tests (integrated GPU, certification blockers only)
84include:
85 graphics/xorg-version certification-status=blocker
86 graphics/xorg-failsafe certification-status=blocker
87 graphics/xorg-process certification-status=blocker
88 graphics/VESA_drivers_not_in_use certification-status=blocker
89 graphics/1_maximum_resolution_.* certification-status=blocker
90 graphics/1_glxgears_.* certification-status=blocker
91 graphics/1_driver_version_.* certification-status=blocker
92 graphics/1_compiz_check_.* certification-status=blocker
93 graphics/1_rotation_.* certification-status=blocker
94 graphics/1_video_.* certification-status=blocker
95bootstrap_include:
96 graphics_card
97
98id: graphics-discrete-gpu-cert-blockers
99unit: test plan
100_name: Graphics tests (discrete GPU, certification blockers only)
101_description: Graphics tests (discrete GPU, certification blockers only)
102include:
103 graphics/2_switch_card_.*_xenial certification-status=blocker
104 graphics/2_maximum_resolution_.* certification-status=blocker
105 graphics/2_valid_opengl_renderer_.* certification-status=blocker
106 graphics/2_glxgears_.* certification-status=blocker
107 graphics/2_driver_version_.* certification-status=blocker
108 graphics/2_compiz_check_.* certification-status=blocker
109 graphics/2_rotation_.* certification-status=blocker
110 graphics/2_video_.* certification-status=blocker
111bootstrap_include:
112 graphics_card
113
114id: after-suspend-graphics-integrated-gpu-cert-blockers
115unit: test plan
116_name: After suspend tests (integrated GPU, certification blockers only)
117_description: After suspend tests (integrated GPU, certification blockers only)
118include:
119 graphics/1_switch_card_.*_xenial certification-status=blocker
120 suspend/1_resolution_before_suspend_.*_xenial certification-status=blocker
121 suspend/suspend_advanced certification-status=blocker
122 power-management/lid certification-status=blocker
123 power-management/lid_close certification-status=blocker
124 power-management/lid_open certification-status=blocker
125 suspend/1_compiz_check_after_suspend_.*_xenial certification-status=blocker
126 suspend/1_driver_version_after_suspend_.*_xenial certification-status=blocker
127 suspend/1_resolution_after_suspend_.*_xenial certification-status=blocker
128 suspend/1_display_after_suspend_.*_xenial certification-status=blocker
129 suspend/1_glxgears_after_suspend_.*_xenial certification-status=blocker
130 suspend/1_video_after_suspend_.*_xenial certification-status=blocker
131
132id: after-suspend-graphics-discrete-gpu-cert-blockers
133unit: test plan
134_name: After suspend tests (discrete GPU, certification blockers only)
135_description: After suspend tests (discrete GPU, certification blockers only)
136include:
137 suspend/2_resolution_before_suspend_.*_xenial certification-status=blocker
138 suspend/2_suspend_after_switch_to_card_.*_xenial certification-status=blocker
139 suspend/2_compiz_check_after_suspend_.*_xenial certification-status=blocker
140 suspend/2_driver_version_after_suspend_.*_xenial certification-status=blocker
141 suspend/2_resolution_after_suspend_.*_xenial certification-status=blocker
142 suspend/2_display_after_suspend_.*_xenial certification-status=blocker
143 suspend/2_glxgears_after_suspend_.*_xenial certification-status=blocker
144 suspend/2_video_after_suspend_.*_xenial certification-status=blocker
diff --git a/units/hibernate/test-plan.pxu b/units/hibernate/test-plan.pxu
index 3c0f12a..8514f12 100644
--- a/units/hibernate/test-plan.pxu
+++ b/units/hibernate/test-plan.pxu
@@ -5,7 +5,7 @@ _description: Hibernate tests (integrated GPU)
5include:5include:
6 power-management/1_hibernate_advanced_.* certification-status=non-blocker6 power-management/1_hibernate_advanced_.* certification-status=non-blocker
7 power-management/1_hibernate-single-log-attach_.*7 power-management/1_hibernate-single-log-attach_.*
8 keys/hibernate certification-status=blocker8 keys/hibernate certification-status=non-blocker
99
10id: hibernate-discrete-gpu-cert-full10id: hibernate-discrete-gpu-cert-full
11unit: test plan11unit: test plan
diff --git a/units/input/test-plan.pxu b/units/input/test-plan.pxu
index a0877c5..8033883 100644
--- a/units/input/test-plan.pxu
+++ b/units/input/test-plan.pxu
@@ -15,3 +15,20 @@ _description: Input tests (after suspend)
15include:15include:
16 suspend/pointing-after-suspend_.* certification-status=blocker16 suspend/pointing-after-suspend_.* certification-status=blocker
17 suspend/clicking-after-suspend_.* certification-status=blocker17 suspend/clicking-after-suspend_.* certification-status=blocker
18
19id: input-cert-blockers
20unit: test plan
21_name: Input tests (certification blockers only)
22_description: Input tests (certification blockers only)
23include:
24 input/pointing_.* certification-status=blocker
25 input/clicking_.* certification-status=blocker
26 input/keyboard certification-status=blocker
27
28id: after-suspend-input-cert-blockers
29unit: test plan
30_name: Input tests (after suspend, certification blockers only)
31_description: Input tests (after suspend, certification blockers only)
32include:
33 suspend/pointing-after-suspend_.* certification-status=blocker
34 suspend/clicking-after-suspend_.* certification-status=blocker
diff --git a/units/keys/test-plan.pxu b/units/keys/test-plan.pxu
index b2e3f91..ebd1696 100644
--- a/units/keys/test-plan.pxu
+++ b/units/keys/test-plan.pxu
@@ -13,3 +13,20 @@ include:
13 keys/volume certification-status=blocker13 keys/volume certification-status=blocker
14 keys/video-out certification-status=blocker14 keys/video-out certification-status=blocker
15 keys/wireless certification-status=blocker15 keys/wireless certification-status=blocker
16
17id: keys-cert-blockers
18unit: test plan
19_name: Special keys tests (certification blockers only)
20_description:
21 Special keys tests (w/o sleep/hibernate keys, see Power Management test plans)
22 (certification blockers only)
23include:
24 keys/lock-screen certification-status=blocker
25 keys/super certification-status=blocker
26 keys/battery-info certification-status=blocker
27 keys/brightness certification-status=blocker
28 keys/media-control certification-status=blocker
29 keys/mute certification-status=blocker
30 keys/volume certification-status=blocker
31 keys/video-out certification-status=blocker
32 keys/wireless certification-status=blocker
diff --git a/units/mediacard/test-plan.pxu b/units/mediacard/test-plan.pxu
index eafadd8..087e556 100644
--- a/units/mediacard/test-plan.pxu
+++ b/units/mediacard/test-plan.pxu
@@ -21,3 +21,27 @@ include:
21 suspend/sdhc-insert-after-suspend certification-status=blocker21 suspend/sdhc-insert-after-suspend certification-status=blocker
22 suspend/sdhc-storage-after-suspend certification-status=blocker22 suspend/sdhc-storage-after-suspend certification-status=blocker
23 suspend/sdhc-remove-after-suspend certification-status=blocker23 suspend/sdhc-remove-after-suspend certification-status=blocker
24
25id: mediacard-cert-blockers
26unit: test plan
27_name: Mediacard tests (certification blockers only)
28_description: Mediacard tests (certification blockers only)
29include:
30 mediacard/sd-insert certification-status=blocker
31 mediacard/sd-storage certification-status=blocker
32 mediacard/sd-remove certification-status=blocker
33 mediacard/sdhc-insert certification-status=blocker
34 mediacard/sdhc-storage certification-status=blocker
35 mediacard/sdhc-remove certification-status=blocker
36
37id: after-suspend-mediacard-cert-blockers
38unit: test plan
39_name: Mediacard tests (after suspend, certification blockers only)
40_description: Mediacard tests (after suspend, certification blockers only)
41include:
42 suspend/sd-insert-after-suspend certification-status=blocker
43 suspend/sd-storage-after-suspend certification-status=blocker
44 suspend/sd-remove-after-suspend certification-status=blocker
45 suspend/sdhc-insert-after-suspend certification-status=blocker
46 suspend/sdhc-storage-after-suspend certification-status=blocker
47 suspend/sdhc-remove-after-suspend certification-status=blocker
diff --git a/units/miscellanea/test-plan.pxu b/units/miscellanea/test-plan.pxu
index eb97d4f..86f502c 100644
--- a/units/miscellanea/test-plan.pxu
+++ b/units/miscellanea/test-plan.pxu
@@ -3,6 +3,16 @@ unit: test plan
3_name: Miscellaneous client tests3_name: Miscellaneous client tests
4_description: Miscellaneous client tests (fwts, dmi, oops)4_description: Miscellaneous client tests (fwts, dmi, oops)
5include:5include:
6nested_part:
7 misc-client-cert-automated
8
9id: misc-client-cert-automated
10unit: test plan
11_name: Miscellaneous client tests (automated)
12_description:
13 Miscellaneous client tests (fwts, dmi, oops)
14 (automated)
15include:
6 install/apt-get-gets-updates16 install/apt-get-gets-updates
7 memory/info certification-status=blocker17 memory/info certification-status=blocker
8 firmware/fwts_desktop_diagnosis18 firmware/fwts_desktop_diagnosis
@@ -17,3 +27,18 @@ include:
17 miscellanea/dmitest_client27 miscellanea/dmitest_client
18bootstrap_include:28bootstrap_include:
19 fwts29 fwts
30
31id: misc-client-cert-blockers
32unit: test plan
33_name: Miscellaneous client tests (certification blockers only)
34_description:
35 Miscellaneous client tests (fwts, dmi, oops)
36 (certification blockers only)
37include:
38 memory/info certification-status=blocker
39 firmware/fwts_wakealarm.* certification-status=blocker
40 firmware/fwts_uefirtvariable.* certification-status=blocker
41 miscellanea/oops certification-status=blocker
42 miscellanea/oops_results.log
43bootstrap_include:
44 fwts
diff --git a/units/mobilebroadband/test-plan.pxu b/units/mobilebroadband/test-plan.pxu
index b9901a6..166a297 100644
--- a/units/mobilebroadband/test-plan.pxu
+++ b/units/mobilebroadband/test-plan.pxu
@@ -3,5 +3,13 @@ unit: test plan
3_name: Mobile broadband tests3_name: Mobile broadband tests
4_description: Mobile broadband tests4_description: Mobile broadband tests
5include:5include:
6nested_part:
7 mobilebroadband-cert-automated
8
9id: mobilebroadband-cert-automated
10unit: test plan
11_name: Mobile broadband tests (automated)
12_description: Mobile broadband tests (automated)
13include:
6 mobilebroadband/gsm_connection certification-status=non-blocker14 mobilebroadband/gsm_connection certification-status=non-blocker
7 mobilebroadband/cdma_connection certification-status=non-blocker15 mobilebroadband/cdma_connection certification-status=non-blocker
diff --git a/units/monitor/test-plan.pxu b/units/monitor/test-plan.pxu
index d3527da..10976c9 100644
--- a/units/monitor/test-plan.pxu
+++ b/units/monitor/test-plan.pxu
@@ -45,3 +45,42 @@ include:
45 monitor/2_multi-head_.* certification-status=blocker45 monitor/2_multi-head_.* certification-status=blocker
46bootstrap_include:46bootstrap_include:
47 graphics_card47 graphics_card
48
49id: monitor-integrated-gpu-cert-blockers
50unit: test plan
51_name: Monitor tests (integrated GPU, certification blockers only)
52_description: Monitor tests (integrated GPU, certification blockers only)
53include:
54 monitor/1_powersaving_.* certification-status=blocker
55 monitor/1_dim_brightness_.* certification-status=blocker
56 monitor/1_displayport_.* certification-status=blocker
57 audio/1_playback_displayport_.* certification-status=blocker
58 monitor/1_dvi_.* certification-status=blocker
59 monitor/1_hdmi_.* certification-status=blocker
60 audio/1_playback_hdmi_.* certification-status=blocker
61 monitor/1_thunderbolt_.* certification-status=blocker
62 audio/1_playback_thunderbolt_.* certification-status=blocker
63 thunderbolt/daisy-chain certification-status=blocker
64 monitor/1_vga_.* certification-status=blocker
65 monitor/1_multi-head_.* certification-status=blocker
66bootstrap_include:
67 graphics_card
68
69id: monitor-discrete-gpu-cert-blockers
70unit: test plan
71_name: Monitor tests (discrete GPU, certification blockers only)
72_description: Monitor tests (discrete GPU, certification blockers only)
73include:
74 monitor/2_powersaving_.* certification-status=blocker
75 monitor/2_dim_brightness_.* certification-status=blocker
76 monitor/2_displayport_.* certification-status=blocker
77 audio/2_playback_displayport_.* certification-status=blocker
78 monitor/2_dvi_.* certification-status=blocker
79 monitor/2_hdmi_.* certification-status=blocker
80 audio/2_playback_hdmi_.* certification-status=blocker
81 monitor/2_thunderbolt_.* certification-status=blocker
82 audio/2_playback_thunderbolt_.* certification-status=blocker
83 monitor/2_vga_.* certification-status=blocker
84 monitor/2_multi-head_.* certification-status=blocker
85bootstrap_include:
86 graphics_card
diff --git a/units/networking/test-plan.pxu b/units/networking/test-plan.pxu
index ebaee65..ade662a 100644
--- a/units/networking/test-plan.pxu
+++ b/units/networking/test-plan.pxu
@@ -3,6 +3,31 @@ unit: test plan
3_name: Networking tests3_name: Networking tests
4_description: Networking tests4_description: Networking tests
5include:5include:
6nested_part:
7 networking-cert-automated
8 networking-cert-manual
9
10id: networking-cert-manual
11unit: test plan
12_name: Networking tests (manual)
13_description: Networking tests (manual)
14include:
15 networking/info.* certification-status=blocker
16
17id: networking-cert-automated
18unit: test plan
19_name: Networking tests (automated)
20_description: Networking tests (automated)
21include:
22 ethernet/detect certification-status=blocker
23 networking/gateway_ping certification-status=blocker
24 networking/ntp certification-status=blocker
25
26id: networking-cert-blockers
27unit: test plan
28_name: Networking tests (certification blockers only)
29_description: Networking tests (certification blockers only)
30include:
6 ethernet/detect certification-status=blocker31 ethernet/detect certification-status=blocker
7 networking/gateway_ping certification-status=blocker32 networking/gateway_ping certification-status=blocker
8 networking/info.* certification-status=blocker33 networking/info.* certification-status=blocker
diff --git a/units/optical/test-plan.pxu b/units/optical/test-plan.pxu
index 7336d45..ba63c28 100644
--- a/units/optical/test-plan.pxu
+++ b/units/optical/test-plan.pxu
@@ -11,3 +11,17 @@ include:
11 optical/bluray-write_.* certification-status=blocker11 optical/bluray-write_.* certification-status=blocker
12bootstrap_include:12bootstrap_include:
13 device13 device
14
15id: optical-cert-blockers
16unit: test plan
17_name: Optical drive tests (certification blockers only)
18_description: Optical drive tests (certification blockers only)
19include:
20 optical/detect certification-status=blocker
21 optical/read_.* certification-status=blocker
22 optical/cdrom-write_.* certification-status=blocker
23 optical/dvd-write_.* certification-status=blocker
24 optical/bluray-read_.* certification-status=blocker
25 optical/bluray-write_.* certification-status=blocker
26bootstrap_include:
27 device
diff --git a/units/power-management/test-plan.pxu b/units/power-management/test-plan.pxu
index 6a4da12..2cd1a76 100644
--- a/units/power-management/test-plan.pxu
+++ b/units/power-management/test-plan.pxu
@@ -3,15 +3,55 @@ unit: test plan
3_name: Power Management precheck tests3_name: Power Management precheck tests
4_description: Power Management precheck tests4_description: Power Management precheck tests
5include:5include:
6nested_part:
7 power-management-precheck-cert-automated
8
9id: power-management-reboot-poweroff-cert
10unit: test plan
11_name: Power Management reboot and power off tests
12_description: Power Management reboot and power off tests
13include:
14nested_part:
15 power-management-reboot-poweroff-cert-automated
16
17id: power-management-precheck-cert-automated
18unit: test plan
19_name: Power Management precheck tests (automated)
20_description: Power Management precheck tests (automated)
21include:
6 power-management/rtc certification-status=blocker22 power-management/rtc certification-status=blocker
7 power-management/tickless_idle certification-status=blocker23 power-management/tickless_idle certification-status=blocker
8 power-management/fwts_wakealarm certification-status=blocker24 power-management/fwts_wakealarm certification-status=blocker
9 power-management/fwts_wakealarm-log-attach25 power-management/fwts_wakealarm-log-attach
1026
11id: power-management-reboot-poweroff-cert27id: power-management-reboot-poweroff-cert-automated
12unit: test plan28unit: test plan
13_name: Power Management reboot and power off tests29_name: Power Management reboot and power off tests (automated)
14_description: Power Management reboot and power off tests30_description: Power Management reboot and power off tests (automated)
31include:
32 power-management/poweroff certification-status=blocker
33 power-management/poweroff-log-attach
34 power-management/reboot certification-status=blocker
35 power-management/reboot-log-attach
36
37id: power-management-precheck-cert-blockers
38unit: test plan
39_name:
40 Power Management precheck tests (certification blockers only)
41_description:
42 Power Management precheck tests (certification blockers only)
43include:
44 power-management/rtc certification-status=blocker
45 power-management/tickless_idle certification-status=blocker
46 power-management/fwts_wakealarm certification-status=blocker
47 power-management/fwts_wakealarm-log-attach
48
49id: power-management-reboot-poweroff-cert-blockers
50unit: test plan
51_name:
52 Power Management reboot and power off tests (certification blockers only)
53_description:
54 Power Management reboot and power off tests (certification blockers only)
15include:55include:
16 power-management/poweroff certification-status=blocker56 power-management/poweroff certification-status=blocker
17 power-management/poweroff-log-attach57 power-management/poweroff-log-attach
diff --git a/units/stress/test-plan.pxu b/units/stress/test-plan.pxu
index 6fa0bc3..5f72916 100644
--- a/units/stress/test-plan.pxu
+++ b/units/stress/test-plan.pxu
@@ -3,9 +3,53 @@ unit: test plan
3_name: Stress tests3_name: Stress tests
4_description: Stress tests4_description: Stress tests
5include:5include:
6 power-management/suspend_30_cycles certification-status=blocker6nested_part:
7 stress-cert-automated
8
9id: stress-cert-automated
10unit: test plan
11_name: Stress tests (automated)
12_description: Stress tests (automated)
13include:
14 power-management/suspend_30_cycles certification-status=blocker
15 power-management/suspend-30-cycle-log-attach
16 power-management/suspend-30-cycles-time-check certification-status=non-blocker
17 stress/cpu_stress_ng_test certification-status=blocker
18
19id: stress-cert-blockers
20unit: test plan
21_name: Stress tests (certification blockers only)
22_description: Stress tests (certification blockers only)
23include:
24 power-management/suspend_30_cycles certification-status=blocker
7 power-management/suspend-30-cycle-log-attach25 power-management/suspend-30-cycle-log-attach
8 power-management/suspend-30-cycles-time-check certification-status=non-blocker26 stress/cpu_stress_ng_test certification-status=blocker
9 power-management/hibernate_30_cycles certification-status=non-blocker27
10 power-management/hibernate-30-cycle-log-attach28id: stress-suspend-30-cycles-with-reboots-automated
11 stress/cpu_stress_test certification-status=blocker29unit: test plan
30_name: Suspend stress tests (with reboots)
31_description: Suspend stress tests (with reboots)
32include:
33 power-management/suspend_30_cycles_with_reboots
34 power-management/suspend-30-cycles-log-check-with-reboots
35 power-management/suspend-30-cycle-log-attach-with-reboots
36 power-management/suspend-30-cycles-time-check-with-reboots
37
38id: stress-30-reboot-poweroff-automated
39unit: test plan
40_name: Power Management reboot and power off stress tests (automated)
41_description: Power Management reboot and power off stress tests (automated)
42include:
43 stress/reboot_30
44 stress/reboot_30_log
45 stress/poweroff_30
46 stress/poweroff_30_log
47
48id: stress-ng-cert-automated
49unit: test plan
50_name: Stress NG tests (automated)
51_description: Stress NG tests (automated)
52include:
53 stress/cpu_stress_ng_test certification-status=blocker
54 memory/memory_stress_ng certification-status=blocker
55
diff --git a/units/suspend/test-plan.pxu b/units/suspend/test-plan.pxu
index bcbe39c..57124f5 100644
--- a/units/suspend/test-plan.pxu
+++ b/units/suspend/test-plan.pxu
@@ -3,6 +3,33 @@ unit: test plan
3_name: Before suspend reference tests3_name: Before suspend reference tests
4_description: Before suspend reference tests4_description: Before suspend reference tests
5include:5include:
6nested_part:
7 before-suspend-reference-cert-automated
8
9id: after-suspend-reference-cert-full
10unit: test plan
11_name: After suspend reference tests
12_description: After suspend reference tests
13include:
14nested_part:
15 after-suspend-reference-cert-automated
16
17id: suspend-key-led-oops-check-cert
18unit: test plan
19_name: After suspend LED and oops tests (using special sleep key)
20_description: After suspend LED and oops tests (using special sleep key)
21include:
22 keys/sleep certification-status=blocker
23 suspend/oops_after_suspend certification-status=blocker
24 suspend/oops_results_after_suspend.log
25 led/power-blink-suspend
26 led/suspend
27
28id: before-suspend-reference-cert-automated
29unit: test plan
30_name: Before suspend reference tests (automated)
31_description: Before suspend reference tests (automated)
32include:
6 suspend/network_before_suspend certification-status=blocker33 suspend/network_before_suspend certification-status=blocker
7 suspend/audio_before_suspend certification-status=blocker34 suspend/audio_before_suspend certification-status=blocker
8 suspend/cpu_before_suspend certification-status=blocker35 suspend/cpu_before_suspend certification-status=blocker
@@ -11,10 +38,10 @@ include:
11 suspend/bluetooth_obex_browse_before_suspend38 suspend/bluetooth_obex_browse_before_suspend
12 suspend/bluetooth_obex_get_before_suspend39 suspend/bluetooth_obex_get_before_suspend
1340
14id: after-suspend-reference-cert-full41id: after-suspend-reference-cert-automated
15unit: test plan42unit: test plan
16_name: After suspend reference tests43_name: After suspend reference tests (automated)
17_description: After suspend reference tests44_description: After suspend reference tests (automated)
18include:45include:
19 suspend/network_after_suspend certification-status=blocker46 suspend/network_after_suspend certification-status=blocker
20 suspend/audio_after_suspend certification-status=blocker47 suspend/audio_after_suspend certification-status=blocker
@@ -25,13 +52,35 @@ include:
25 suspend/bluetooth_obex_browse_after_suspend52 suspend/bluetooth_obex_browse_after_suspend
26 suspend/bluetooth_obex_get_after_suspend53 suspend/bluetooth_obex_get_after_suspend
2754
28id: suspend-key-led-oops-check-cert55id: before-suspend-reference-cert-blockers
29unit: test plan56unit: test plan
30_name: After suspend LED and oops tests (using special sleep key)57_name: Before suspend reference tests (certification blockers only)
31_description: After suspend LED and oops tests (using special sleep key)58_description: Before suspend reference tests (certification blockers only)
59include:
60 suspend/network_before_suspend certification-status=blocker
61 suspend/audio_before_suspend certification-status=blocker
62 suspend/cpu_before_suspend certification-status=blocker
63 suspend/memory_before_suspend certification-status=blocker
64
65id: after-suspend-reference-cert-blockers
66unit: test plan
67_name: After suspend reference tests (certification blockers only)
68_description: After suspend reference tests (certification blockers only)
69include:
70 suspend/network_after_suspend certification-status=blocker
71 suspend/audio_after_suspend certification-status=blocker
72 suspend/cpu_after_suspend certification-status=blocker
73 suspend/memory_after_suspend certification-status=blocker
74 suspend/bluetooth_detect_after_suspend certification-status=blocker
75
76id: suspend-key-led-oops-check-cert-blockers
77unit: test plan
78_name:
79 After suspend LED and oops tests (using special sleep key, cert. blockers only)
80_description:
81 After suspend LED and oops tests (using special sleep key)
82 (certification blockers only)
32include:83include:
33 keys/sleep certification-status=blocker84 keys/sleep certification-status=blocker
34 suspend/oops_after_suspend certification-status=blocker85 suspend/oops_after_suspend certification-status=blocker
35 suspend/oops_results_after_suspend.log86 suspend/oops_results_after_suspend.log
36 led/power-blink-suspend
37 led/suspend
diff --git a/units/thunderbolt/test-plan.pxu b/units/thunderbolt/test-plan.pxu
index 686bb82..054bb26 100644
--- a/units/thunderbolt/test-plan.pxu
+++ b/units/thunderbolt/test-plan.pxu
@@ -9,3 +9,12 @@ include:
9 thunderbolt3/insert certification-status=non-blocker9 thunderbolt3/insert certification-status=non-blocker
10 thunderbolt3/storage-test certification-status=non-blocker10 thunderbolt3/storage-test certification-status=non-blocker
11 thunderbolt3/remove certification-status=non-blocker11 thunderbolt3/remove certification-status=non-blocker
12
13id: thunderbolt-cert-blockers
14unit: test plan
15_name: Thunderbolt tests (certification blockers only)
16_description: Thunderbolt tests (certification blockers only)
17include:
18 thunderbolt/insert certification-status=blocker
19 thunderbolt/storage-test certification-status=blocker
20 thunderbolt/remove certification-status=blocker
diff --git a/units/touchpad/test-plan.pxu b/units/touchpad/test-plan.pxu
index b270d92..7514991 100644
--- a/units/touchpad/test-plan.pxu
+++ b/units/touchpad/test-plan.pxu
@@ -39,3 +39,41 @@ include:
39 touchpad/multitouch-horizontal-after-suspend certification-status=blocker39 touchpad/multitouch-horizontal-after-suspend certification-status=blocker
40 touchpad/multitouch-vertical-after-suspend certification-status=blocker40 touchpad/multitouch-vertical-after-suspend certification-status=blocker
41 touchpad/multitouch-dash-after-suspend certification-status=non-blocker41 touchpad/multitouch-dash-after-suspend certification-status=non-blocker
42
43id: touchpad-cert-blockers
44unit: test plan
45_name: Touchpad tests (certification blockers only)
46_description: Touchpad tests (certification blockers only)
47include:
48 touchpad/basic certification-status=blocker
49 touchpad/detected-as-mouse certification-status=blocker
50 touchpad/continuous-move certification-status=blocker
51 touchpad/horizontal certification-status=blocker
52 touchpad/vertical certification-status=blocker
53 touchpad/singletouch-automated certification-status=blocker
54 touchpad/singletouch-selection certification-status=blocker
55 touchpad/drag-and-drop certification-status=blocker
56 touchpad/multitouch-automated certification-status=blocker
57 touchpad/multitouch-manual certification-status=blocker
58 touchpad/multitouch-rightclick certification-status=blocker
59 touchpad/multitouch-horizontal certification-status=blocker
60 touchpad/multitouch-vertical certification-status=blocker
61
62id: after-suspend-touchpad-cert-blockers
63unit: test plan
64_name: Touchpad tests (after suspend, certification blockers only)
65_description: Touchpad tests (after suspend, certification blockers only)
66include:
67 touchpad/basic-after-suspend certification-status=blocker
68 touchpad/detected-as-mouse-after-suspend certification-status=blocker
69 touchpad/continuous-move-after-suspend certification-status=blocker
70 touchpad/horizontal-after-suspend certification-status=blocker
71 touchpad/vertical-after-suspend certification-status=blocker
72 touchpad/singletouch-automated-after-suspend certification-status=blocker
73 touchpad/singletouch-selection-after-suspend certification-status=blocker
74 touchpad/drag-and-drop-after-suspend certification-status=blocker
75 touchpad/multitouch-automated-after-suspend certification-status=blocker
76 touchpad/multitouch-manual-after-suspend certification-status=blocker
77 touchpad/multitouch-rightclick-after-suspend certification-status=blocker
78 touchpad/multitouch-horizontal-after-suspend certification-status=blocker
79 touchpad/multitouch-vertical-after-suspend certification-status=blocker
diff --git a/units/touchscreen/test-plan.pxu b/units/touchscreen/test-plan.pxu
index eaba085..e984af9 100644
--- a/units/touchscreen/test-plan.pxu
+++ b/units/touchscreen/test-plan.pxu
@@ -9,3 +9,13 @@ include:
9 touchscreen/3-touch-tap certification-status=blocker9 touchscreen/3-touch-tap certification-status=blocker
10 touchscreen/4-touch-tap certification-status=blocker10 touchscreen/4-touch-tap certification-status=blocker
11 touchscreen/multitouch-dash certification-status=non-blocker11 touchscreen/multitouch-dash certification-status=non-blocker
12
13id: touchscreen-cert-blockers
14unit: test plan
15_name: Touchscreen tests (certification blockers only)
16_description: Touchscreen tests (certification blockers only)
17include:
18 touchscreen/drag-n-drop certification-status=blocker
19 touchscreen/multitouch-zoom certification-status=blocker
20 touchscreen/3-touch-tap certification-status=blocker
21 touchscreen/4-touch-tap certification-status=blocker
diff --git a/units/usb/test-plan.pxu b/units/usb/test-plan.pxu
index 5588110..96ece6d 100644
--- a/units/usb/test-plan.pxu
+++ b/units/usb/test-plan.pxu
@@ -49,3 +49,41 @@ include:
49 suspend/usb3_insert_after_suspend certification-status=blocker49 suspend/usb3_insert_after_suspend certification-status=blocker
50 suspend/usb3_storage_automated_after_suspend certification-status=blocker50 suspend/usb3_storage_automated_after_suspend certification-status=blocker
51 suspend/usb3_remove_after_suspend certification-status=blocker51 suspend/usb3_remove_after_suspend certification-status=blocker
52
53id: usb-cert-blockers
54unit: test plan
55_name: USB tests (certification blockers only)
56_description: USB tests (certification blockers only)
57include:
58 usb/detect certification-status=blocker
59 usb/HID certification-status=blocker
60 usb/insert certification-status=blocker
61 usb/storage-automated certification-status=blocker
62 usb/remove certification-status=blocker
63
64id: usb3-cert-blockers
65unit: test plan
66_name: USB3 tests (certification blockers only)
67_description: USB3 tests (certification blockers only)
68include:
69 usb3/insert certification-status=blocker
70 usb3/storage-automated certification-status=blocker
71 usb3/remove certification-status=blocker
72
73id: after-suspend-usb-cert-blockers
74unit: test plan
75_name: USB tests (after suspend, certification blockers only)
76_description: USB tests (after suspend, certification blockers only)
77include:
78 suspend/usb_insert_after_suspend certification-status=blocker
79 suspend/usb_storage_automated_after_suspend certification-status=blocker
80 suspend/usb_remove_after_suspend certification-status=blocker
81
82id: after-suspend-usb3-cert-blockers
83unit: test plan
84_name: USB3 tests (after suspend, certification blockers only)
85_description: USB3 tests (after suspend, certification blockers only)
86include:
87 suspend/usb3_insert_after_suspend certification-status=blocker
88 suspend/usb3_storage_automated_after_suspend certification-status=blocker
89 suspend/usb3_remove_after_suspend certification-status=blocker
diff --git a/units/wireless/test-plan.pxu b/units/wireless/test-plan.pxu
index b2c73ff..b4cf2f7 100644
--- a/units/wireless/test-plan.pxu
+++ b/units/wireless/test-plan.pxu
@@ -3,6 +3,22 @@ unit: test plan
3_name: Wireless tests3_name: Wireless tests
4_description: Wireless connection tests4_description: Wireless connection tests
5include:5include:
6nested_part:
7 wireless-cert-automated
8
9id: after-suspend-wireless-cert-full
10unit: test plan
11_name: Wireless tests (after suspend)
12_description: Wireless connection tests (after suspend)
13include:
14nested_part:
15 after-suspend-wireless-cert-automated
16
17id: wireless-cert-automated
18unit: test plan
19_name: Wireless tests
20_description: Wireless connection tests
21include:
6 wireless/wireless_scanning certification-status=blocker22 wireless/wireless_scanning certification-status=blocker
7 wireless/wireless_connection_wpa_bg certification-status=blocker23 wireless/wireless_connection_wpa_bg certification-status=blocker
8 wireless/wireless_connection_open_bg certification-status=blocker24 wireless/wireless_connection_open_bg certification-status=blocker
@@ -11,10 +27,36 @@ include:
11 wireless/wireless_connection_wpa_ac certification-status=blocker27 wireless/wireless_connection_wpa_ac certification-status=blocker
12 wireless/wireless_connection_open_ac certification-status=blocker28 wireless/wireless_connection_open_ac certification-status=blocker
1329
14id: after-suspend-wireless-cert-full30id: after-suspend-wireless-cert-automated
15unit: test plan31unit: test plan
16_name: Wireless tests (after suspend)32_name: Wireless tests (after suspend, automated)
17_description: Wireless connection tests (after suspend)33_description: Wireless connection tests (after suspend, automated)
34include:
35 suspend/wireless_connection_after_suspend_wpa_bg certification-status=blocker
36 suspend/wireless_connection_after_suspend_open_bg certification-status=blocker
37 suspend/wireless_connection_after_suspend_wpa_n certification-status=blocker
38 suspend/wireless_connection_after_suspend_open_n certification-status=blocker
39 suspend/wireless_connection_after_suspend_wpa_ac certification-status=blocker
40 suspend/wireless_connection_after_suspend_open_ac certification-status=blocker
41
42id: wireless-cert-blockers
43unit: test plan
44_name: Wireless tests (certification blockers only)
45_description: Wireless connection tests (certification blockers only)
46include:
47 wireless/wireless_scanning certification-status=blocker
48 wireless/wireless_connection_wpa_bg certification-status=blocker
49 wireless/wireless_connection_open_bg certification-status=blocker
50 wireless/wireless_connection_wpa_n certification-status=blocker
51 wireless/wireless_connection_open_n certification-status=blocker
52 wireless/wireless_connection_wpa_ac certification-status=blocker
53 wireless/wireless_connection_open_ac certification-status=blocker
54
55id: after-suspend-wireless-cert-blockers
56unit: test plan
57_name: Wireless tests (after suspend, certification blockers only)
58_description:
59 Wireless connection tests (after suspend, certification blockers only)
18include:60include:
19 suspend/wireless_connection_after_suspend_wpa_bg certification-status=blocker61 suspend/wireless_connection_after_suspend_wpa_bg certification-status=blocker
20 suspend/wireless_connection_after_suspend_open_bg certification-status=blocker62 suspend/wireless_connection_after_suspend_open_bg certification-status=blocker

Subscribers

People subscribed via source and target branches