Merge ~sylvain-pineau/plainbox-provider-checkbox:blockers-auto-nested-parts into plainbox-provider-checkbox:master
- Git
- lp:~sylvain-pineau/plainbox-provider-checkbox
- blockers-auto-nested-parts
- Merge into master
Proposed by
Sylvain Pineau
Status: | Merged |
---|---|
Approved by: | Sylvain Pineau |
Approved revision: | 704d45e3a86d7efc226685da2cf065ab4cc77442 |
Merged at revision: | 1b90e960b7096bd2d30e5a2c28381f11fcd6f0dc |
Proposed branch: | ~sylvain-pineau/plainbox-provider-checkbox:blockers-auto-nested-parts |
Merge into: | plainbox-provider-checkbox:master |
Diff against target: |
940 lines (+655/-23) 25 files modified
units/audio/test-plan.pxu (+37/-0) units/bluetooth/test-plan.pxu (+15/-0) units/camera/test-plan.pxu (+26/-0) units/cpu/test-plan.pxu (+25/-3) units/disk/test-plan.pxu (+9/-0) units/esata/test-plan.pxu (+9/-0) units/firewire/test-plan.pxu (+9/-0) units/graphics/test-plan.pxu (+66/-0) units/hibernate/test-plan.pxu (+1/-1) units/input/test-plan.pxu (+17/-0) units/keys/test-plan.pxu (+17/-0) units/mediacard/test-plan.pxu (+24/-0) units/miscellanea/test-plan.pxu (+25/-0) units/mobilebroadband/test-plan.pxu (+8/-0) units/monitor/test-plan.pxu (+39/-0) units/networking/test-plan.pxu (+25/-0) units/optical/test-plan.pxu (+14/-0) units/power-management/test-plan.pxu (+43/-3) units/stress/test-plan.pxu (+49/-5) units/suspend/test-plan.pxu (+57/-8) units/thunderbolt/test-plan.pxu (+9/-0) units/touchpad/test-plan.pxu (+38/-0) units/touchscreen/test-plan.pxu (+10/-0) units/usb/test-plan.pxu (+38/-0) units/wireless/test-plan.pxu (+45/-3) |
Related bugs: |
Reviewer | Review Type | Date Requested | Status |
---|---|---|---|
Sylvain Pineau (community) | Approve | ||
Review via email: mp+331290@code.launchpad.net |
Commit message
Description of the change
This MR adds several new test plans meant to be used to create fully automated and certification blockers only test plans.
Provider validation passes (no clashes with other providers units).
To post a comment you must log in.
Preview Diff
[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1 | diff --git a/units/audio/test-plan.pxu b/units/audio/test-plan.pxu | |||
2 | index a1c298e..b425c57 100644 | |||
3 | --- a/units/audio/test-plan.pxu | |||
4 | +++ b/units/audio/test-plan.pxu | |||
5 | @@ -27,3 +27,40 @@ include: | |||
6 | 27 | suspend/microphone-plug-detection-after-suspend certification-status=blocker | 27 | suspend/microphone-plug-detection-after-suspend certification-status=blocker |
7 | 28 | suspend/playback_headphones-after-suspend certification-status=blocker | 28 | suspend/playback_headphones-after-suspend certification-status=blocker |
8 | 29 | suspend/alsa_record_playback_external-after-suspend certification-status=blocker | 29 | suspend/alsa_record_playback_external-after-suspend certification-status=blocker |
9 | 30 | |||
10 | 31 | id: audio-cert-automated | ||
11 | 32 | unit: test plan | ||
12 | 33 | _name: Audio tests (automated) | ||
13 | 34 | _description: | ||
14 | 35 | Audio tests (automated) | ||
15 | 36 | include: | ||
16 | 37 | audio/alsa_info_collect | ||
17 | 38 | audio/alsa_info_attachment | ||
18 | 39 | audio/list_devices | ||
19 | 40 | |||
20 | 41 | id: audio-cert-blockers | ||
21 | 42 | unit: test plan | ||
22 | 43 | _name: Audio tests (certification blockers only) | ||
23 | 44 | _description: | ||
24 | 45 | Audio tests (certification blockers only) | ||
25 | 46 | See Monitor / Graphic test plans for hybrid-graphic monitor audio tests | ||
26 | 47 | include: | ||
27 | 48 | audio/alsa_info_collect | ||
28 | 49 | audio/alsa_info_attachment | ||
29 | 50 | audio/list_devices | ||
30 | 51 | audio/speaker-headphone-plug-detection certification-status=blocker | ||
31 | 52 | audio/microphone-plug-detection certification-status=blocker | ||
32 | 53 | audio/playback_headphones certification-status=blocker | ||
33 | 54 | audio/alsa_record_playback_external certification-status=blocker | ||
34 | 55 | audio/playback_auto certification-status=blocker | ||
35 | 56 | audio/alsa_record_playback_internal certification-status=blocker | ||
36 | 57 | |||
37 | 58 | id: after-suspend-audio-cert-blockers | ||
38 | 59 | unit: test plan | ||
39 | 60 | _name: Audio tests (after suspend, certification blockers only) | ||
40 | 61 | _description: Audio tests (after suspend, certification blockers only) | ||
41 | 62 | include: | ||
42 | 63 | suspend/speaker-headphone-plug-detection-after-suspend certification-status=blocker | ||
43 | 64 | suspend/microphone-plug-detection-after-suspend certification-status=blocker | ||
44 | 65 | suspend/playback_headphones-after-suspend certification-status=blocker | ||
45 | 66 | suspend/alsa_record_playback_external-after-suspend certification-status=blocker | ||
46 | diff --git a/units/bluetooth/test-plan.pxu b/units/bluetooth/test-plan.pxu | |||
47 | index ded7c5b..e6d64e9 100644 | |||
48 | --- a/units/bluetooth/test-plan.pxu | |||
49 | +++ b/units/bluetooth/test-plan.pxu | |||
50 | @@ -10,3 +10,18 @@ include: | |||
51 | 10 | bluetooth/HID | 10 | bluetooth/HID |
52 | 11 | bluetooth4/HOGP-mouse certification-status=blocker | 11 | bluetooth4/HOGP-mouse certification-status=blocker |
53 | 12 | bluetooth4/HOGP-keyboard certification-status=blocker | 12 | bluetooth4/HOGP-keyboard certification-status=blocker |
54 | 13 | |||
55 | 14 | id: bluetooth-cert-automated | ||
56 | 15 | unit: test plan | ||
57 | 16 | _name: Bluetooth tests (automated) | ||
58 | 17 | _description: Bluetooth tests (automated) | ||
59 | 18 | include: | ||
60 | 19 | bluetooth/detect-output | ||
61 | 20 | |||
62 | 21 | id: bluetooth-cert-blockers | ||
63 | 22 | unit: test plan | ||
64 | 23 | _name: Bluetooth tests (certification blockers only) | ||
65 | 24 | _description: Bluetooth tests (certification blockers only) | ||
66 | 25 | include: | ||
67 | 26 | bluetooth4/HOGP-mouse certification-status=blocker | ||
68 | 27 | bluetooth4/HOGP-keyboard certification-status=blocker | ||
69 | diff --git a/units/camera/test-plan.pxu b/units/camera/test-plan.pxu | |||
70 | index 998be60..2cf5550 100644 | |||
71 | --- a/units/camera/test-plan.pxu | |||
72 | +++ b/units/camera/test-plan.pxu | |||
73 | @@ -15,3 +15,29 @@ _description: Camera tests (after suspend) | |||
74 | 15 | include: | 15 | include: |
75 | 16 | camera/display_after_suspend certification-status=blocker | 16 | camera/display_after_suspend certification-status=blocker |
76 | 17 | camera/still_after_suspend certification-status=blocker | 17 | camera/still_after_suspend certification-status=blocker |
77 | 18 | |||
78 | 19 | id: camera-cert-automated | ||
79 | 20 | unit: test plan | ||
80 | 21 | _name: Camera tests (automated) | ||
81 | 22 | _description: Camera tests (automated) | ||
82 | 23 | include: | ||
83 | 24 | camera/detect certification-status=blocker | ||
84 | 25 | camera/multiple-resolution-images certification-status=blocker | ||
85 | 26 | |||
86 | 27 | id: camera-cert-blockers | ||
87 | 28 | unit: test plan | ||
88 | 29 | _name: Camera tests (certification blockers only) | ||
89 | 30 | _description: Camera tests (certification blockers only) | ||
90 | 31 | include: | ||
91 | 32 | camera/detect certification-status=blocker | ||
92 | 33 | camera/still certification-status=blocker | ||
93 | 34 | camera/display certification-status=blocker | ||
94 | 35 | camera/multiple-resolution-images certification-status=blocker | ||
95 | 36 | |||
96 | 37 | id: after-suspend-camera-cert-blockers | ||
97 | 38 | unit: test plan | ||
98 | 39 | _name: Camera tests (after suspend, certification blockers only) | ||
99 | 40 | _description: Camera tests (after suspend, certification blockers only) | ||
100 | 41 | include: | ||
101 | 42 | camera/display_after_suspend certification-status=blocker | ||
102 | 43 | camera/still_after_suspend certification-status=blocker | ||
103 | diff --git a/units/cpu/test-plan.pxu b/units/cpu/test-plan.pxu | |||
104 | index c6b6fd7..2678c31 100644 | |||
105 | --- a/units/cpu/test-plan.pxu | |||
106 | +++ b/units/cpu/test-plan.pxu | |||
107 | @@ -3,12 +3,34 @@ unit: test plan | |||
108 | 3 | _name: CPU tests | 3 | _name: CPU tests |
109 | 4 | _description: CPU tests | 4 | _description: CPU tests |
110 | 5 | include: | 5 | include: |
111 | 6 | nested_part: | ||
112 | 7 | cpu-cert-automated | ||
113 | 8 | |||
114 | 9 | id: cpu-cert-automated | ||
115 | 10 | unit: test plan | ||
116 | 11 | _name: CPU tests (automated) | ||
117 | 12 | _description: CPU tests (automated) | ||
118 | 13 | include: | ||
119 | 6 | cpu/cstates certification-status=blocker | 14 | cpu/cstates certification-status=blocker |
121 | 7 | cpu/cstates_results.log | 15 | cpu/cstates_results.log |
122 | 8 | cpu/scaling_test certification-status=blocker | 16 | cpu/scaling_test certification-status=blocker |
124 | 9 | cpu/scaling_test-log-attach | 17 | cpu/scaling_test-log-attach |
125 | 10 | cpu/maxfreq_test certification-status=blocker | 18 | cpu/maxfreq_test certification-status=blocker |
127 | 11 | cpu/maxfreq_test-log-attach | 19 | cpu/maxfreq_test-log-attach |
128 | 12 | cpu/offlining_test certification-status=blocker | 20 | cpu/offlining_test certification-status=blocker |
129 | 13 | cpu/topology certification-status=blocker | 21 | cpu/topology certification-status=blocker |
130 | 14 | cpu/clocktest | 22 | cpu/clocktest |
131 | 23 | |||
132 | 24 | id: cpu-cert-blockers | ||
133 | 25 | unit: test plan | ||
134 | 26 | _name: CPU tests (certification blockers only) | ||
135 | 27 | _description: CPU tests (certification blockers only) | ||
136 | 28 | include: | ||
137 | 29 | cpu/cstates certification-status=blocker | ||
138 | 30 | cpu/cstates_results.log | ||
139 | 31 | cpu/scaling_test certification-status=blocker | ||
140 | 32 | cpu/scaling_test-log-attach | ||
141 | 33 | cpu/maxfreq_test certification-status=blocker | ||
142 | 34 | cpu/maxfreq_test-log-attach | ||
143 | 35 | cpu/offlining_test certification-status=blocker | ||
144 | 36 | cpu/topology certification-status=blocker | ||
145 | diff --git a/units/disk/test-plan.pxu b/units/disk/test-plan.pxu | |||
146 | index cc7f176..08974cb 100644 | |||
147 | --- a/units/disk/test-plan.pxu | |||
148 | +++ b/units/disk/test-plan.pxu | |||
149 | @@ -18,3 +18,12 @@ include: | |||
150 | 18 | benchmarks/disk/hdparm-read_.* | 18 | benchmarks/disk/hdparm-read_.* |
151 | 19 | benchmarks/disk/hdparm-cache-read_.* | 19 | benchmarks/disk/hdparm-cache-read_.* |
152 | 20 | disk/apste_support_on_.* | 20 | disk/apste_support_on_.* |
153 | 21 | |||
154 | 22 | id: disk-cert-blockers | ||
155 | 23 | unit: test plan | ||
156 | 24 | _name: Disk tests (certification blockers only) | ||
157 | 25 | _description: Disk tests (certification blockers only) | ||
158 | 26 | include: | ||
159 | 27 | disk/detect certification-status=blocker | ||
160 | 28 | disk/read_performance_.* certification-status=blocker | ||
161 | 29 | disk/storage_device_.* certification-status=blocker | ||
162 | diff --git a/units/esata/test-plan.pxu b/units/esata/test-plan.pxu | |||
163 | index ef30569..b7e59cd 100644 | |||
164 | --- a/units/esata/test-plan.pxu | |||
165 | +++ b/units/esata/test-plan.pxu | |||
166 | @@ -6,3 +6,12 @@ include: | |||
167 | 6 | esata/insert certification-status=blocker | 6 | esata/insert certification-status=blocker |
168 | 7 | esata/storage-test certification-status=blocker | 7 | esata/storage-test certification-status=blocker |
169 | 8 | esata/remove certification-status=blocker | 8 | esata/remove certification-status=blocker |
170 | 9 | |||
171 | 10 | id: esata-cert-blockers | ||
172 | 11 | unit: test plan | ||
173 | 12 | _name: eSATA tests (certification blockers only) | ||
174 | 13 | _description: eSATA tests (certification blockers only) | ||
175 | 14 | include: | ||
176 | 15 | esata/insert certification-status=blocker | ||
177 | 16 | esata/storage-test certification-status=blocker | ||
178 | 17 | esata/remove certification-status=blocker | ||
179 | diff --git a/units/firewire/test-plan.pxu b/units/firewire/test-plan.pxu | |||
180 | index 5409e06..ecb6084 100644 | |||
181 | --- a/units/firewire/test-plan.pxu | |||
182 | +++ b/units/firewire/test-plan.pxu | |||
183 | @@ -6,3 +6,12 @@ include: | |||
184 | 6 | firewire/insert certification-status=blocker | 6 | firewire/insert certification-status=blocker |
185 | 7 | firewire/storage-test certification-status=blocker | 7 | firewire/storage-test certification-status=blocker |
186 | 8 | firewire/remove certification-status=blocker | 8 | firewire/remove certification-status=blocker |
187 | 9 | |||
188 | 10 | id: firewire-cert-blockers | ||
189 | 11 | unit: test plan | ||
190 | 12 | _name: Firewire tests (certification blockers only) | ||
191 | 13 | _description: Firewire tests (certification blockers only) | ||
192 | 14 | include: | ||
193 | 15 | firewire/insert certification-status=blocker | ||
194 | 16 | firewire/storage-test certification-status=blocker | ||
195 | 17 | firewire/remove certification-status=blocker | ||
196 | diff --git a/units/graphics/test-plan.pxu b/units/graphics/test-plan.pxu | |||
197 | index d292060..a85b194 100644 | |||
198 | --- a/units/graphics/test-plan.pxu | |||
199 | +++ b/units/graphics/test-plan.pxu | |||
200 | @@ -76,3 +76,69 @@ include: | |||
201 | 76 | suspend/2_video_after_suspend_.*_xenial certification-status=blocker | 76 | suspend/2_video_after_suspend_.*_xenial certification-status=blocker |
202 | 77 | suspend/2_cycle_resolutions_after_suspend_.*_xenial certification-status=non-blocker | 77 | suspend/2_cycle_resolutions_after_suspend_.*_xenial certification-status=non-blocker |
203 | 78 | suspend/2_xrandr_screens_after_suspend_.*.tar.gz_xenial | 78 | suspend/2_xrandr_screens_after_suspend_.*.tar.gz_xenial |
204 | 79 | |||
205 | 80 | id: graphics-integrated-gpu-cert-blockers | ||
206 | 81 | unit: test plan | ||
207 | 82 | _name: Graphics tests (integrated GPU, certification blockers only) | ||
208 | 83 | _description: Graphics tests (integrated GPU, certification blockers only) | ||
209 | 84 | include: | ||
210 | 85 | graphics/xorg-version certification-status=blocker | ||
211 | 86 | graphics/xorg-failsafe certification-status=blocker | ||
212 | 87 | graphics/xorg-process certification-status=blocker | ||
213 | 88 | graphics/VESA_drivers_not_in_use certification-status=blocker | ||
214 | 89 | graphics/1_maximum_resolution_.* certification-status=blocker | ||
215 | 90 | graphics/1_glxgears_.* certification-status=blocker | ||
216 | 91 | graphics/1_driver_version_.* certification-status=blocker | ||
217 | 92 | graphics/1_compiz_check_.* certification-status=blocker | ||
218 | 93 | graphics/1_rotation_.* certification-status=blocker | ||
219 | 94 | graphics/1_video_.* certification-status=blocker | ||
220 | 95 | bootstrap_include: | ||
221 | 96 | graphics_card | ||
222 | 97 | |||
223 | 98 | id: graphics-discrete-gpu-cert-blockers | ||
224 | 99 | unit: test plan | ||
225 | 100 | _name: Graphics tests (discrete GPU, certification blockers only) | ||
226 | 101 | _description: Graphics tests (discrete GPU, certification blockers only) | ||
227 | 102 | include: | ||
228 | 103 | graphics/2_switch_card_.*_xenial certification-status=blocker | ||
229 | 104 | graphics/2_maximum_resolution_.* certification-status=blocker | ||
230 | 105 | graphics/2_valid_opengl_renderer_.* certification-status=blocker | ||
231 | 106 | graphics/2_glxgears_.* certification-status=blocker | ||
232 | 107 | graphics/2_driver_version_.* certification-status=blocker | ||
233 | 108 | graphics/2_compiz_check_.* certification-status=blocker | ||
234 | 109 | graphics/2_rotation_.* certification-status=blocker | ||
235 | 110 | graphics/2_video_.* certification-status=blocker | ||
236 | 111 | bootstrap_include: | ||
237 | 112 | graphics_card | ||
238 | 113 | |||
239 | 114 | id: after-suspend-graphics-integrated-gpu-cert-blockers | ||
240 | 115 | unit: test plan | ||
241 | 116 | _name: After suspend tests (integrated GPU, certification blockers only) | ||
242 | 117 | _description: After suspend tests (integrated GPU, certification blockers only) | ||
243 | 118 | include: | ||
244 | 119 | graphics/1_switch_card_.*_xenial certification-status=blocker | ||
245 | 120 | suspend/1_resolution_before_suspend_.*_xenial certification-status=blocker | ||
246 | 121 | suspend/suspend_advanced certification-status=blocker | ||
247 | 122 | power-management/lid certification-status=blocker | ||
248 | 123 | power-management/lid_close certification-status=blocker | ||
249 | 124 | power-management/lid_open certification-status=blocker | ||
250 | 125 | suspend/1_compiz_check_after_suspend_.*_xenial certification-status=blocker | ||
251 | 126 | suspend/1_driver_version_after_suspend_.*_xenial certification-status=blocker | ||
252 | 127 | suspend/1_resolution_after_suspend_.*_xenial certification-status=blocker | ||
253 | 128 | suspend/1_display_after_suspend_.*_xenial certification-status=blocker | ||
254 | 129 | suspend/1_glxgears_after_suspend_.*_xenial certification-status=blocker | ||
255 | 130 | suspend/1_video_after_suspend_.*_xenial certification-status=blocker | ||
256 | 131 | |||
257 | 132 | id: after-suspend-graphics-discrete-gpu-cert-blockers | ||
258 | 133 | unit: test plan | ||
259 | 134 | _name: After suspend tests (discrete GPU, certification blockers only) | ||
260 | 135 | _description: After suspend tests (discrete GPU, certification blockers only) | ||
261 | 136 | include: | ||
262 | 137 | suspend/2_resolution_before_suspend_.*_xenial certification-status=blocker | ||
263 | 138 | suspend/2_suspend_after_switch_to_card_.*_xenial certification-status=blocker | ||
264 | 139 | suspend/2_compiz_check_after_suspend_.*_xenial certification-status=blocker | ||
265 | 140 | suspend/2_driver_version_after_suspend_.*_xenial certification-status=blocker | ||
266 | 141 | suspend/2_resolution_after_suspend_.*_xenial certification-status=blocker | ||
267 | 142 | suspend/2_display_after_suspend_.*_xenial certification-status=blocker | ||
268 | 143 | suspend/2_glxgears_after_suspend_.*_xenial certification-status=blocker | ||
269 | 144 | suspend/2_video_after_suspend_.*_xenial certification-status=blocker | ||
270 | diff --git a/units/hibernate/test-plan.pxu b/units/hibernate/test-plan.pxu | |||
271 | index 3c0f12a..8514f12 100644 | |||
272 | --- a/units/hibernate/test-plan.pxu | |||
273 | +++ b/units/hibernate/test-plan.pxu | |||
274 | @@ -5,7 +5,7 @@ _description: Hibernate tests (integrated GPU) | |||
275 | 5 | include: | 5 | include: |
276 | 6 | power-management/1_hibernate_advanced_.* certification-status=non-blocker | 6 | power-management/1_hibernate_advanced_.* certification-status=non-blocker |
277 | 7 | power-management/1_hibernate-single-log-attach_.* | 7 | power-management/1_hibernate-single-log-attach_.* |
279 | 8 | keys/hibernate certification-status=blocker | 8 | keys/hibernate certification-status=non-blocker |
280 | 9 | 9 | ||
281 | 10 | id: hibernate-discrete-gpu-cert-full | 10 | id: hibernate-discrete-gpu-cert-full |
282 | 11 | unit: test plan | 11 | unit: test plan |
283 | diff --git a/units/input/test-plan.pxu b/units/input/test-plan.pxu | |||
284 | index a0877c5..8033883 100644 | |||
285 | --- a/units/input/test-plan.pxu | |||
286 | +++ b/units/input/test-plan.pxu | |||
287 | @@ -15,3 +15,20 @@ _description: Input tests (after suspend) | |||
288 | 15 | include: | 15 | include: |
289 | 16 | suspend/pointing-after-suspend_.* certification-status=blocker | 16 | suspend/pointing-after-suspend_.* certification-status=blocker |
290 | 17 | suspend/clicking-after-suspend_.* certification-status=blocker | 17 | suspend/clicking-after-suspend_.* certification-status=blocker |
291 | 18 | |||
292 | 19 | id: input-cert-blockers | ||
293 | 20 | unit: test plan | ||
294 | 21 | _name: Input tests (certification blockers only) | ||
295 | 22 | _description: Input tests (certification blockers only) | ||
296 | 23 | include: | ||
297 | 24 | input/pointing_.* certification-status=blocker | ||
298 | 25 | input/clicking_.* certification-status=blocker | ||
299 | 26 | input/keyboard certification-status=blocker | ||
300 | 27 | |||
301 | 28 | id: after-suspend-input-cert-blockers | ||
302 | 29 | unit: test plan | ||
303 | 30 | _name: Input tests (after suspend, certification blockers only) | ||
304 | 31 | _description: Input tests (after suspend, certification blockers only) | ||
305 | 32 | include: | ||
306 | 33 | suspend/pointing-after-suspend_.* certification-status=blocker | ||
307 | 34 | suspend/clicking-after-suspend_.* certification-status=blocker | ||
308 | diff --git a/units/keys/test-plan.pxu b/units/keys/test-plan.pxu | |||
309 | index b2e3f91..ebd1696 100644 | |||
310 | --- a/units/keys/test-plan.pxu | |||
311 | +++ b/units/keys/test-plan.pxu | |||
312 | @@ -13,3 +13,20 @@ include: | |||
313 | 13 | keys/volume certification-status=blocker | 13 | keys/volume certification-status=blocker |
314 | 14 | keys/video-out certification-status=blocker | 14 | keys/video-out certification-status=blocker |
315 | 15 | keys/wireless certification-status=blocker | 15 | keys/wireless certification-status=blocker |
316 | 16 | |||
317 | 17 | id: keys-cert-blockers | ||
318 | 18 | unit: test plan | ||
319 | 19 | _name: Special keys tests (certification blockers only) | ||
320 | 20 | _description: | ||
321 | 21 | Special keys tests (w/o sleep/hibernate keys, see Power Management test plans) | ||
322 | 22 | (certification blockers only) | ||
323 | 23 | include: | ||
324 | 24 | keys/lock-screen certification-status=blocker | ||
325 | 25 | keys/super certification-status=blocker | ||
326 | 26 | keys/battery-info certification-status=blocker | ||
327 | 27 | keys/brightness certification-status=blocker | ||
328 | 28 | keys/media-control certification-status=blocker | ||
329 | 29 | keys/mute certification-status=blocker | ||
330 | 30 | keys/volume certification-status=blocker | ||
331 | 31 | keys/video-out certification-status=blocker | ||
332 | 32 | keys/wireless certification-status=blocker | ||
333 | diff --git a/units/mediacard/test-plan.pxu b/units/mediacard/test-plan.pxu | |||
334 | index eafadd8..087e556 100644 | |||
335 | --- a/units/mediacard/test-plan.pxu | |||
336 | +++ b/units/mediacard/test-plan.pxu | |||
337 | @@ -21,3 +21,27 @@ include: | |||
338 | 21 | suspend/sdhc-insert-after-suspend certification-status=blocker | 21 | suspend/sdhc-insert-after-suspend certification-status=blocker |
339 | 22 | suspend/sdhc-storage-after-suspend certification-status=blocker | 22 | suspend/sdhc-storage-after-suspend certification-status=blocker |
340 | 23 | suspend/sdhc-remove-after-suspend certification-status=blocker | 23 | suspend/sdhc-remove-after-suspend certification-status=blocker |
341 | 24 | |||
342 | 25 | id: mediacard-cert-blockers | ||
343 | 26 | unit: test plan | ||
344 | 27 | _name: Mediacard tests (certification blockers only) | ||
345 | 28 | _description: Mediacard tests (certification blockers only) | ||
346 | 29 | include: | ||
347 | 30 | mediacard/sd-insert certification-status=blocker | ||
348 | 31 | mediacard/sd-storage certification-status=blocker | ||
349 | 32 | mediacard/sd-remove certification-status=blocker | ||
350 | 33 | mediacard/sdhc-insert certification-status=blocker | ||
351 | 34 | mediacard/sdhc-storage certification-status=blocker | ||
352 | 35 | mediacard/sdhc-remove certification-status=blocker | ||
353 | 36 | |||
354 | 37 | id: after-suspend-mediacard-cert-blockers | ||
355 | 38 | unit: test plan | ||
356 | 39 | _name: Mediacard tests (after suspend, certification blockers only) | ||
357 | 40 | _description: Mediacard tests (after suspend, certification blockers only) | ||
358 | 41 | include: | ||
359 | 42 | suspend/sd-insert-after-suspend certification-status=blocker | ||
360 | 43 | suspend/sd-storage-after-suspend certification-status=blocker | ||
361 | 44 | suspend/sd-remove-after-suspend certification-status=blocker | ||
362 | 45 | suspend/sdhc-insert-after-suspend certification-status=blocker | ||
363 | 46 | suspend/sdhc-storage-after-suspend certification-status=blocker | ||
364 | 47 | suspend/sdhc-remove-after-suspend certification-status=blocker | ||
365 | diff --git a/units/miscellanea/test-plan.pxu b/units/miscellanea/test-plan.pxu | |||
366 | index eb97d4f..86f502c 100644 | |||
367 | --- a/units/miscellanea/test-plan.pxu | |||
368 | +++ b/units/miscellanea/test-plan.pxu | |||
369 | @@ -3,6 +3,16 @@ unit: test plan | |||
370 | 3 | _name: Miscellaneous client tests | 3 | _name: Miscellaneous client tests |
371 | 4 | _description: Miscellaneous client tests (fwts, dmi, oops) | 4 | _description: Miscellaneous client tests (fwts, dmi, oops) |
372 | 5 | include: | 5 | include: |
373 | 6 | nested_part: | ||
374 | 7 | misc-client-cert-automated | ||
375 | 8 | |||
376 | 9 | id: misc-client-cert-automated | ||
377 | 10 | unit: test plan | ||
378 | 11 | _name: Miscellaneous client tests (automated) | ||
379 | 12 | _description: | ||
380 | 13 | Miscellaneous client tests (fwts, dmi, oops) | ||
381 | 14 | (automated) | ||
382 | 15 | include: | ||
383 | 6 | install/apt-get-gets-updates | 16 | install/apt-get-gets-updates |
384 | 7 | memory/info certification-status=blocker | 17 | memory/info certification-status=blocker |
385 | 8 | firmware/fwts_desktop_diagnosis | 18 | firmware/fwts_desktop_diagnosis |
386 | @@ -17,3 +27,18 @@ include: | |||
387 | 17 | miscellanea/dmitest_client | 27 | miscellanea/dmitest_client |
388 | 18 | bootstrap_include: | 28 | bootstrap_include: |
389 | 19 | fwts | 29 | fwts |
390 | 30 | |||
391 | 31 | id: misc-client-cert-blockers | ||
392 | 32 | unit: test plan | ||
393 | 33 | _name: Miscellaneous client tests (certification blockers only) | ||
394 | 34 | _description: | ||
395 | 35 | Miscellaneous client tests (fwts, dmi, oops) | ||
396 | 36 | (certification blockers only) | ||
397 | 37 | include: | ||
398 | 38 | memory/info certification-status=blocker | ||
399 | 39 | firmware/fwts_wakealarm.* certification-status=blocker | ||
400 | 40 | firmware/fwts_uefirtvariable.* certification-status=blocker | ||
401 | 41 | miscellanea/oops certification-status=blocker | ||
402 | 42 | miscellanea/oops_results.log | ||
403 | 43 | bootstrap_include: | ||
404 | 44 | fwts | ||
405 | diff --git a/units/mobilebroadband/test-plan.pxu b/units/mobilebroadband/test-plan.pxu | |||
406 | index b9901a6..166a297 100644 | |||
407 | --- a/units/mobilebroadband/test-plan.pxu | |||
408 | +++ b/units/mobilebroadband/test-plan.pxu | |||
409 | @@ -3,5 +3,13 @@ unit: test plan | |||
410 | 3 | _name: Mobile broadband tests | 3 | _name: Mobile broadband tests |
411 | 4 | _description: Mobile broadband tests | 4 | _description: Mobile broadband tests |
412 | 5 | include: | 5 | include: |
413 | 6 | nested_part: | ||
414 | 7 | mobilebroadband-cert-automated | ||
415 | 8 | |||
416 | 9 | id: mobilebroadband-cert-automated | ||
417 | 10 | unit: test plan | ||
418 | 11 | _name: Mobile broadband tests (automated) | ||
419 | 12 | _description: Mobile broadband tests (automated) | ||
420 | 13 | include: | ||
421 | 6 | mobilebroadband/gsm_connection certification-status=non-blocker | 14 | mobilebroadband/gsm_connection certification-status=non-blocker |
422 | 7 | mobilebroadband/cdma_connection certification-status=non-blocker | 15 | mobilebroadband/cdma_connection certification-status=non-blocker |
423 | diff --git a/units/monitor/test-plan.pxu b/units/monitor/test-plan.pxu | |||
424 | index d3527da..10976c9 100644 | |||
425 | --- a/units/monitor/test-plan.pxu | |||
426 | +++ b/units/monitor/test-plan.pxu | |||
427 | @@ -45,3 +45,42 @@ include: | |||
428 | 45 | monitor/2_multi-head_.* certification-status=blocker | 45 | monitor/2_multi-head_.* certification-status=blocker |
429 | 46 | bootstrap_include: | 46 | bootstrap_include: |
430 | 47 | graphics_card | 47 | graphics_card |
431 | 48 | |||
432 | 49 | id: monitor-integrated-gpu-cert-blockers | ||
433 | 50 | unit: test plan | ||
434 | 51 | _name: Monitor tests (integrated GPU, certification blockers only) | ||
435 | 52 | _description: Monitor tests (integrated GPU, certification blockers only) | ||
436 | 53 | include: | ||
437 | 54 | monitor/1_powersaving_.* certification-status=blocker | ||
438 | 55 | monitor/1_dim_brightness_.* certification-status=blocker | ||
439 | 56 | monitor/1_displayport_.* certification-status=blocker | ||
440 | 57 | audio/1_playback_displayport_.* certification-status=blocker | ||
441 | 58 | monitor/1_dvi_.* certification-status=blocker | ||
442 | 59 | monitor/1_hdmi_.* certification-status=blocker | ||
443 | 60 | audio/1_playback_hdmi_.* certification-status=blocker | ||
444 | 61 | monitor/1_thunderbolt_.* certification-status=blocker | ||
445 | 62 | audio/1_playback_thunderbolt_.* certification-status=blocker | ||
446 | 63 | thunderbolt/daisy-chain certification-status=blocker | ||
447 | 64 | monitor/1_vga_.* certification-status=blocker | ||
448 | 65 | monitor/1_multi-head_.* certification-status=blocker | ||
449 | 66 | bootstrap_include: | ||
450 | 67 | graphics_card | ||
451 | 68 | |||
452 | 69 | id: monitor-discrete-gpu-cert-blockers | ||
453 | 70 | unit: test plan | ||
454 | 71 | _name: Monitor tests (discrete GPU, certification blockers only) | ||
455 | 72 | _description: Monitor tests (discrete GPU, certification blockers only) | ||
456 | 73 | include: | ||
457 | 74 | monitor/2_powersaving_.* certification-status=blocker | ||
458 | 75 | monitor/2_dim_brightness_.* certification-status=blocker | ||
459 | 76 | monitor/2_displayport_.* certification-status=blocker | ||
460 | 77 | audio/2_playback_displayport_.* certification-status=blocker | ||
461 | 78 | monitor/2_dvi_.* certification-status=blocker | ||
462 | 79 | monitor/2_hdmi_.* certification-status=blocker | ||
463 | 80 | audio/2_playback_hdmi_.* certification-status=blocker | ||
464 | 81 | monitor/2_thunderbolt_.* certification-status=blocker | ||
465 | 82 | audio/2_playback_thunderbolt_.* certification-status=blocker | ||
466 | 83 | monitor/2_vga_.* certification-status=blocker | ||
467 | 84 | monitor/2_multi-head_.* certification-status=blocker | ||
468 | 85 | bootstrap_include: | ||
469 | 86 | graphics_card | ||
470 | diff --git a/units/networking/test-plan.pxu b/units/networking/test-plan.pxu | |||
471 | index ebaee65..ade662a 100644 | |||
472 | --- a/units/networking/test-plan.pxu | |||
473 | +++ b/units/networking/test-plan.pxu | |||
474 | @@ -3,6 +3,31 @@ unit: test plan | |||
475 | 3 | _name: Networking tests | 3 | _name: Networking tests |
476 | 4 | _description: Networking tests | 4 | _description: Networking tests |
477 | 5 | include: | 5 | include: |
478 | 6 | nested_part: | ||
479 | 7 | networking-cert-automated | ||
480 | 8 | networking-cert-manual | ||
481 | 9 | |||
482 | 10 | id: networking-cert-manual | ||
483 | 11 | unit: test plan | ||
484 | 12 | _name: Networking tests (manual) | ||
485 | 13 | _description: Networking tests (manual) | ||
486 | 14 | include: | ||
487 | 15 | networking/info.* certification-status=blocker | ||
488 | 16 | |||
489 | 17 | id: networking-cert-automated | ||
490 | 18 | unit: test plan | ||
491 | 19 | _name: Networking tests (automated) | ||
492 | 20 | _description: Networking tests (automated) | ||
493 | 21 | include: | ||
494 | 22 | ethernet/detect certification-status=blocker | ||
495 | 23 | networking/gateway_ping certification-status=blocker | ||
496 | 24 | networking/ntp certification-status=blocker | ||
497 | 25 | |||
498 | 26 | id: networking-cert-blockers | ||
499 | 27 | unit: test plan | ||
500 | 28 | _name: Networking tests (certification blockers only) | ||
501 | 29 | _description: Networking tests (certification blockers only) | ||
502 | 30 | include: | ||
503 | 6 | ethernet/detect certification-status=blocker | 31 | ethernet/detect certification-status=blocker |
504 | 7 | networking/gateway_ping certification-status=blocker | 32 | networking/gateway_ping certification-status=blocker |
505 | 8 | networking/info.* certification-status=blocker | 33 | networking/info.* certification-status=blocker |
506 | diff --git a/units/optical/test-plan.pxu b/units/optical/test-plan.pxu | |||
507 | index 7336d45..ba63c28 100644 | |||
508 | --- a/units/optical/test-plan.pxu | |||
509 | +++ b/units/optical/test-plan.pxu | |||
510 | @@ -11,3 +11,17 @@ include: | |||
511 | 11 | optical/bluray-write_.* certification-status=blocker | 11 | optical/bluray-write_.* certification-status=blocker |
512 | 12 | bootstrap_include: | 12 | bootstrap_include: |
513 | 13 | device | 13 | device |
514 | 14 | |||
515 | 15 | id: optical-cert-blockers | ||
516 | 16 | unit: test plan | ||
517 | 17 | _name: Optical drive tests (certification blockers only) | ||
518 | 18 | _description: Optical drive tests (certification blockers only) | ||
519 | 19 | include: | ||
520 | 20 | optical/detect certification-status=blocker | ||
521 | 21 | optical/read_.* certification-status=blocker | ||
522 | 22 | optical/cdrom-write_.* certification-status=blocker | ||
523 | 23 | optical/dvd-write_.* certification-status=blocker | ||
524 | 24 | optical/bluray-read_.* certification-status=blocker | ||
525 | 25 | optical/bluray-write_.* certification-status=blocker | ||
526 | 26 | bootstrap_include: | ||
527 | 27 | device | ||
528 | diff --git a/units/power-management/test-plan.pxu b/units/power-management/test-plan.pxu | |||
529 | index 6a4da12..2cd1a76 100644 | |||
530 | --- a/units/power-management/test-plan.pxu | |||
531 | +++ b/units/power-management/test-plan.pxu | |||
532 | @@ -3,15 +3,55 @@ unit: test plan | |||
533 | 3 | _name: Power Management precheck tests | 3 | _name: Power Management precheck tests |
534 | 4 | _description: Power Management precheck tests | 4 | _description: Power Management precheck tests |
535 | 5 | include: | 5 | include: |
536 | 6 | nested_part: | ||
537 | 7 | power-management-precheck-cert-automated | ||
538 | 8 | |||
539 | 9 | id: power-management-reboot-poweroff-cert | ||
540 | 10 | unit: test plan | ||
541 | 11 | _name: Power Management reboot and power off tests | ||
542 | 12 | _description: Power Management reboot and power off tests | ||
543 | 13 | include: | ||
544 | 14 | nested_part: | ||
545 | 15 | power-management-reboot-poweroff-cert-automated | ||
546 | 16 | |||
547 | 17 | id: power-management-precheck-cert-automated | ||
548 | 18 | unit: test plan | ||
549 | 19 | _name: Power Management precheck tests (automated) | ||
550 | 20 | _description: Power Management precheck tests (automated) | ||
551 | 21 | include: | ||
552 | 6 | power-management/rtc certification-status=blocker | 22 | power-management/rtc certification-status=blocker |
553 | 7 | power-management/tickless_idle certification-status=blocker | 23 | power-management/tickless_idle certification-status=blocker |
554 | 8 | power-management/fwts_wakealarm certification-status=blocker | 24 | power-management/fwts_wakealarm certification-status=blocker |
555 | 9 | power-management/fwts_wakealarm-log-attach | 25 | power-management/fwts_wakealarm-log-attach |
556 | 10 | 26 | ||
558 | 11 | id: power-management-reboot-poweroff-cert | 27 | id: power-management-reboot-poweroff-cert-automated |
559 | 12 | unit: test plan | 28 | unit: test plan |
562 | 13 | _name: Power Management reboot and power off tests | 29 | _name: Power Management reboot and power off tests (automated) |
563 | 14 | _description: Power Management reboot and power off tests | 30 | _description: Power Management reboot and power off tests (automated) |
564 | 31 | include: | ||
565 | 32 | power-management/poweroff certification-status=blocker | ||
566 | 33 | power-management/poweroff-log-attach | ||
567 | 34 | power-management/reboot certification-status=blocker | ||
568 | 35 | power-management/reboot-log-attach | ||
569 | 36 | |||
570 | 37 | id: power-management-precheck-cert-blockers | ||
571 | 38 | unit: test plan | ||
572 | 39 | _name: | ||
573 | 40 | Power Management precheck tests (certification blockers only) | ||
574 | 41 | _description: | ||
575 | 42 | Power Management precheck tests (certification blockers only) | ||
576 | 43 | include: | ||
577 | 44 | power-management/rtc certification-status=blocker | ||
578 | 45 | power-management/tickless_idle certification-status=blocker | ||
579 | 46 | power-management/fwts_wakealarm certification-status=blocker | ||
580 | 47 | power-management/fwts_wakealarm-log-attach | ||
581 | 48 | |||
582 | 49 | id: power-management-reboot-poweroff-cert-blockers | ||
583 | 50 | unit: test plan | ||
584 | 51 | _name: | ||
585 | 52 | Power Management reboot and power off tests (certification blockers only) | ||
586 | 53 | _description: | ||
587 | 54 | Power Management reboot and power off tests (certification blockers only) | ||
588 | 15 | include: | 55 | include: |
589 | 16 | power-management/poweroff certification-status=blocker | 56 | power-management/poweroff certification-status=blocker |
590 | 17 | power-management/poweroff-log-attach | 57 | power-management/poweroff-log-attach |
591 | diff --git a/units/stress/test-plan.pxu b/units/stress/test-plan.pxu | |||
592 | index 6fa0bc3..5f72916 100644 | |||
593 | --- a/units/stress/test-plan.pxu | |||
594 | +++ b/units/stress/test-plan.pxu | |||
595 | @@ -3,9 +3,53 @@ unit: test plan | |||
596 | 3 | _name: Stress tests | 3 | _name: Stress tests |
597 | 4 | _description: Stress tests | 4 | _description: Stress tests |
598 | 5 | include: | 5 | include: |
600 | 6 | power-management/suspend_30_cycles certification-status=blocker | 6 | nested_part: |
601 | 7 | stress-cert-automated | ||
602 | 8 | |||
603 | 9 | id: stress-cert-automated | ||
604 | 10 | unit: test plan | ||
605 | 11 | _name: Stress tests (automated) | ||
606 | 12 | _description: Stress tests (automated) | ||
607 | 13 | include: | ||
608 | 14 | power-management/suspend_30_cycles certification-status=blocker | ||
609 | 15 | power-management/suspend-30-cycle-log-attach | ||
610 | 16 | power-management/suspend-30-cycles-time-check certification-status=non-blocker | ||
611 | 17 | stress/cpu_stress_ng_test certification-status=blocker | ||
612 | 18 | |||
613 | 19 | id: stress-cert-blockers | ||
614 | 20 | unit: test plan | ||
615 | 21 | _name: Stress tests (certification blockers only) | ||
616 | 22 | _description: Stress tests (certification blockers only) | ||
617 | 23 | include: | ||
618 | 24 | power-management/suspend_30_cycles certification-status=blocker | ||
619 | 7 | power-management/suspend-30-cycle-log-attach | 25 | power-management/suspend-30-cycle-log-attach |
624 | 8 | power-management/suspend-30-cycles-time-check certification-status=non-blocker | 26 | stress/cpu_stress_ng_test certification-status=blocker |
625 | 9 | power-management/hibernate_30_cycles certification-status=non-blocker | 27 | |
626 | 10 | power-management/hibernate-30-cycle-log-attach | 28 | id: stress-suspend-30-cycles-with-reboots-automated |
627 | 11 | stress/cpu_stress_test certification-status=blocker | 29 | unit: test plan |
628 | 30 | _name: Suspend stress tests (with reboots) | ||
629 | 31 | _description: Suspend stress tests (with reboots) | ||
630 | 32 | include: | ||
631 | 33 | power-management/suspend_30_cycles_with_reboots | ||
632 | 34 | power-management/suspend-30-cycles-log-check-with-reboots | ||
633 | 35 | power-management/suspend-30-cycle-log-attach-with-reboots | ||
634 | 36 | power-management/suspend-30-cycles-time-check-with-reboots | ||
635 | 37 | |||
636 | 38 | id: stress-30-reboot-poweroff-automated | ||
637 | 39 | unit: test plan | ||
638 | 40 | _name: Power Management reboot and power off stress tests (automated) | ||
639 | 41 | _description: Power Management reboot and power off stress tests (automated) | ||
640 | 42 | include: | ||
641 | 43 | stress/reboot_30 | ||
642 | 44 | stress/reboot_30_log | ||
643 | 45 | stress/poweroff_30 | ||
644 | 46 | stress/poweroff_30_log | ||
645 | 47 | |||
646 | 48 | id: stress-ng-cert-automated | ||
647 | 49 | unit: test plan | ||
648 | 50 | _name: Stress NG tests (automated) | ||
649 | 51 | _description: Stress NG tests (automated) | ||
650 | 52 | include: | ||
651 | 53 | stress/cpu_stress_ng_test certification-status=blocker | ||
652 | 54 | memory/memory_stress_ng certification-status=blocker | ||
653 | 55 | |||
654 | diff --git a/units/suspend/test-plan.pxu b/units/suspend/test-plan.pxu | |||
655 | index bcbe39c..57124f5 100644 | |||
656 | --- a/units/suspend/test-plan.pxu | |||
657 | +++ b/units/suspend/test-plan.pxu | |||
658 | @@ -3,6 +3,33 @@ unit: test plan | |||
659 | 3 | _name: Before suspend reference tests | 3 | _name: Before suspend reference tests |
660 | 4 | _description: Before suspend reference tests | 4 | _description: Before suspend reference tests |
661 | 5 | include: | 5 | include: |
662 | 6 | nested_part: | ||
663 | 7 | before-suspend-reference-cert-automated | ||
664 | 8 | |||
665 | 9 | id: after-suspend-reference-cert-full | ||
666 | 10 | unit: test plan | ||
667 | 11 | _name: After suspend reference tests | ||
668 | 12 | _description: After suspend reference tests | ||
669 | 13 | include: | ||
670 | 14 | nested_part: | ||
671 | 15 | after-suspend-reference-cert-automated | ||
672 | 16 | |||
673 | 17 | id: suspend-key-led-oops-check-cert | ||
674 | 18 | unit: test plan | ||
675 | 19 | _name: After suspend LED and oops tests (using special sleep key) | ||
676 | 20 | _description: After suspend LED and oops tests (using special sleep key) | ||
677 | 21 | include: | ||
678 | 22 | keys/sleep certification-status=blocker | ||
679 | 23 | suspend/oops_after_suspend certification-status=blocker | ||
680 | 24 | suspend/oops_results_after_suspend.log | ||
681 | 25 | led/power-blink-suspend | ||
682 | 26 | led/suspend | ||
683 | 27 | |||
684 | 28 | id: before-suspend-reference-cert-automated | ||
685 | 29 | unit: test plan | ||
686 | 30 | _name: Before suspend reference tests (automated) | ||
687 | 31 | _description: Before suspend reference tests (automated) | ||
688 | 32 | include: | ||
689 | 6 | suspend/network_before_suspend certification-status=blocker | 33 | suspend/network_before_suspend certification-status=blocker |
690 | 7 | suspend/audio_before_suspend certification-status=blocker | 34 | suspend/audio_before_suspend certification-status=blocker |
691 | 8 | suspend/cpu_before_suspend certification-status=blocker | 35 | suspend/cpu_before_suspend certification-status=blocker |
692 | @@ -11,10 +38,10 @@ include: | |||
693 | 11 | suspend/bluetooth_obex_browse_before_suspend | 38 | suspend/bluetooth_obex_browse_before_suspend |
694 | 12 | suspend/bluetooth_obex_get_before_suspend | 39 | suspend/bluetooth_obex_get_before_suspend |
695 | 13 | 40 | ||
697 | 14 | id: after-suspend-reference-cert-full | 41 | id: after-suspend-reference-cert-automated |
698 | 15 | unit: test plan | 42 | unit: test plan |
701 | 16 | _name: After suspend reference tests | 43 | _name: After suspend reference tests (automated) |
702 | 17 | _description: After suspend reference tests | 44 | _description: After suspend reference tests (automated) |
703 | 18 | include: | 45 | include: |
704 | 19 | suspend/network_after_suspend certification-status=blocker | 46 | suspend/network_after_suspend certification-status=blocker |
705 | 20 | suspend/audio_after_suspend certification-status=blocker | 47 | suspend/audio_after_suspend certification-status=blocker |
706 | @@ -25,13 +52,35 @@ include: | |||
707 | 25 | suspend/bluetooth_obex_browse_after_suspend | 52 | suspend/bluetooth_obex_browse_after_suspend |
708 | 26 | suspend/bluetooth_obex_get_after_suspend | 53 | suspend/bluetooth_obex_get_after_suspend |
709 | 27 | 54 | ||
711 | 28 | id: suspend-key-led-oops-check-cert | 55 | id: before-suspend-reference-cert-blockers |
712 | 29 | unit: test plan | 56 | unit: test plan |
715 | 30 | _name: After suspend LED and oops tests (using special sleep key) | 57 | _name: Before suspend reference tests (certification blockers only) |
716 | 31 | _description: After suspend LED and oops tests (using special sleep key) | 58 | _description: Before suspend reference tests (certification blockers only) |
717 | 59 | include: | ||
718 | 60 | suspend/network_before_suspend certification-status=blocker | ||
719 | 61 | suspend/audio_before_suspend certification-status=blocker | ||
720 | 62 | suspend/cpu_before_suspend certification-status=blocker | ||
721 | 63 | suspend/memory_before_suspend certification-status=blocker | ||
722 | 64 | |||
723 | 65 | id: after-suspend-reference-cert-blockers | ||
724 | 66 | unit: test plan | ||
725 | 67 | _name: After suspend reference tests (certification blockers only) | ||
726 | 68 | _description: After suspend reference tests (certification blockers only) | ||
727 | 69 | include: | ||
728 | 70 | suspend/network_after_suspend certification-status=blocker | ||
729 | 71 | suspend/audio_after_suspend certification-status=blocker | ||
730 | 72 | suspend/cpu_after_suspend certification-status=blocker | ||
731 | 73 | suspend/memory_after_suspend certification-status=blocker | ||
732 | 74 | suspend/bluetooth_detect_after_suspend certification-status=blocker | ||
733 | 75 | |||
734 | 76 | id: suspend-key-led-oops-check-cert-blockers | ||
735 | 77 | unit: test plan | ||
736 | 78 | _name: | ||
737 | 79 | After suspend LED and oops tests (using special sleep key, cert. blockers only) | ||
738 | 80 | _description: | ||
739 | 81 | After suspend LED and oops tests (using special sleep key) | ||
740 | 82 | (certification blockers only) | ||
741 | 32 | include: | 83 | include: |
742 | 33 | keys/sleep certification-status=blocker | 84 | keys/sleep certification-status=blocker |
743 | 34 | suspend/oops_after_suspend certification-status=blocker | 85 | suspend/oops_after_suspend certification-status=blocker |
744 | 35 | suspend/oops_results_after_suspend.log | 86 | suspend/oops_results_after_suspend.log |
745 | 36 | led/power-blink-suspend | ||
746 | 37 | led/suspend | ||
747 | diff --git a/units/thunderbolt/test-plan.pxu b/units/thunderbolt/test-plan.pxu | |||
748 | index 686bb82..054bb26 100644 | |||
749 | --- a/units/thunderbolt/test-plan.pxu | |||
750 | +++ b/units/thunderbolt/test-plan.pxu | |||
751 | @@ -9,3 +9,12 @@ include: | |||
752 | 9 | thunderbolt3/insert certification-status=non-blocker | 9 | thunderbolt3/insert certification-status=non-blocker |
753 | 10 | thunderbolt3/storage-test certification-status=non-blocker | 10 | thunderbolt3/storage-test certification-status=non-blocker |
754 | 11 | thunderbolt3/remove certification-status=non-blocker | 11 | thunderbolt3/remove certification-status=non-blocker |
755 | 12 | |||
756 | 13 | id: thunderbolt-cert-blockers | ||
757 | 14 | unit: test plan | ||
758 | 15 | _name: Thunderbolt tests (certification blockers only) | ||
759 | 16 | _description: Thunderbolt tests (certification blockers only) | ||
760 | 17 | include: | ||
761 | 18 | thunderbolt/insert certification-status=blocker | ||
762 | 19 | thunderbolt/storage-test certification-status=blocker | ||
763 | 20 | thunderbolt/remove certification-status=blocker | ||
764 | diff --git a/units/touchpad/test-plan.pxu b/units/touchpad/test-plan.pxu | |||
765 | index b270d92..7514991 100644 | |||
766 | --- a/units/touchpad/test-plan.pxu | |||
767 | +++ b/units/touchpad/test-plan.pxu | |||
768 | @@ -39,3 +39,41 @@ include: | |||
769 | 39 | touchpad/multitouch-horizontal-after-suspend certification-status=blocker | 39 | touchpad/multitouch-horizontal-after-suspend certification-status=blocker |
770 | 40 | touchpad/multitouch-vertical-after-suspend certification-status=blocker | 40 | touchpad/multitouch-vertical-after-suspend certification-status=blocker |
771 | 41 | touchpad/multitouch-dash-after-suspend certification-status=non-blocker | 41 | touchpad/multitouch-dash-after-suspend certification-status=non-blocker |
772 | 42 | |||
773 | 43 | id: touchpad-cert-blockers | ||
774 | 44 | unit: test plan | ||
775 | 45 | _name: Touchpad tests (certification blockers only) | ||
776 | 46 | _description: Touchpad tests (certification blockers only) | ||
777 | 47 | include: | ||
778 | 48 | touchpad/basic certification-status=blocker | ||
779 | 49 | touchpad/detected-as-mouse certification-status=blocker | ||
780 | 50 | touchpad/continuous-move certification-status=blocker | ||
781 | 51 | touchpad/horizontal certification-status=blocker | ||
782 | 52 | touchpad/vertical certification-status=blocker | ||
783 | 53 | touchpad/singletouch-automated certification-status=blocker | ||
784 | 54 | touchpad/singletouch-selection certification-status=blocker | ||
785 | 55 | touchpad/drag-and-drop certification-status=blocker | ||
786 | 56 | touchpad/multitouch-automated certification-status=blocker | ||
787 | 57 | touchpad/multitouch-manual certification-status=blocker | ||
788 | 58 | touchpad/multitouch-rightclick certification-status=blocker | ||
789 | 59 | touchpad/multitouch-horizontal certification-status=blocker | ||
790 | 60 | touchpad/multitouch-vertical certification-status=blocker | ||
791 | 61 | |||
792 | 62 | id: after-suspend-touchpad-cert-blockers | ||
793 | 63 | unit: test plan | ||
794 | 64 | _name: Touchpad tests (after suspend, certification blockers only) | ||
795 | 65 | _description: Touchpad tests (after suspend, certification blockers only) | ||
796 | 66 | include: | ||
797 | 67 | touchpad/basic-after-suspend certification-status=blocker | ||
798 | 68 | touchpad/detected-as-mouse-after-suspend certification-status=blocker | ||
799 | 69 | touchpad/continuous-move-after-suspend certification-status=blocker | ||
800 | 70 | touchpad/horizontal-after-suspend certification-status=blocker | ||
801 | 71 | touchpad/vertical-after-suspend certification-status=blocker | ||
802 | 72 | touchpad/singletouch-automated-after-suspend certification-status=blocker | ||
803 | 73 | touchpad/singletouch-selection-after-suspend certification-status=blocker | ||
804 | 74 | touchpad/drag-and-drop-after-suspend certification-status=blocker | ||
805 | 75 | touchpad/multitouch-automated-after-suspend certification-status=blocker | ||
806 | 76 | touchpad/multitouch-manual-after-suspend certification-status=blocker | ||
807 | 77 | touchpad/multitouch-rightclick-after-suspend certification-status=blocker | ||
808 | 78 | touchpad/multitouch-horizontal-after-suspend certification-status=blocker | ||
809 | 79 | touchpad/multitouch-vertical-after-suspend certification-status=blocker | ||
810 | diff --git a/units/touchscreen/test-plan.pxu b/units/touchscreen/test-plan.pxu | |||
811 | index eaba085..e984af9 100644 | |||
812 | --- a/units/touchscreen/test-plan.pxu | |||
813 | +++ b/units/touchscreen/test-plan.pxu | |||
814 | @@ -9,3 +9,13 @@ include: | |||
815 | 9 | touchscreen/3-touch-tap certification-status=blocker | 9 | touchscreen/3-touch-tap certification-status=blocker |
816 | 10 | touchscreen/4-touch-tap certification-status=blocker | 10 | touchscreen/4-touch-tap certification-status=blocker |
817 | 11 | touchscreen/multitouch-dash certification-status=non-blocker | 11 | touchscreen/multitouch-dash certification-status=non-blocker |
818 | 12 | |||
819 | 13 | id: touchscreen-cert-blockers | ||
820 | 14 | unit: test plan | ||
821 | 15 | _name: Touchscreen tests (certification blockers only) | ||
822 | 16 | _description: Touchscreen tests (certification blockers only) | ||
823 | 17 | include: | ||
824 | 18 | touchscreen/drag-n-drop certification-status=blocker | ||
825 | 19 | touchscreen/multitouch-zoom certification-status=blocker | ||
826 | 20 | touchscreen/3-touch-tap certification-status=blocker | ||
827 | 21 | touchscreen/4-touch-tap certification-status=blocker | ||
828 | diff --git a/units/usb/test-plan.pxu b/units/usb/test-plan.pxu | |||
829 | index 5588110..96ece6d 100644 | |||
830 | --- a/units/usb/test-plan.pxu | |||
831 | +++ b/units/usb/test-plan.pxu | |||
832 | @@ -49,3 +49,41 @@ include: | |||
833 | 49 | suspend/usb3_insert_after_suspend certification-status=blocker | 49 | suspend/usb3_insert_after_suspend certification-status=blocker |
834 | 50 | suspend/usb3_storage_automated_after_suspend certification-status=blocker | 50 | suspend/usb3_storage_automated_after_suspend certification-status=blocker |
835 | 51 | suspend/usb3_remove_after_suspend certification-status=blocker | 51 | suspend/usb3_remove_after_suspend certification-status=blocker |
836 | 52 | |||
837 | 53 | id: usb-cert-blockers | ||
838 | 54 | unit: test plan | ||
839 | 55 | _name: USB tests (certification blockers only) | ||
840 | 56 | _description: USB tests (certification blockers only) | ||
841 | 57 | include: | ||
842 | 58 | usb/detect certification-status=blocker | ||
843 | 59 | usb/HID certification-status=blocker | ||
844 | 60 | usb/insert certification-status=blocker | ||
845 | 61 | usb/storage-automated certification-status=blocker | ||
846 | 62 | usb/remove certification-status=blocker | ||
847 | 63 | |||
848 | 64 | id: usb3-cert-blockers | ||
849 | 65 | unit: test plan | ||
850 | 66 | _name: USB3 tests (certification blockers only) | ||
851 | 67 | _description: USB3 tests (certification blockers only) | ||
852 | 68 | include: | ||
853 | 69 | usb3/insert certification-status=blocker | ||
854 | 70 | usb3/storage-automated certification-status=blocker | ||
855 | 71 | usb3/remove certification-status=blocker | ||
856 | 72 | |||
857 | 73 | id: after-suspend-usb-cert-blockers | ||
858 | 74 | unit: test plan | ||
859 | 75 | _name: USB tests (after suspend, certification blockers only) | ||
860 | 76 | _description: USB tests (after suspend, certification blockers only) | ||
861 | 77 | include: | ||
862 | 78 | suspend/usb_insert_after_suspend certification-status=blocker | ||
863 | 79 | suspend/usb_storage_automated_after_suspend certification-status=blocker | ||
864 | 80 | suspend/usb_remove_after_suspend certification-status=blocker | ||
865 | 81 | |||
866 | 82 | id: after-suspend-usb3-cert-blockers | ||
867 | 83 | unit: test plan | ||
868 | 84 | _name: USB3 tests (after suspend, certification blockers only) | ||
869 | 85 | _description: USB3 tests (after suspend, certification blockers only) | ||
870 | 86 | include: | ||
871 | 87 | suspend/usb3_insert_after_suspend certification-status=blocker | ||
872 | 88 | suspend/usb3_storage_automated_after_suspend certification-status=blocker | ||
873 | 89 | suspend/usb3_remove_after_suspend certification-status=blocker | ||
874 | diff --git a/units/wireless/test-plan.pxu b/units/wireless/test-plan.pxu | |||
875 | index b2c73ff..b4cf2f7 100644 | |||
876 | --- a/units/wireless/test-plan.pxu | |||
877 | +++ b/units/wireless/test-plan.pxu | |||
878 | @@ -3,6 +3,22 @@ unit: test plan | |||
879 | 3 | _name: Wireless tests | 3 | _name: Wireless tests |
880 | 4 | _description: Wireless connection tests | 4 | _description: Wireless connection tests |
881 | 5 | include: | 5 | include: |
882 | 6 | nested_part: | ||
883 | 7 | wireless-cert-automated | ||
884 | 8 | |||
885 | 9 | id: after-suspend-wireless-cert-full | ||
886 | 10 | unit: test plan | ||
887 | 11 | _name: Wireless tests (after suspend) | ||
888 | 12 | _description: Wireless connection tests (after suspend) | ||
889 | 13 | include: | ||
890 | 14 | nested_part: | ||
891 | 15 | after-suspend-wireless-cert-automated | ||
892 | 16 | |||
893 | 17 | id: wireless-cert-automated | ||
894 | 18 | unit: test plan | ||
895 | 19 | _name: Wireless tests | ||
896 | 20 | _description: Wireless connection tests | ||
897 | 21 | include: | ||
898 | 6 | wireless/wireless_scanning certification-status=blocker | 22 | wireless/wireless_scanning certification-status=blocker |
899 | 7 | wireless/wireless_connection_wpa_bg certification-status=blocker | 23 | wireless/wireless_connection_wpa_bg certification-status=blocker |
900 | 8 | wireless/wireless_connection_open_bg certification-status=blocker | 24 | wireless/wireless_connection_open_bg certification-status=blocker |
901 | @@ -11,10 +27,36 @@ include: | |||
902 | 11 | wireless/wireless_connection_wpa_ac certification-status=blocker | 27 | wireless/wireless_connection_wpa_ac certification-status=blocker |
903 | 12 | wireless/wireless_connection_open_ac certification-status=blocker | 28 | wireless/wireless_connection_open_ac certification-status=blocker |
904 | 13 | 29 | ||
906 | 14 | id: after-suspend-wireless-cert-full | 30 | id: after-suspend-wireless-cert-automated |
907 | 15 | unit: test plan | 31 | unit: test plan |
910 | 16 | _name: Wireless tests (after suspend) | 32 | _name: Wireless tests (after suspend, automated) |
911 | 17 | _description: Wireless connection tests (after suspend) | 33 | _description: Wireless connection tests (after suspend, automated) |
912 | 34 | include: | ||
913 | 35 | suspend/wireless_connection_after_suspend_wpa_bg certification-status=blocker | ||
914 | 36 | suspend/wireless_connection_after_suspend_open_bg certification-status=blocker | ||
915 | 37 | suspend/wireless_connection_after_suspend_wpa_n certification-status=blocker | ||
916 | 38 | suspend/wireless_connection_after_suspend_open_n certification-status=blocker | ||
917 | 39 | suspend/wireless_connection_after_suspend_wpa_ac certification-status=blocker | ||
918 | 40 | suspend/wireless_connection_after_suspend_open_ac certification-status=blocker | ||
919 | 41 | |||
920 | 42 | id: wireless-cert-blockers | ||
921 | 43 | unit: test plan | ||
922 | 44 | _name: Wireless tests (certification blockers only) | ||
923 | 45 | _description: Wireless connection tests (certification blockers only) | ||
924 | 46 | include: | ||
925 | 47 | wireless/wireless_scanning certification-status=blocker | ||
926 | 48 | wireless/wireless_connection_wpa_bg certification-status=blocker | ||
927 | 49 | wireless/wireless_connection_open_bg certification-status=blocker | ||
928 | 50 | wireless/wireless_connection_wpa_n certification-status=blocker | ||
929 | 51 | wireless/wireless_connection_open_n certification-status=blocker | ||
930 | 52 | wireless/wireless_connection_wpa_ac certification-status=blocker | ||
931 | 53 | wireless/wireless_connection_open_ac certification-status=blocker | ||
932 | 54 | |||
933 | 55 | id: after-suspend-wireless-cert-blockers | ||
934 | 56 | unit: test plan | ||
935 | 57 | _name: Wireless tests (after suspend, certification blockers only) | ||
936 | 58 | _description: | ||
937 | 59 | Wireless connection tests (after suspend, certification blockers only) | ||
938 | 18 | include: | 60 | include: |
939 | 19 | suspend/wireless_connection_after_suspend_wpa_bg certification-status=blocker | 61 | suspend/wireless_connection_after_suspend_wpa_bg certification-status=blocker |
940 | 20 | suspend/wireless_connection_after_suspend_open_bg certification-status=blocker | 62 | suspend/wireless_connection_after_suspend_open_bg certification-status=blocker |
I'm merging this one, main use will be oem provider updates.