Merge ~sylvain-pineau/plainbox-provider-certification-client:prep-new-22-test-plans into plainbox-provider-certification-client:master
- Git
- lp:~sylvain-pineau/plainbox-provider-certification-client
- prep-new-22-test-plans
- Merge into master
Status: | Merged |
---|---|
Approved by: | Sylvain Pineau |
Approved revision: | 22e349851adec851b863d93963a539ac5156b3b8 |
Merged at revision: | 72c2b6433bfbe02df4869b9ab83b6b6d819747a4 |
Proposed branch: | ~sylvain-pineau/plainbox-provider-certification-client:prep-new-22-test-plans |
Merge into: | plainbox-provider-certification-client:master |
Diff against target: |
787 lines (+757/-0) 5 files modified
units/client-cert-desktop-22-04.pxu (+157/-0) units/client-cert-iot-server-22-04.pxu (+45/-0) units/client-cert-iot-ubuntucore-22.pxu (+179/-0) units/client-cert-odm-desktop-22-04.pxu (+218/-0) units/client-cert-odm-ubuntucore-22.pxu (+158/-0) |
Related bugs: |
Reviewer | Review Type | Date Requested | Status |
---|---|---|---|
Sylvain Pineau | Approve | ||
Devices Certification Bot | Needs Fixing | ||
Jonathan Cave | Approve | ||
Review via email:
|
Commit message
Description of the change
In preparation for base core22 testing, add uc22 and 22.04 test plans to this provider (only copies of uc20/20.04 test plans at the moment).
Note: those new test plans are not the final version!

Sylvain Pineau (sylvain-pineau) wrote : | # |
lemme add this DRAFT marker

Devices Certification Bot (ce-certification-qa) wrote : | # |
The merge was fine but running tests failed.
"10.38.105.197"
"10.38.105.54"
"10.38.105.108"
[xenial] [13:32:04] starting container
Device project added to xenial-testing
[bionic] [13:32:22] starting container
[focal] [13:32:26] starting container
"10.38.105.54"
[xenial] [13:32:28] provisioning container
Device project added to bionic-testing
Device project added to focal-testing
"10.38.105.145"
[bionic] [13:32:44] provisioning container
"10.38.105.251"
[focal] [13:32:49] provisioning container
[xenial] [13:33:44] Starting tests...
[xenial] Found a test script: ./requirements/
[bionic] [13:34:09] Starting tests...
[bionic] Found a test script: ./requirements/
[xenial] [13:34:33] container-
[xenial] output: https:/
[xenial] [13:34:35] Fixing file permissions in source directory
[xenial] [13:34:35] Destroying container
[bionic] [13:34:44] container-
[bionic] output: https:/
[bionic] [13:34:46] Fixing file permissions in source directory
[bionic] [13:34:46] Destroying container
[focal] [13:35:11] Starting tests...
[focal] Found a test script: ./requirements/
[focal] [13:35:41] container-
[focal] output: https:/
[focal] [13:35:43] Fixing file permissions in source directory
[focal] [13:35:43] Destroying container

Devices Certification Bot (ce-certification-qa) wrote : | # |
I tried to merge it but there are some problems. Typically you want to merge or rebase and try again.
Preview Diff
1 | diff --git a/units/client-cert-desktop-22-04.pxu b/units/client-cert-desktop-22-04.pxu |
2 | new file mode 100644 |
3 | index 0000000..4ed2c0c |
4 | --- /dev/null |
5 | +++ b/units/client-cert-desktop-22-04.pxu |
6 | @@ -0,0 +1,157 @@ |
7 | +id: client-cert-desktop-22-04 |
8 | +_name: [DRAFT] Desktop Preload Certification Tests for 22.04 |
9 | +unit: test plan |
10 | +_description: |
11 | + This test plan is intended for use inside Canonical's test labs. It will be |
12 | + used to certify Desktop devices on behalf of OEM customers as part of |
13 | + commercial engagements. |
14 | +include: |
15 | +nested_part: |
16 | + client-cert-desktop-22-04-manual |
17 | + client-cert-desktop-22-04-automated |
18 | + client-cert-desktop-22-04-stress |
19 | + |
20 | + |
21 | +id: client-cert-desktop-22-04-manual |
22 | +_name: [DRAFT] Desktop Preload Certification Tests for 22.04 (Manual Tests) |
23 | +unit: test plan |
24 | +_description: |
25 | + Includes tests that require input from an operator to complete. |
26 | +include: |
27 | +nested_part: |
28 | + submission-cert-full |
29 | + audio-cert-manual |
30 | + bluetooth-cert-manual |
31 | + camera-cert-manual |
32 | + thunderbolt-cert-manual |
33 | + monitor-integrated-gpu-cert-manual |
34 | + graphics-integrated-gpu-cert-manual |
35 | + graphics-discrete-gpu-cert-manual |
36 | + monitor-discrete-gpu-cert-manual |
37 | + cpu-cert-manual |
38 | + input-cert-manual |
39 | + disk-cert-manual |
40 | + misc-client-cert-manual |
41 | + fingerprint-manual |
42 | + keys-cert-manual |
43 | + led-cert-manual |
44 | + mediacard-cert-manual |
45 | + memory-manual |
46 | + mobilebroadband-cert-manual |
47 | + ethernet-cert-manual |
48 | + networking-cert-manual |
49 | + optical-cert-manual |
50 | + power-management-precheck-cert-manual |
51 | + touchpad-cert-manual |
52 | + touchscreen-cert-manual |
53 | + usb-cert-manual |
54 | + usb3-cert-manual |
55 | + usb-c-cert-full # no manual only |
56 | + wireless-cert-manual |
57 | + # start of suspend related tests |
58 | + # suspend point |
59 | + # Test discrete card first, if present, since it's the one we will be using |
60 | + # after coming back from suspend if the system has hybrid graphics. |
61 | + after-suspend-graphics-discrete-gpu-cert-manual |
62 | + after-suspend-monitor-discrete-gpu-cert-full |
63 | + # Now we ask to switch to the integrated graphics card. This requires a |
64 | + # restart of checkbox. |
65 | + after-suspend-graphics-integrated-gpu-cert-manual |
66 | + after-suspend-monitor-integrated-gpu-cert-full |
67 | + suspend-key-led-oops-check-cert |
68 | + after-suspend-audio-cert-full |
69 | + after-suspend-camera-cert-full |
70 | + after-suspend-input-cert-full |
71 | + after-suspend-keys-cert-full |
72 | + after-suspend-led-cert-full |
73 | + after-suspend-mediacard-cert-full |
74 | + after-suspend-optical-cert-full |
75 | + after-suspend-touchpad-cert-full |
76 | + after-suspend-touchscreen-cert-manual |
77 | + after-suspend-usb-cert-full |
78 | + after-suspend-usb3-cert-full |
79 | + after-suspend-usb-c-cert-full |
80 | + # after-suspend-wireless-cert-full # auto only |
81 | + info-attachment-cert-manual |
82 | +exclude: |
83 | + keys/hibernate |
84 | + |
85 | + |
86 | +id: client-cert-desktop-22-04-automated |
87 | +_name: [DRAFT] Desktop Preload Certification Tests for 22.04 (Automated Tests) |
88 | +unit: test plan |
89 | +_description: |
90 | + Includes tests that do not require operator input. |
91 | +include: |
92 | + audio/alsa_record_playback_automated |
93 | + recovery_info_attachment |
94 | +nested_part: |
95 | + submission-cert-automated |
96 | + info-attachment-cert-automated |
97 | + audio-cert-automated |
98 | + bluetooth-cert-automated |
99 | + camera-cert-automated |
100 | + thunderbolt-cert-automated |
101 | + monitor-integrated-gpu-cert-automated |
102 | + graphics-integrated-gpu-cert-automated |
103 | + graphics-discrete-gpu-cert-automated |
104 | + monitor-discrete-gpu-cert-automated |
105 | + cpu-cert-automated |
106 | + input-cert-automated |
107 | + disk-cert-automated |
108 | + misc-client-cert-automated |
109 | + fingerprint-automated |
110 | + keys-cert-automated |
111 | + led-cert-automated |
112 | + mediacard-cert-automated |
113 | + mediacard-automated |
114 | + memory-automated |
115 | + mobilebroadband-cert-automated |
116 | + ethernet-cert-automated |
117 | + networking-cert-automated |
118 | + optical-cert-automated |
119 | + power-management-precheck-cert-automated |
120 | + touchpad-cert-automated |
121 | + touchscreen-cert-automated |
122 | + usb-cert-automated |
123 | + usb-automated |
124 | + wireless-cert-automated |
125 | + # start of suspend related tests |
126 | + before-suspend-reference-cert-full |
127 | + # suspend point |
128 | + after-suspend-reference-cert-full |
129 | + # Test discrete card first, if present, since it's the one we will be using |
130 | + # after coming back from suspend if the system has hybrid graphics. |
131 | + after-suspend-graphics-discrete-gpu-cert-automated |
132 | + # after-suspend-monitor-discrete-gpu-cert-automated # not defined |
133 | + # Now we ask to switch to the integrated graphics card. |
134 | + after-suspend-graphics-integrated-gpu-cert-automated |
135 | + # after-suspend-monitor-integrated-gpu-cert-automated # not defined |
136 | + after-suspend-touchscreen-cert-automated |
137 | + after-suspend-wireless-cert-automated |
138 | + # The following tests should run BEFORE the automated tests. The reboot and |
139 | + # power off tests will also give us a clean system to start the stress run |
140 | + # with. |
141 | + power-management-reboot-poweroff-cert-automated |
142 | + tpm-cert-automated |
143 | +bootstrap_include: |
144 | + device |
145 | + graphics_card |
146 | + |
147 | +id: client-cert-desktop-22-04-stress |
148 | +_name: [DRAFT] Desktop Preload Certification Tests for 22.04 (Stress Tests) |
149 | +unit: test plan |
150 | +_description: |
151 | + Includes tests that are long running device stress tests. |
152 | +include: |
153 | +nested_part: |
154 | + submission-cert-automated |
155 | + # The following tests are purely automated and/or lenghty stress tests. |
156 | + # They have been moved to the end of the test run to improve the testing |
157 | + # process. |
158 | + stress-iperf3-automated |
159 | + #stress-cert-full |
160 | + stress-suspend-30-cycles-with-reboots-automated |
161 | + stress-ng-cert-automated |
162 | + stress-30-reboot-poweroff-automated |
163 | + stress-pm-graph |
164 | diff --git a/units/client-cert-iot-server-22-04.pxu b/units/client-cert-iot-server-22-04.pxu |
165 | new file mode 100644 |
166 | index 0000000..97c48c8 |
167 | --- /dev/null |
168 | +++ b/units/client-cert-iot-server-22-04.pxu |
169 | @@ -0,0 +1,45 @@ |
170 | +id: client-cert-iot-server-22-04 |
171 | +_name: [DRAFT] IoT Client Certification for 22.04 classic images |
172 | +unit: test plan |
173 | +_description: |
174 | + This is classic 22.04 |
175 | +include: |
176 | +nested_part: |
177 | + client-cert-iot-server-22-04-manual |
178 | + client-cert-iot-server-22-04-automated |
179 | + |
180 | + |
181 | +id: client-cert-iot-server-22-04-manual |
182 | +_name: [DRAFT] IoT Client Certification for 22.04 classic images (Manual Tests) |
183 | +unit: test plan |
184 | +_description: |
185 | + This is classic 22.04 |
186 | +include: |
187 | +nested_part: |
188 | + # until there is reason to diverge, nest these plans |
189 | + client-cert-iot-ubuntucore-20-manual |
190 | +exclude: |
191 | + ubuntucore/os-.* |
192 | + snappy/os-.* |
193 | + |
194 | + |
195 | +id: client-cert-iot-server-22-04-automated |
196 | +_name: [DRAFT] IoT Client Certification for 22.04 classic images (Automated Tests) |
197 | +unit: test plan |
198 | +_description: |
199 | + This is classic 22.04 |
200 | +include: |
201 | +nested_part: |
202 | + # until there is reason to diverge, nest these plans |
203 | + client-cert-iot-ubuntucore-20-automated |
204 | + ## snappy-snap-automated-lightweight ?? |
205 | + |
206 | + |
207 | +id: client-cert-iot-server-22-04-stress |
208 | +_name: [DRAFT] IoT Client Certification for 22.04 classic images (Stress Tests) |
209 | +unit: test plan |
210 | +_description: |
211 | + This is classic 22.04 |
212 | +include: |
213 | +nested_part: |
214 | + stress-full |
215 | diff --git a/units/client-cert-iot-ubuntucore-22.pxu b/units/client-cert-iot-ubuntucore-22.pxu |
216 | new file mode 100644 |
217 | index 0000000..245e845 |
218 | --- /dev/null |
219 | +++ b/units/client-cert-iot-ubuntucore-22.pxu |
220 | @@ -0,0 +1,179 @@ |
221 | +id: client-cert-iot-ubuntucore-22 |
222 | +_name: [DRAFT] IoT Client Certification for Ubuntu Core 22 |
223 | +unit: test plan |
224 | +_description: |
225 | + This is UC22 |
226 | +include: |
227 | +nested_part: |
228 | + client-cert-iot-ubuntucore-22-manual |
229 | + client-cert-iot-ubuntucore-22-automated |
230 | + |
231 | + |
232 | +id: client-cert-iot-ubuntucore-22-manual |
233 | +_name: [DRAFT] IoT Client Certification for Ubuntu Core 22 (Manual Tests) |
234 | +unit: test plan |
235 | +_description: |
236 | + This is UC22 |
237 | +include: |
238 | +mandatory_include: |
239 | + com.canonical.plainbox::manifest |
240 | + alsa_resource |
241 | + dmi |
242 | + dmi_attachment |
243 | + dmesg_attachment |
244 | + dpkg |
245 | + lsb |
246 | + lspci_attachment |
247 | + lsusb_attachment |
248 | + meminfo |
249 | + package |
250 | + snap |
251 | + sysfs_attachment |
252 | + udev_attachment |
253 | + udev_json |
254 | + uname |
255 | + model_assertion |
256 | + serial_assertion |
257 | + parts_meta_info_attachment |
258 | + info/buildstamp |
259 | + info/systemd-analyze |
260 | + system_info_json |
261 | + net_if_management_attachment |
262 | +bootstrap_include: |
263 | + bootloader |
264 | + cpuinfo |
265 | + device |
266 | + interface |
267 | + net_if_management |
268 | +nested_part: |
269 | + self-manual |
270 | + ubuntucore-manual |
271 | + audio-manual |
272 | + bluetooth-manual |
273 | + camera-manual |
274 | + cpu-manual |
275 | + disk-manual |
276 | + ethernet-manual |
277 | + led-manual |
278 | + mediacard-manual |
279 | + memory-manual |
280 | + monitor-manual |
281 | + networking-manual |
282 | + rtc-manual |
283 | + serial-manual |
284 | + snappy-snap-manual |
285 | + socketcan-manual-remote |
286 | + socketcan-manual-local |
287 | + usb-manual |
288 | + usb-c-manual |
289 | + usb3-manual |
290 | + thunderbolt-cert-manual |
291 | + watchdog-manual |
292 | + wireless-manual |
293 | + wireless-wifi-master-mode-manual |
294 | + wwan-manual |
295 | + after-suspend-audio-manual |
296 | + after-suspend-bluetooth-manual |
297 | + after-suspend-ethernet-manual |
298 | + after-suspend-monitor-manual |
299 | + after-suspend-networking-manual |
300 | + after-suspend-serial-manual |
301 | + after-suspend-socketcan-manual-remote |
302 | + after-suspend-socketcan-manual-local |
303 | + after-suspend-usb-manual |
304 | + after-suspend-usb-c-manual |
305 | + after-suspend-usb3-manual |
306 | + after-suspend-thunderbolt-cert-manual |
307 | + after-suspend-wireless-manual |
308 | + after-suspend-wireless-wifi-master-mode-manual |
309 | + after-suspend-wwan-manual |
310 | + |
311 | + |
312 | +id: client-cert-iot-ubuntucore-22-automated |
313 | +_name: [DRAFT] IoT Client Certification for Ubuntu Core 22 (Automated Tests) |
314 | +unit: test plan |
315 | +_description: |
316 | + This is UC22 |
317 | +include: |
318 | +mandatory_include: |
319 | + com.canonical.plainbox::manifest |
320 | + alsa_resource |
321 | + dmi |
322 | + dmi_attachment |
323 | + dmesg_attachment |
324 | + dpkg |
325 | + lsb |
326 | + lspci_attachment |
327 | + lsusb_attachment |
328 | + meminfo |
329 | + package |
330 | + snap |
331 | + sysfs_attachment |
332 | + udev_attachment |
333 | + udev_json |
334 | + uname |
335 | + model_assertion |
336 | + serial_assertion |
337 | + parts_meta_info_attachment |
338 | + info/buildstamp |
339 | + info/systemd-analyze |
340 | + system_info_json |
341 | + net_if_management_attachment |
342 | +bootstrap_include: |
343 | + bootloader |
344 | + cpuinfo |
345 | + device |
346 | + interface |
347 | + net_if_management |
348 | +nested_part: |
349 | + self-automated |
350 | + ubuntucore-automated |
351 | + com.intel.ipdt::ipdt-plan |
352 | + iot-fwts-automated |
353 | + audio-automated |
354 | + bluez-automated |
355 | + camera-automated |
356 | + cpu-automated |
357 | + disk-automated |
358 | + docker-automated |
359 | + ethernet-automated |
360 | + i2c-automated |
361 | + gpio-automated |
362 | + kernel-security-automated |
363 | + kernel-snap-automated |
364 | + location-automated |
365 | + mediacard-automated |
366 | + memory-automated |
367 | + # monitor-automated |
368 | + networking-automated |
369 | + power-automated |
370 | + serial-automated |
371 | + snappy-snap-automated |
372 | + socketcan-auto-local |
373 | + socketcan-auto-remote |
374 | + tpm-cert-automated |
375 | + usb-automated |
376 | + thunderbolt-cert-automated |
377 | + watchdog-automated |
378 | + wireless-automated |
379 | + wireless-wifi-master-mode-auto |
380 | + wwan-automated |
381 | + after-suspend-audio-automated |
382 | + after-suspend-bluez-automated |
383 | + after-suspend-ethernet-automated |
384 | + after-suspend-gpio-automated |
385 | + after-suspend-location-automated |
386 | + after-suspend-serial-automated |
387 | + after-suspend-usb-automated |
388 | + after-suspend-wireless-automated |
389 | + after-suspend-wwan-automated |
390 | + |
391 | + |
392 | +id: client-cert-iot-ubuntucore-22-stress |
393 | +_name: [DRAFT] IoT Client Certification for Ubuntu Core 22 (Stress Tests) |
394 | +unit: test plan |
395 | +_description: |
396 | + This is UC22 |
397 | +include: |
398 | +nested_part: |
399 | + stress-full |
400 | diff --git a/units/client-cert-odm-desktop-22-04.pxu b/units/client-cert-odm-desktop-22-04.pxu |
401 | new file mode 100644 |
402 | index 0000000..fbe7904 |
403 | --- /dev/null |
404 | +++ b/units/client-cert-odm-desktop-22-04.pxu |
405 | @@ -0,0 +1,218 @@ |
406 | +id: client-cert-odm-desktop-22-04-manual |
407 | +_name: [DRAFT] ODM Client Certification for Desktop 22.04 - (1/2) Manual tests |
408 | +unit: test plan |
409 | +_description: |
410 | + This test plan is intended for use by ODMs in their own facilities as part of |
411 | + the ODM Certification programme. This test plan should be used when certifying |
412 | + Desktop images. |
413 | +include: |
414 | +nested_part: |
415 | + submission-cert-full |
416 | + audio-cert-manual |
417 | + bluetooth-cert-manual |
418 | + camera-cert-manual |
419 | + edac-manual |
420 | + thunderbolt-cert-manual |
421 | + monitor-integrated-gpu-cert-manual |
422 | + graphics-integrated-gpu-cert-manual |
423 | + graphics-discrete-gpu-cert-manual |
424 | + monitor-discrete-gpu-cert-manual |
425 | + input-cert-manual |
426 | + disk-cert-manual |
427 | + keys-cert-manual |
428 | + led-cert-manual |
429 | + mediacard-cert-manual |
430 | + mobilebroadband-cert-manual |
431 | + ethernet-cert-manual |
432 | + networking-cert-manual |
433 | + optical-cert-manual |
434 | + power-management-precheck-cert-manual |
435 | + # touchpad-cert-manual |
436 | + # touchscreen-cert-manual |
437 | + usb-cert-manual |
438 | + usb3-cert-manual |
439 | + usb-c-cert-full # no manual only |
440 | + usb-dwc3-manual |
441 | + wireless-cert-manual |
442 | + # start of suspend related tests |
443 | + before-suspend-reference-cert-full |
444 | + # suspend point |
445 | + after-suspend-reference-cert-full |
446 | + # Test discrete card first, if present, since it's the one we will be using |
447 | + # after coming back from suspend if the system has hybrid graphics. |
448 | + after-suspend-graphics-discrete-gpu-cert-manual |
449 | + after-suspend-monitor-discrete-gpu-cert-full |
450 | + # Now we ask to switch to the integrated graphics card. This requires a |
451 | + # restart of checkbox. |
452 | + after-suspend-graphics-integrated-gpu-cert-manual |
453 | + after-suspend-monitor-integrated-gpu-cert-full |
454 | + suspend-key-led-oops-check-cert |
455 | + after-suspend-audio-cert-full # no-manual only |
456 | + after-suspend-camera-cert-full # no-manual only |
457 | + after-suspend-input-cert-full # no-manual only |
458 | + after-suspend-keys-cert-full # no-manual only |
459 | + after-suspend-led-cert-full # no-manual only |
460 | + after-suspend-mediacard-cert-full # no-manual only |
461 | + after-suspend-optical-cert-full # no-manual only |
462 | + # after-suspend-touchpad-cert-manual |
463 | + # after-suspend-touchscreen-cert-manual |
464 | + after-suspend-usb-cert-full # no-manual only |
465 | + after-suspend-usb3-cert-full # no-manual only |
466 | + after-suspend-usb-c-cert-full # no manual only |
467 | + # after-suspend-wireless-cert-full # auto only |
468 | + info-attachment-cert-full |
469 | +exclude: |
470 | + com.canonical.certification::keys/hibernate |
471 | + com.canonical.certification::keys/lock-screen |
472 | + com.canonical.certification::keys/brightness |
473 | + com.canonical.certification::keys/media-control |
474 | + com.canonical.certification::keys/mute |
475 | + com.canonical.certification::keys/volume |
476 | + com.canonical.certification::keys/video-out |
477 | + com.canonical.certification::keys/wireless |
478 | + com.canonical.certification::keys/keyboard-backlight |
479 | + com.canonical.certification::keys/microphone-mute |
480 | + com.canonical.certification::keys/fn-lock |
481 | + com.canonical.certification::after-suspend-manual-keys/hibernate |
482 | + com.canonical.certification::after-suspend-manual-keys/lock-screen |
483 | + com.canonical.certification::after-suspend-manual-keys/brightness |
484 | + com.canonical.certification::after-suspend-manual-keys/media-control |
485 | + com.canonical.certification::after-suspend-manual-keys/mute |
486 | + com.canonical.certification::after-suspend-manual-keys/volume |
487 | + com.canonical.certification::after-suspend-manual-keys/video-out |
488 | + com.canonical.certification::after-suspend-manual-keys/wireless |
489 | + com.canonical.certification::after-suspend-manual-keys/keyboard-backlight |
490 | + com.canonical.certification::after-suspend-manual-keys/microphone-mute |
491 | + com.canonical.certification::after-suspend-manual-keys/fn-lock |
492 | + com.canonical.certification::led/bluetooth |
493 | + com.canonical.certification::led/wlan |
494 | + com.canonical.certification::led/wlan-disabled |
495 | + com.canonical.certification::led/fn |
496 | + com.canonical.certification::led/mute |
497 | + com.canonical.certification::led/microphone-mute |
498 | + com.canonical.certification::suspend/led_after_suspend/bluetooth |
499 | + com.canonical.certification::suspend/led_after_suspend/wlan |
500 | + com.canonical.certification::suspend/led_after_suspend/wlan-disabled |
501 | + com.canonical.certification::after-suspend-manual-led/fn |
502 | + com.canonical.certification::after-suspend-manual-led/mute |
503 | + com.canonical.certification::after-suspend-manual-led/microphone-mute |
504 | + |
505 | +id: client-cert-odm-desktop-22-04-automated |
506 | +_name: [DRAFT] ODM Client Certification for Desktop 22.04 - (2/2) Automated tests |
507 | +unit: test plan |
508 | +_description: |
509 | + This test plan is intended for use by ODMs in their own facilities as part of |
510 | + the ODM Certification programme. This test plan should be used when certifying |
511 | + Desktop images. |
512 | +include: |
513 | +nested_part: |
514 | + submission-cert-full |
515 | + audio-cert-automated |
516 | + bluetooth-cert-automated |
517 | + camera-cert-automated |
518 | + edac-automated |
519 | + thunderbolt-cert-automated |
520 | + monitor-integrated-gpu-cert-automated |
521 | + graphics-integrated-gpu-cert-automated |
522 | + graphics-discrete-gpu-cert-automated |
523 | + monitor-discrete-gpu-cert-automated |
524 | + input-cert-automated |
525 | + disk-cert-manual |
526 | + keys-cert-automated |
527 | + led-cert-automated |
528 | + mediacard-cert-automated |
529 | + mobilebroadband-cert-automated |
530 | + ethernet-cert-automated |
531 | + networking-cert-automated |
532 | + optical-cert-automated |
533 | + power-management-precheck-cert-automated |
534 | + # touchpad-cert-automated |
535 | + # touchscreen-cert-automated |
536 | + usb-cert-automated |
537 | + usb3-cert-automated |
538 | + # usb-c-cert-automated # only usb-c-cert-full |
539 | + usb-dwc3-automated |
540 | + wireless-cert-automated |
541 | + # start of suspend related tests |
542 | + before-suspend-reference-cert-full |
543 | + # suspend point |
544 | + after-suspend-reference-cert-full |
545 | + # Test discrete card first, if present, since it's the one we will be using |
546 | + # after coming back from suspend if the system has hybrid graphics. |
547 | + after-suspend-graphics-discrete-gpu-cert-automated |
548 | + # after-suspend-monitor-discrete-gpu-cert-automated # not defined |
549 | + # Now we ask to switch to the integrated graphics card. This requires a |
550 | + # restart of checkbox. |
551 | + after-suspend-graphics-integrated-gpu-cert-automated |
552 | + # after-suspend-monitor-integrated-gpu-cert-automated # not defined |
553 | + suspend-key-led-oops-check-cert |
554 | + # after-suspend-audio-cert-automated |
555 | + # after-suspend-camera-cert-automated |
556 | + # after-suspend-input-cert-automated |
557 | + # after-suspend-keys-cert-automated |
558 | + # after-suspend-led-cert-automated |
559 | + # after-suspend-mediacard-cert-automated |
560 | + # after-suspend-optical-cert-automated |
561 | + # after-suspend-touchpad-cert-automated |
562 | + # after-suspend-touchscreen-cert-automated |
563 | + # after-suspend-usb-cert-automated |
564 | + # after-suspend-usb3-cert-automated |
565 | + # after-suspend-usb-c-cert-automated # only usb-c-cert-full |
566 | + after-suspend-wireless-cert-automated |
567 | + # Automated Tests |
568 | + # The following tests are purely automated and/or lenghty stress tests. |
569 | + # They have been moved to the end of the test run to improve the testing |
570 | + # process. |
571 | + misc-client-cert-full |
572 | + cpu-cert-automated |
573 | + disk-cert-automated |
574 | + stress-iperf3-automated |
575 | + warm-boot-stress-test |
576 | + cold-boot-stress-test |
577 | + suspend-stress-test |
578 | + stress-ng-cert-automated |
579 | + tpm-cert-automated |
580 | + info-attachment-cert-full |
581 | +exclude: |
582 | + com.canonical.certification::keys/hibernate |
583 | + com.canonical.certification::keys/lock-screen |
584 | + com.canonical.certification::keys/brightness |
585 | + com.canonical.certification::keys/media-control |
586 | + com.canonical.certification::keys/mute |
587 | + com.canonical.certification::keys/volume |
588 | + com.canonical.certification::keys/video-out |
589 | + com.canonical.certification::keys/wireless |
590 | + com.canonical.certification::keys/keyboard-backlight |
591 | + com.canonical.certification::keys/microphone-mute |
592 | + com.canonical.certification::keys/fn-lock |
593 | + com.canonical.certification::after-suspend-manual-keys/hibernate |
594 | + com.canonical.certification::after-suspend-manual-keys/lock-screen |
595 | + com.canonical.certification::after-suspend-manual-keys/brightness |
596 | + com.canonical.certification::after-suspend-manual-keys/media-control |
597 | + com.canonical.certification::after-suspend-manual-keys/mute |
598 | + com.canonical.certification::after-suspend-manual-keys/volume |
599 | + com.canonical.certification::after-suspend-manual-keys/video-out |
600 | + com.canonical.certification::after-suspend-manual-keys/wireless |
601 | + com.canonical.certification::after-suspend-manual-keys/keyboard-backlight |
602 | + com.canonical.certification::after-suspend-manual-keys/microphone-mute |
603 | + com.canonical.certification::after-suspend-manual-keys/fn-lock |
604 | + com.canonical.certification::led/bluetooth |
605 | + com.canonical.certification::led/wlan |
606 | + com.canonical.certification::led/wlan-disabled |
607 | + com.canonical.certification::led/fn |
608 | + com.canonical.certification::led/mute |
609 | + com.canonical.certification::led/microphone-mute |
610 | + com.canonical.certification::suspend/led_after_suspend/bluetooth |
611 | + com.canonical.certification::suspend/led_after_suspend/wlan |
612 | + com.canonical.certification::suspend/led_after_suspend/wlan-disabled |
613 | + com.canonical.certification::after-suspend-manual-led/fn |
614 | + com.canonical.certification::after-suspend-manual-led/mute |
615 | + com.canonical.certification::after-suspend-manual-led/microphone-mute |
616 | + |
617 | +id: client-cert-odm-desktop-22-04 |
618 | +_name: [DRAFT] DONT USE - desktop-22-04 - placeholder to establish that total number of tests has not changed |
619 | +unit: test plan |
620 | +include: |
621 | +nested_part: |
622 | + client-cert-odm-desktop-22-04-manual |
623 | + client-cert-odm-desktop-22-04-automated |
624 | diff --git a/units/client-cert-odm-ubuntucore-22.pxu b/units/client-cert-odm-ubuntucore-22.pxu |
625 | new file mode 100644 |
626 | index 0000000..b8d5b66 |
627 | --- /dev/null |
628 | +++ b/units/client-cert-odm-ubuntucore-22.pxu |
629 | @@ -0,0 +1,158 @@ |
630 | +id: client-cert-odm-ubuntucore-22-manual |
631 | +_name: [DRAFT] ODM Client Certification for Ubuntu Core 22 - (1/2) Manual tests |
632 | +unit: test plan |
633 | +_description: |
634 | + This test plan is intended for use by ODMs in their own facilities as part of |
635 | + the ODM Certification programme. This test plan should be used when certifying |
636 | + Ubuntu Core images. |
637 | +include: |
638 | +mandatory_include: |
639 | + com.canonical.plainbox::manifest |
640 | + executable |
641 | + dmi |
642 | + dmi_attachment |
643 | + dpkg |
644 | + interface |
645 | + lsb |
646 | + lspci_attachment |
647 | + lsusb_attachment |
648 | + meminfo |
649 | + package |
650 | + rtc |
651 | + sleep |
652 | + snap |
653 | + sysfs_attachment |
654 | + udev_attachment |
655 | + udev_json |
656 | + uname |
657 | + connections |
658 | + model_assertion |
659 | + serial_assertion |
660 | + net_if_management_attachment |
661 | +bootstrap_include: |
662 | + bootloader |
663 | + cpuinfo |
664 | + device |
665 | + net_if_management |
666 | +nested_part: |
667 | + self-manual |
668 | + audio-manual |
669 | + bluetooth-manual |
670 | + camera-manual |
671 | + edac-manual |
672 | + led-manual |
673 | + mediacard-manual |
674 | + rtc-manual |
675 | + serial-manual |
676 | + usb-c-manual |
677 | + usb-manual |
678 | + usb3-manual |
679 | + usb-dwc3-manual |
680 | + thunderbolt-cert-manual |
681 | + wwan-manual |
682 | + i2c-manual |
683 | + suspend-tp |
684 | + after-suspend-audio-manual |
685 | + after-suspend-bluetooth-manual |
686 | + after-suspend-ethernet-manual |
687 | + after-suspend-wwan-manual |
688 | + after-suspend-thunderbolt-cert-manual |
689 | +exclude: |
690 | + com.intel.ipdt::ipdt/PCH-.* |
691 | + usb-c/c-to-a-adapter.* |
692 | + mediacard/mmc-.* |
693 | + mediacard/cf-.* |
694 | + mediacard/sdxc-.* |
695 | + mediacard/ms-.* |
696 | + mediacard/msp-.* |
697 | + mediacard/xd-.* |
698 | + rtc/battery |
699 | + |
700 | +id: client-cert-odm-ubuntucore-22-automated |
701 | +_name: [DRAFT] ODM Client Certification for Ubuntu Core 22 - (2/2) Automated tests |
702 | +unit: test plan |
703 | +_description: |
704 | + This test plan is intended for use by ODMs in their own facilities as part of |
705 | + the ODM Certification programme. This test plan should be used when certifying |
706 | + Ubuntu Core images. |
707 | +include: |
708 | +mandatory_include: |
709 | + com.canonical.plainbox::manifest |
710 | + executable |
711 | + dmi |
712 | + dmi_attachment |
713 | + dpkg |
714 | + interface |
715 | + lsb |
716 | + lspci_attachment |
717 | + lsusb_attachment |
718 | + meminfo |
719 | + package |
720 | + rtc |
721 | + sleep |
722 | + snap |
723 | + sysfs_attachment |
724 | + udev_attachment |
725 | + udev_json |
726 | + uname |
727 | + connections |
728 | + model_assertion |
729 | + serial_assertion |
730 | + net_if_management_attachment |
731 | +bootstrap_include: |
732 | + bootloader |
733 | + cpuinfo |
734 | + device |
735 | + net_if_management |
736 | +nested_part: |
737 | + self-automated |
738 | + bluez-automated |
739 | + camera-automated |
740 | + edac-automated |
741 | + mediacard-automated |
742 | + rtc-automated |
743 | + serial-automated |
744 | + usb-c-automated |
745 | + usb-automated |
746 | + usb3-automated |
747 | + usb-dwc3-automated |
748 | + thunderbolt-cert-automated |
749 | + watchdog-automated |
750 | + wwan-automated |
751 | + com.intel.ipdt::ipdt-plan |
752 | + cpu-automated |
753 | + disk-automated |
754 | + ethernet-automated |
755 | + iot-cert-image-automated |
756 | + i2c-automated |
757 | + memory-automated |
758 | + networking-automated |
759 | + snappy-snap-automated |
760 | + wireless-automated |
761 | + wireless-wifi-master-mode-auto |
762 | + tpm-cert-automated |
763 | + suspend-tp |
764 | + after-suspend-bluez-automated |
765 | + after-suspend-ethernet-automated |
766 | + after-suspend-wireless-automated |
767 | + after-suspend-wwan-automated |
768 | + warm-boot-stress-test |
769 | + cold-boot-stress-test |
770 | +exclude: |
771 | + com.intel.ipdt::ipdt/PCH-.* |
772 | + usb-c/c-to-a-adapter.* |
773 | + mediacard/mmc-.* |
774 | + mediacard/cf-.* |
775 | + mediacard/sdxc-.* |
776 | + mediacard/ms-.* |
777 | + mediacard/msp-.* |
778 | + mediacard/xd-.* |
779 | + rtc/battery |
780 | + |
781 | +id: client-cert-odm-ubuntucore-22 |
782 | +_name: [DRAFT] DONT USE - uc22 - placeholder to establish that total number of tests has not changed |
783 | +unit: test plan |
784 | +include: |
785 | +nested_part: |
786 | + client-cert-odm-ubuntucore-22-manual |
787 | + client-cert-odm-ubuntucore-22-automated |
I think this should be ok as the new test plans should not show-up in cdts.odm- certification thanks to the filter used in the launcher. (I would prefer they are not offered until we are ready to have ODMs certify with 22).
I wonder if the _name field should be pre-fixed with [DRAFT] or something for now?