Merge ~sylvain-pineau/plainbox-provider-certification-client:prep-new-22-test-plans into plainbox-provider-certification-client:master

Proposed by Sylvain Pineau
Status: Merged
Approved by: Sylvain Pineau
Approved revision: 22e349851adec851b863d93963a539ac5156b3b8
Merged at revision: 72c2b6433bfbe02df4869b9ab83b6b6d819747a4
Proposed branch: ~sylvain-pineau/plainbox-provider-certification-client:prep-new-22-test-plans
Merge into: plainbox-provider-certification-client:master
Diff against target: 787 lines (+757/-0)
5 files modified
units/client-cert-desktop-22-04.pxu (+157/-0)
units/client-cert-iot-server-22-04.pxu (+45/-0)
units/client-cert-iot-ubuntucore-22.pxu (+179/-0)
units/client-cert-odm-desktop-22-04.pxu (+218/-0)
units/client-cert-odm-ubuntucore-22.pxu (+158/-0)
Reviewer Review Type Date Requested Status
Sylvain Pineau Approve
Devices Certification Bot Needs Fixing
Jonathan Cave Approve
Review via email: mp+412837@code.launchpad.net

Description of the change

In preparation for base core22 testing, add uc22 and 22.04 test plans to this provider (only copies of uc20/20.04 test plans at the moment).

Note: those new test plans are not the final version!

To post a comment you must log in.
Revision history for this message
Jonathan Cave (jocave) wrote :

I think this should be ok as the new test plans should not show-up in cdts.odm-certification thanks to the filter used in the launcher. (I would prefer they are not offered until we are ready to have ODMs certify with 22).

I wonder if the _name field should be pre-fixed with [DRAFT] or something for now?

review: Approve
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

lemme add this DRAFT marker

Revision history for this message
Devices Certification Bot (ce-certification-qa) wrote :

The merge was fine but running tests failed.

"10.38.105.197"
"10.38.105.54"
"10.38.105.108"
[xenial] [13:32:04] starting container
Device project added to xenial-testing
[bionic] [13:32:22] starting container
[focal] [13:32:26] starting container
"10.38.105.54"
[xenial] [13:32:28] provisioning container
Device project added to bionic-testing
Device project added to focal-testing
"10.38.105.145"
[bionic] [13:32:44] provisioning container
"10.38.105.251"
[focal] [13:32:49] provisioning container
[xenial] [13:33:44] Starting tests...
[xenial] Found a test script: ./requirements/container-tests-provider-certification-client
[bionic] [13:34:09] Starting tests...
[bionic] Found a test script: ./requirements/container-tests-provider-certification-client
[xenial] [13:34:33] container-tests-provider-certification-client: FAIL
[xenial] output: https://paste.ubuntu.com/p/x7WmChZWxC/
[xenial] [13:34:35] Fixing file permissions in source directory
[xenial] [13:34:35] Destroying container
[bionic] [13:34:44] container-tests-provider-certification-client: FAIL
[bionic] output: https://paste.ubuntu.com/p/6JNmwTXxGg/
[bionic] [13:34:46] Fixing file permissions in source directory
[bionic] [13:34:46] Destroying container
[focal] [13:35:11] Starting tests...
[focal] Found a test script: ./requirements/container-tests-provider-certification-client
[focal] [13:35:41] container-tests-provider-certification-client: FAIL
[focal] output: https://paste.ubuntu.com/p/SZ8TKwfVQy/
[focal] [13:35:43] Fixing file permissions in source directory
[focal] [13:35:43] Destroying container

review: Needs Fixing
Revision history for this message
Devices Certification Bot (ce-certification-qa) wrote :

I tried to merge it but there are some problems. Typically you want to merge or rebase and try again.

review: Needs Fixing
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

+1

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1diff --git a/units/client-cert-desktop-22-04.pxu b/units/client-cert-desktop-22-04.pxu
2new file mode 100644
3index 0000000..4ed2c0c
4--- /dev/null
5+++ b/units/client-cert-desktop-22-04.pxu
6@@ -0,0 +1,157 @@
7+id: client-cert-desktop-22-04
8+_name: [DRAFT] Desktop Preload Certification Tests for 22.04
9+unit: test plan
10+_description:
11+ This test plan is intended for use inside Canonical's test labs. It will be
12+ used to certify Desktop devices on behalf of OEM customers as part of
13+ commercial engagements.
14+include:
15+nested_part:
16+ client-cert-desktop-22-04-manual
17+ client-cert-desktop-22-04-automated
18+ client-cert-desktop-22-04-stress
19+
20+
21+id: client-cert-desktop-22-04-manual
22+_name: [DRAFT] Desktop Preload Certification Tests for 22.04 (Manual Tests)
23+unit: test plan
24+_description:
25+ Includes tests that require input from an operator to complete.
26+include:
27+nested_part:
28+ submission-cert-full
29+ audio-cert-manual
30+ bluetooth-cert-manual
31+ camera-cert-manual
32+ thunderbolt-cert-manual
33+ monitor-integrated-gpu-cert-manual
34+ graphics-integrated-gpu-cert-manual
35+ graphics-discrete-gpu-cert-manual
36+ monitor-discrete-gpu-cert-manual
37+ cpu-cert-manual
38+ input-cert-manual
39+ disk-cert-manual
40+ misc-client-cert-manual
41+ fingerprint-manual
42+ keys-cert-manual
43+ led-cert-manual
44+ mediacard-cert-manual
45+ memory-manual
46+ mobilebroadband-cert-manual
47+ ethernet-cert-manual
48+ networking-cert-manual
49+ optical-cert-manual
50+ power-management-precheck-cert-manual
51+ touchpad-cert-manual
52+ touchscreen-cert-manual
53+ usb-cert-manual
54+ usb3-cert-manual
55+ usb-c-cert-full # no manual only
56+ wireless-cert-manual
57+ # start of suspend related tests
58+ # suspend point
59+ # Test discrete card first, if present, since it's the one we will be using
60+ # after coming back from suspend if the system has hybrid graphics.
61+ after-suspend-graphics-discrete-gpu-cert-manual
62+ after-suspend-monitor-discrete-gpu-cert-full
63+ # Now we ask to switch to the integrated graphics card. This requires a
64+ # restart of checkbox.
65+ after-suspend-graphics-integrated-gpu-cert-manual
66+ after-suspend-monitor-integrated-gpu-cert-full
67+ suspend-key-led-oops-check-cert
68+ after-suspend-audio-cert-full
69+ after-suspend-camera-cert-full
70+ after-suspend-input-cert-full
71+ after-suspend-keys-cert-full
72+ after-suspend-led-cert-full
73+ after-suspend-mediacard-cert-full
74+ after-suspend-optical-cert-full
75+ after-suspend-touchpad-cert-full
76+ after-suspend-touchscreen-cert-manual
77+ after-suspend-usb-cert-full
78+ after-suspend-usb3-cert-full
79+ after-suspend-usb-c-cert-full
80+ # after-suspend-wireless-cert-full # auto only
81+ info-attachment-cert-manual
82+exclude:
83+ keys/hibernate
84+
85+
86+id: client-cert-desktop-22-04-automated
87+_name: [DRAFT] Desktop Preload Certification Tests for 22.04 (Automated Tests)
88+unit: test plan
89+_description:
90+ Includes tests that do not require operator input.
91+include:
92+ audio/alsa_record_playback_automated
93+ recovery_info_attachment
94+nested_part:
95+ submission-cert-automated
96+ info-attachment-cert-automated
97+ audio-cert-automated
98+ bluetooth-cert-automated
99+ camera-cert-automated
100+ thunderbolt-cert-automated
101+ monitor-integrated-gpu-cert-automated
102+ graphics-integrated-gpu-cert-automated
103+ graphics-discrete-gpu-cert-automated
104+ monitor-discrete-gpu-cert-automated
105+ cpu-cert-automated
106+ input-cert-automated
107+ disk-cert-automated
108+ misc-client-cert-automated
109+ fingerprint-automated
110+ keys-cert-automated
111+ led-cert-automated
112+ mediacard-cert-automated
113+ mediacard-automated
114+ memory-automated
115+ mobilebroadband-cert-automated
116+ ethernet-cert-automated
117+ networking-cert-automated
118+ optical-cert-automated
119+ power-management-precheck-cert-automated
120+ touchpad-cert-automated
121+ touchscreen-cert-automated
122+ usb-cert-automated
123+ usb-automated
124+ wireless-cert-automated
125+ # start of suspend related tests
126+ before-suspend-reference-cert-full
127+ # suspend point
128+ after-suspend-reference-cert-full
129+ # Test discrete card first, if present, since it's the one we will be using
130+ # after coming back from suspend if the system has hybrid graphics.
131+ after-suspend-graphics-discrete-gpu-cert-automated
132+ # after-suspend-monitor-discrete-gpu-cert-automated # not defined
133+ # Now we ask to switch to the integrated graphics card.
134+ after-suspend-graphics-integrated-gpu-cert-automated
135+ # after-suspend-monitor-integrated-gpu-cert-automated # not defined
136+ after-suspend-touchscreen-cert-automated
137+ after-suspend-wireless-cert-automated
138+ # The following tests should run BEFORE the automated tests. The reboot and
139+ # power off tests will also give us a clean system to start the stress run
140+ # with.
141+ power-management-reboot-poweroff-cert-automated
142+ tpm-cert-automated
143+bootstrap_include:
144+ device
145+ graphics_card
146+
147+id: client-cert-desktop-22-04-stress
148+_name: [DRAFT] Desktop Preload Certification Tests for 22.04 (Stress Tests)
149+unit: test plan
150+_description:
151+ Includes tests that are long running device stress tests.
152+include:
153+nested_part:
154+ submission-cert-automated
155+ # The following tests are purely automated and/or lenghty stress tests.
156+ # They have been moved to the end of the test run to improve the testing
157+ # process.
158+ stress-iperf3-automated
159+ #stress-cert-full
160+ stress-suspend-30-cycles-with-reboots-automated
161+ stress-ng-cert-automated
162+ stress-30-reboot-poweroff-automated
163+ stress-pm-graph
164diff --git a/units/client-cert-iot-server-22-04.pxu b/units/client-cert-iot-server-22-04.pxu
165new file mode 100644
166index 0000000..97c48c8
167--- /dev/null
168+++ b/units/client-cert-iot-server-22-04.pxu
169@@ -0,0 +1,45 @@
170+id: client-cert-iot-server-22-04
171+_name: [DRAFT] IoT Client Certification for 22.04 classic images
172+unit: test plan
173+_description:
174+ This is classic 22.04
175+include:
176+nested_part:
177+ client-cert-iot-server-22-04-manual
178+ client-cert-iot-server-22-04-automated
179+
180+
181+id: client-cert-iot-server-22-04-manual
182+_name: [DRAFT] IoT Client Certification for 22.04 classic images (Manual Tests)
183+unit: test plan
184+_description:
185+ This is classic 22.04
186+include:
187+nested_part:
188+ # until there is reason to diverge, nest these plans
189+ client-cert-iot-ubuntucore-20-manual
190+exclude:
191+ ubuntucore/os-.*
192+ snappy/os-.*
193+
194+
195+id: client-cert-iot-server-22-04-automated
196+_name: [DRAFT] IoT Client Certification for 22.04 classic images (Automated Tests)
197+unit: test plan
198+_description:
199+ This is classic 22.04
200+include:
201+nested_part:
202+ # until there is reason to diverge, nest these plans
203+ client-cert-iot-ubuntucore-20-automated
204+ ## snappy-snap-automated-lightweight ??
205+
206+
207+id: client-cert-iot-server-22-04-stress
208+_name: [DRAFT] IoT Client Certification for 22.04 classic images (Stress Tests)
209+unit: test plan
210+_description:
211+ This is classic 22.04
212+include:
213+nested_part:
214+ stress-full
215diff --git a/units/client-cert-iot-ubuntucore-22.pxu b/units/client-cert-iot-ubuntucore-22.pxu
216new file mode 100644
217index 0000000..245e845
218--- /dev/null
219+++ b/units/client-cert-iot-ubuntucore-22.pxu
220@@ -0,0 +1,179 @@
221+id: client-cert-iot-ubuntucore-22
222+_name: [DRAFT] IoT Client Certification for Ubuntu Core 22
223+unit: test plan
224+_description:
225+ This is UC22
226+include:
227+nested_part:
228+ client-cert-iot-ubuntucore-22-manual
229+ client-cert-iot-ubuntucore-22-automated
230+
231+
232+id: client-cert-iot-ubuntucore-22-manual
233+_name: [DRAFT] IoT Client Certification for Ubuntu Core 22 (Manual Tests)
234+unit: test plan
235+_description:
236+ This is UC22
237+include:
238+mandatory_include:
239+ com.canonical.plainbox::manifest
240+ alsa_resource
241+ dmi
242+ dmi_attachment
243+ dmesg_attachment
244+ dpkg
245+ lsb
246+ lspci_attachment
247+ lsusb_attachment
248+ meminfo
249+ package
250+ snap
251+ sysfs_attachment
252+ udev_attachment
253+ udev_json
254+ uname
255+ model_assertion
256+ serial_assertion
257+ parts_meta_info_attachment
258+ info/buildstamp
259+ info/systemd-analyze
260+ system_info_json
261+ net_if_management_attachment
262+bootstrap_include:
263+ bootloader
264+ cpuinfo
265+ device
266+ interface
267+ net_if_management
268+nested_part:
269+ self-manual
270+ ubuntucore-manual
271+ audio-manual
272+ bluetooth-manual
273+ camera-manual
274+ cpu-manual
275+ disk-manual
276+ ethernet-manual
277+ led-manual
278+ mediacard-manual
279+ memory-manual
280+ monitor-manual
281+ networking-manual
282+ rtc-manual
283+ serial-manual
284+ snappy-snap-manual
285+ socketcan-manual-remote
286+ socketcan-manual-local
287+ usb-manual
288+ usb-c-manual
289+ usb3-manual
290+ thunderbolt-cert-manual
291+ watchdog-manual
292+ wireless-manual
293+ wireless-wifi-master-mode-manual
294+ wwan-manual
295+ after-suspend-audio-manual
296+ after-suspend-bluetooth-manual
297+ after-suspend-ethernet-manual
298+ after-suspend-monitor-manual
299+ after-suspend-networking-manual
300+ after-suspend-serial-manual
301+ after-suspend-socketcan-manual-remote
302+ after-suspend-socketcan-manual-local
303+ after-suspend-usb-manual
304+ after-suspend-usb-c-manual
305+ after-suspend-usb3-manual
306+ after-suspend-thunderbolt-cert-manual
307+ after-suspend-wireless-manual
308+ after-suspend-wireless-wifi-master-mode-manual
309+ after-suspend-wwan-manual
310+
311+
312+id: client-cert-iot-ubuntucore-22-automated
313+_name: [DRAFT] IoT Client Certification for Ubuntu Core 22 (Automated Tests)
314+unit: test plan
315+_description:
316+ This is UC22
317+include:
318+mandatory_include:
319+ com.canonical.plainbox::manifest
320+ alsa_resource
321+ dmi
322+ dmi_attachment
323+ dmesg_attachment
324+ dpkg
325+ lsb
326+ lspci_attachment
327+ lsusb_attachment
328+ meminfo
329+ package
330+ snap
331+ sysfs_attachment
332+ udev_attachment
333+ udev_json
334+ uname
335+ model_assertion
336+ serial_assertion
337+ parts_meta_info_attachment
338+ info/buildstamp
339+ info/systemd-analyze
340+ system_info_json
341+ net_if_management_attachment
342+bootstrap_include:
343+ bootloader
344+ cpuinfo
345+ device
346+ interface
347+ net_if_management
348+nested_part:
349+ self-automated
350+ ubuntucore-automated
351+ com.intel.ipdt::ipdt-plan
352+ iot-fwts-automated
353+ audio-automated
354+ bluez-automated
355+ camera-automated
356+ cpu-automated
357+ disk-automated
358+ docker-automated
359+ ethernet-automated
360+ i2c-automated
361+ gpio-automated
362+ kernel-security-automated
363+ kernel-snap-automated
364+ location-automated
365+ mediacard-automated
366+ memory-automated
367+ # monitor-automated
368+ networking-automated
369+ power-automated
370+ serial-automated
371+ snappy-snap-automated
372+ socketcan-auto-local
373+ socketcan-auto-remote
374+ tpm-cert-automated
375+ usb-automated
376+ thunderbolt-cert-automated
377+ watchdog-automated
378+ wireless-automated
379+ wireless-wifi-master-mode-auto
380+ wwan-automated
381+ after-suspend-audio-automated
382+ after-suspend-bluez-automated
383+ after-suspend-ethernet-automated
384+ after-suspend-gpio-automated
385+ after-suspend-location-automated
386+ after-suspend-serial-automated
387+ after-suspend-usb-automated
388+ after-suspend-wireless-automated
389+ after-suspend-wwan-automated
390+
391+
392+id: client-cert-iot-ubuntucore-22-stress
393+_name: [DRAFT] IoT Client Certification for Ubuntu Core 22 (Stress Tests)
394+unit: test plan
395+_description:
396+ This is UC22
397+include:
398+nested_part:
399+ stress-full
400diff --git a/units/client-cert-odm-desktop-22-04.pxu b/units/client-cert-odm-desktop-22-04.pxu
401new file mode 100644
402index 0000000..fbe7904
403--- /dev/null
404+++ b/units/client-cert-odm-desktop-22-04.pxu
405@@ -0,0 +1,218 @@
406+id: client-cert-odm-desktop-22-04-manual
407+_name: [DRAFT] ODM Client Certification for Desktop 22.04 - (1/2) Manual tests
408+unit: test plan
409+_description:
410+ This test plan is intended for use by ODMs in their own facilities as part of
411+ the ODM Certification programme. This test plan should be used when certifying
412+ Desktop images.
413+include:
414+nested_part:
415+ submission-cert-full
416+ audio-cert-manual
417+ bluetooth-cert-manual
418+ camera-cert-manual
419+ edac-manual
420+ thunderbolt-cert-manual
421+ monitor-integrated-gpu-cert-manual
422+ graphics-integrated-gpu-cert-manual
423+ graphics-discrete-gpu-cert-manual
424+ monitor-discrete-gpu-cert-manual
425+ input-cert-manual
426+ disk-cert-manual
427+ keys-cert-manual
428+ led-cert-manual
429+ mediacard-cert-manual
430+ mobilebroadband-cert-manual
431+ ethernet-cert-manual
432+ networking-cert-manual
433+ optical-cert-manual
434+ power-management-precheck-cert-manual
435+ # touchpad-cert-manual
436+ # touchscreen-cert-manual
437+ usb-cert-manual
438+ usb3-cert-manual
439+ usb-c-cert-full # no manual only
440+ usb-dwc3-manual
441+ wireless-cert-manual
442+ # start of suspend related tests
443+ before-suspend-reference-cert-full
444+ # suspend point
445+ after-suspend-reference-cert-full
446+ # Test discrete card first, if present, since it's the one we will be using
447+ # after coming back from suspend if the system has hybrid graphics.
448+ after-suspend-graphics-discrete-gpu-cert-manual
449+ after-suspend-monitor-discrete-gpu-cert-full
450+ # Now we ask to switch to the integrated graphics card. This requires a
451+ # restart of checkbox.
452+ after-suspend-graphics-integrated-gpu-cert-manual
453+ after-suspend-monitor-integrated-gpu-cert-full
454+ suspend-key-led-oops-check-cert
455+ after-suspend-audio-cert-full # no-manual only
456+ after-suspend-camera-cert-full # no-manual only
457+ after-suspend-input-cert-full # no-manual only
458+ after-suspend-keys-cert-full # no-manual only
459+ after-suspend-led-cert-full # no-manual only
460+ after-suspend-mediacard-cert-full # no-manual only
461+ after-suspend-optical-cert-full # no-manual only
462+ # after-suspend-touchpad-cert-manual
463+ # after-suspend-touchscreen-cert-manual
464+ after-suspend-usb-cert-full # no-manual only
465+ after-suspend-usb3-cert-full # no-manual only
466+ after-suspend-usb-c-cert-full # no manual only
467+ # after-suspend-wireless-cert-full # auto only
468+ info-attachment-cert-full
469+exclude:
470+ com.canonical.certification::keys/hibernate
471+ com.canonical.certification::keys/lock-screen
472+ com.canonical.certification::keys/brightness
473+ com.canonical.certification::keys/media-control
474+ com.canonical.certification::keys/mute
475+ com.canonical.certification::keys/volume
476+ com.canonical.certification::keys/video-out
477+ com.canonical.certification::keys/wireless
478+ com.canonical.certification::keys/keyboard-backlight
479+ com.canonical.certification::keys/microphone-mute
480+ com.canonical.certification::keys/fn-lock
481+ com.canonical.certification::after-suspend-manual-keys/hibernate
482+ com.canonical.certification::after-suspend-manual-keys/lock-screen
483+ com.canonical.certification::after-suspend-manual-keys/brightness
484+ com.canonical.certification::after-suspend-manual-keys/media-control
485+ com.canonical.certification::after-suspend-manual-keys/mute
486+ com.canonical.certification::after-suspend-manual-keys/volume
487+ com.canonical.certification::after-suspend-manual-keys/video-out
488+ com.canonical.certification::after-suspend-manual-keys/wireless
489+ com.canonical.certification::after-suspend-manual-keys/keyboard-backlight
490+ com.canonical.certification::after-suspend-manual-keys/microphone-mute
491+ com.canonical.certification::after-suspend-manual-keys/fn-lock
492+ com.canonical.certification::led/bluetooth
493+ com.canonical.certification::led/wlan
494+ com.canonical.certification::led/wlan-disabled
495+ com.canonical.certification::led/fn
496+ com.canonical.certification::led/mute
497+ com.canonical.certification::led/microphone-mute
498+ com.canonical.certification::suspend/led_after_suspend/bluetooth
499+ com.canonical.certification::suspend/led_after_suspend/wlan
500+ com.canonical.certification::suspend/led_after_suspend/wlan-disabled
501+ com.canonical.certification::after-suspend-manual-led/fn
502+ com.canonical.certification::after-suspend-manual-led/mute
503+ com.canonical.certification::after-suspend-manual-led/microphone-mute
504+
505+id: client-cert-odm-desktop-22-04-automated
506+_name: [DRAFT] ODM Client Certification for Desktop 22.04 - (2/2) Automated tests
507+unit: test plan
508+_description:
509+ This test plan is intended for use by ODMs in their own facilities as part of
510+ the ODM Certification programme. This test plan should be used when certifying
511+ Desktop images.
512+include:
513+nested_part:
514+ submission-cert-full
515+ audio-cert-automated
516+ bluetooth-cert-automated
517+ camera-cert-automated
518+ edac-automated
519+ thunderbolt-cert-automated
520+ monitor-integrated-gpu-cert-automated
521+ graphics-integrated-gpu-cert-automated
522+ graphics-discrete-gpu-cert-automated
523+ monitor-discrete-gpu-cert-automated
524+ input-cert-automated
525+ disk-cert-manual
526+ keys-cert-automated
527+ led-cert-automated
528+ mediacard-cert-automated
529+ mobilebroadband-cert-automated
530+ ethernet-cert-automated
531+ networking-cert-automated
532+ optical-cert-automated
533+ power-management-precheck-cert-automated
534+ # touchpad-cert-automated
535+ # touchscreen-cert-automated
536+ usb-cert-automated
537+ usb3-cert-automated
538+ # usb-c-cert-automated # only usb-c-cert-full
539+ usb-dwc3-automated
540+ wireless-cert-automated
541+ # start of suspend related tests
542+ before-suspend-reference-cert-full
543+ # suspend point
544+ after-suspend-reference-cert-full
545+ # Test discrete card first, if present, since it's the one we will be using
546+ # after coming back from suspend if the system has hybrid graphics.
547+ after-suspend-graphics-discrete-gpu-cert-automated
548+ # after-suspend-monitor-discrete-gpu-cert-automated # not defined
549+ # Now we ask to switch to the integrated graphics card. This requires a
550+ # restart of checkbox.
551+ after-suspend-graphics-integrated-gpu-cert-automated
552+ # after-suspend-monitor-integrated-gpu-cert-automated # not defined
553+ suspend-key-led-oops-check-cert
554+ # after-suspend-audio-cert-automated
555+ # after-suspend-camera-cert-automated
556+ # after-suspend-input-cert-automated
557+ # after-suspend-keys-cert-automated
558+ # after-suspend-led-cert-automated
559+ # after-suspend-mediacard-cert-automated
560+ # after-suspend-optical-cert-automated
561+ # after-suspend-touchpad-cert-automated
562+ # after-suspend-touchscreen-cert-automated
563+ # after-suspend-usb-cert-automated
564+ # after-suspend-usb3-cert-automated
565+ # after-suspend-usb-c-cert-automated # only usb-c-cert-full
566+ after-suspend-wireless-cert-automated
567+ # Automated Tests
568+ # The following tests are purely automated and/or lenghty stress tests.
569+ # They have been moved to the end of the test run to improve the testing
570+ # process.
571+ misc-client-cert-full
572+ cpu-cert-automated
573+ disk-cert-automated
574+ stress-iperf3-automated
575+ warm-boot-stress-test
576+ cold-boot-stress-test
577+ suspend-stress-test
578+ stress-ng-cert-automated
579+ tpm-cert-automated
580+ info-attachment-cert-full
581+exclude:
582+ com.canonical.certification::keys/hibernate
583+ com.canonical.certification::keys/lock-screen
584+ com.canonical.certification::keys/brightness
585+ com.canonical.certification::keys/media-control
586+ com.canonical.certification::keys/mute
587+ com.canonical.certification::keys/volume
588+ com.canonical.certification::keys/video-out
589+ com.canonical.certification::keys/wireless
590+ com.canonical.certification::keys/keyboard-backlight
591+ com.canonical.certification::keys/microphone-mute
592+ com.canonical.certification::keys/fn-lock
593+ com.canonical.certification::after-suspend-manual-keys/hibernate
594+ com.canonical.certification::after-suspend-manual-keys/lock-screen
595+ com.canonical.certification::after-suspend-manual-keys/brightness
596+ com.canonical.certification::after-suspend-manual-keys/media-control
597+ com.canonical.certification::after-suspend-manual-keys/mute
598+ com.canonical.certification::after-suspend-manual-keys/volume
599+ com.canonical.certification::after-suspend-manual-keys/video-out
600+ com.canonical.certification::after-suspend-manual-keys/wireless
601+ com.canonical.certification::after-suspend-manual-keys/keyboard-backlight
602+ com.canonical.certification::after-suspend-manual-keys/microphone-mute
603+ com.canonical.certification::after-suspend-manual-keys/fn-lock
604+ com.canonical.certification::led/bluetooth
605+ com.canonical.certification::led/wlan
606+ com.canonical.certification::led/wlan-disabled
607+ com.canonical.certification::led/fn
608+ com.canonical.certification::led/mute
609+ com.canonical.certification::led/microphone-mute
610+ com.canonical.certification::suspend/led_after_suspend/bluetooth
611+ com.canonical.certification::suspend/led_after_suspend/wlan
612+ com.canonical.certification::suspend/led_after_suspend/wlan-disabled
613+ com.canonical.certification::after-suspend-manual-led/fn
614+ com.canonical.certification::after-suspend-manual-led/mute
615+ com.canonical.certification::after-suspend-manual-led/microphone-mute
616+
617+id: client-cert-odm-desktop-22-04
618+_name: [DRAFT] DONT USE - desktop-22-04 - placeholder to establish that total number of tests has not changed
619+unit: test plan
620+include:
621+nested_part:
622+ client-cert-odm-desktop-22-04-manual
623+ client-cert-odm-desktop-22-04-automated
624diff --git a/units/client-cert-odm-ubuntucore-22.pxu b/units/client-cert-odm-ubuntucore-22.pxu
625new file mode 100644
626index 0000000..b8d5b66
627--- /dev/null
628+++ b/units/client-cert-odm-ubuntucore-22.pxu
629@@ -0,0 +1,158 @@
630+id: client-cert-odm-ubuntucore-22-manual
631+_name: [DRAFT] ODM Client Certification for Ubuntu Core 22 - (1/2) Manual tests
632+unit: test plan
633+_description:
634+ This test plan is intended for use by ODMs in their own facilities as part of
635+ the ODM Certification programme. This test plan should be used when certifying
636+ Ubuntu Core images.
637+include:
638+mandatory_include:
639+ com.canonical.plainbox::manifest
640+ executable
641+ dmi
642+ dmi_attachment
643+ dpkg
644+ interface
645+ lsb
646+ lspci_attachment
647+ lsusb_attachment
648+ meminfo
649+ package
650+ rtc
651+ sleep
652+ snap
653+ sysfs_attachment
654+ udev_attachment
655+ udev_json
656+ uname
657+ connections
658+ model_assertion
659+ serial_assertion
660+ net_if_management_attachment
661+bootstrap_include:
662+ bootloader
663+ cpuinfo
664+ device
665+ net_if_management
666+nested_part:
667+ self-manual
668+ audio-manual
669+ bluetooth-manual
670+ camera-manual
671+ edac-manual
672+ led-manual
673+ mediacard-manual
674+ rtc-manual
675+ serial-manual
676+ usb-c-manual
677+ usb-manual
678+ usb3-manual
679+ usb-dwc3-manual
680+ thunderbolt-cert-manual
681+ wwan-manual
682+ i2c-manual
683+ suspend-tp
684+ after-suspend-audio-manual
685+ after-suspend-bluetooth-manual
686+ after-suspend-ethernet-manual
687+ after-suspend-wwan-manual
688+ after-suspend-thunderbolt-cert-manual
689+exclude:
690+ com.intel.ipdt::ipdt/PCH-.*
691+ usb-c/c-to-a-adapter.*
692+ mediacard/mmc-.*
693+ mediacard/cf-.*
694+ mediacard/sdxc-.*
695+ mediacard/ms-.*
696+ mediacard/msp-.*
697+ mediacard/xd-.*
698+ rtc/battery
699+
700+id: client-cert-odm-ubuntucore-22-automated
701+_name: [DRAFT] ODM Client Certification for Ubuntu Core 22 - (2/2) Automated tests
702+unit: test plan
703+_description:
704+ This test plan is intended for use by ODMs in their own facilities as part of
705+ the ODM Certification programme. This test plan should be used when certifying
706+ Ubuntu Core images.
707+include:
708+mandatory_include:
709+ com.canonical.plainbox::manifest
710+ executable
711+ dmi
712+ dmi_attachment
713+ dpkg
714+ interface
715+ lsb
716+ lspci_attachment
717+ lsusb_attachment
718+ meminfo
719+ package
720+ rtc
721+ sleep
722+ snap
723+ sysfs_attachment
724+ udev_attachment
725+ udev_json
726+ uname
727+ connections
728+ model_assertion
729+ serial_assertion
730+ net_if_management_attachment
731+bootstrap_include:
732+ bootloader
733+ cpuinfo
734+ device
735+ net_if_management
736+nested_part:
737+ self-automated
738+ bluez-automated
739+ camera-automated
740+ edac-automated
741+ mediacard-automated
742+ rtc-automated
743+ serial-automated
744+ usb-c-automated
745+ usb-automated
746+ usb3-automated
747+ usb-dwc3-automated
748+ thunderbolt-cert-automated
749+ watchdog-automated
750+ wwan-automated
751+ com.intel.ipdt::ipdt-plan
752+ cpu-automated
753+ disk-automated
754+ ethernet-automated
755+ iot-cert-image-automated
756+ i2c-automated
757+ memory-automated
758+ networking-automated
759+ snappy-snap-automated
760+ wireless-automated
761+ wireless-wifi-master-mode-auto
762+ tpm-cert-automated
763+ suspend-tp
764+ after-suspend-bluez-automated
765+ after-suspend-ethernet-automated
766+ after-suspend-wireless-automated
767+ after-suspend-wwan-automated
768+ warm-boot-stress-test
769+ cold-boot-stress-test
770+exclude:
771+ com.intel.ipdt::ipdt/PCH-.*
772+ usb-c/c-to-a-adapter.*
773+ mediacard/mmc-.*
774+ mediacard/cf-.*
775+ mediacard/sdxc-.*
776+ mediacard/ms-.*
777+ mediacard/msp-.*
778+ mediacard/xd-.*
779+ rtc/battery
780+
781+id: client-cert-odm-ubuntucore-22
782+_name: [DRAFT] DONT USE - uc22 - placeholder to establish that total number of tests has not changed
783+unit: test plan
784+include:
785+nested_part:
786+ client-cert-odm-ubuntucore-22-manual
787+ client-cert-odm-ubuntucore-22-automated

Subscribers

People subscribed via source and target branches