Merge ~liaou3/checkbox-iiotg/+git/checkbox-provider-intliotg:refactor_testplan_with_nested into ~checkbox-dev/checkbox-iiotg/+git/checkbox-provider-intliotg:master

Proposed by Vincent Liao
Status: Merged
Approved by: Vincent Liao
Approved revision: d83e8d2d4f454c1de577d537e167b5ce44acd6e3
Merged at revision: 991812880ae9f5ec8fc4f55d29b54e5e985a5c0d
Proposed branch: ~liaou3/checkbox-iiotg/+git/checkbox-provider-intliotg:refactor_testplan_with_nested
Merge into: ~checkbox-dev/checkbox-iiotg/+git/checkbox-provider-intliotg:master
Diff against target: 636 lines (+230/-74)
6 files modified
units/test-plan-core-rt.pxu (+58/-0)
units/test-plan-core.pxu (+19/-24)
units/test-plan-desktop-rt.pxu (+58/-0)
units/test-plan-desktop.pxu (+19/-25)
units/test-plan-server-rt.pxu (+57/-0)
units/test-plan-server.pxu (+19/-25)
Reviewer Review Type Date Requested Status
Rick Wu Approve
Vic Liu Approve
StanleyHuang Pending
PeiYao Chang Pending
Doug Jacobs Pending
Patrick Liu Pending
Review via email: mp+444230@code.launchpad.net

Commit message

Modify: Seperate realtime testplan from generic testplan.

Description of the change

Description
-----------
This MR is to seperate realtime testplan from generic test plan.

Changed
-------
1. Remove realtime related jobs or testplans from generic testplan.
    - tsn
    - rt-performance-tests-stress
2. Create realtime testplan, basically it's the same as generic test plan, but
    - Add tsn and rt-performance-tests-stress
    - Remove suspend related tests

Diff
----
1. For core testplan: https://pastebin.canonical.com/p/hB8gtMdMWT/
2. For desktop testplan: https://pastebin.canonical.com/p/RRJjzb79N7/
3. For server testplan: https://pastebin.canonical.com/p/GC8BdPHcTK/

Linked MR
---------
https://code.launchpad.net/~liaou3/checkbox-iiotg/+git/checkbox-iiotg/+merge/444358
https://code.launchpad.net/~liaou3/checkbox-iiotg/+git/checkbox-iiotg/+merge/444359
https://code.launchpad.net/~liaou3/checkbox-iiotg/+git/checkbox-iiotg-classic/+merge/444361
https://code.launchpad.net/~liaou3/checkbox-iiotg/+git/checkbox-iiotg-classic/+merge/444362

To post a comment you must log in.
Revision history for this message
Rick Wu (rickwu4444) wrote :

@Vincent,
Please see my in-line comments.

review: Needs Fixing
Revision history for this message
Vincent Liao (liaou3) wrote :

@Rick
Please see my reply. Thanks!

Revision history for this message
Vic Liu (zongminl) wrote :

- Please update the copyright year to 2023 on the files you touched
- +1 to what Rick mentions in the review, let's use the full name of Intel IoTG in the description (maybe in a separated commit to do this change to all the test plans)
- checkbox-iiotg is missing 'rt-tests' stage-package definition in order for cyclictest to run, please raise another MR for cyclictest to be able to start running in core images (ref: https://git.launchpad.net/~checkbox-dev/checkbox-iiotg/+git/checkbox-iiotg-classic/tree/snap/snapcraft.yaml#n64)

Please also check my incline comments for more details to be fixed

review: Needs Fixing
Revision history for this message
Vincent Liao (liaou3) wrote :

@Vic

Please see my in-line reply for the question.

Revision history for this message
Vic Liu (zongminl) wrote :

- Please update the copyright year to 2023
- Please use "Intel IoTG" in the name/description/summary strings instead of "intel iotg"
- Please remove all the series 20 (desktop 20.04, server 20.04 and ubuntu core 20) RT test plans, we don't need to support RT on focal
- Let's use regex power-management-cpu-cstate/.* to exclude the jobs we don't want them to run

review: Needs Fixing
Revision history for this message
Vincent Liao (liaou3) wrote (last edit ):

@Vic @Rick

What I fixed
------------
1. change name from "intliotg" to "intel iotg" for being mre human readable in the field of name and description in testplan.
2. Update copyright from 2022 to 2023.
3. Remove realtime test on 20 due to it only support on 22 now.
4. Exclude all jobs under "power-management-cpu-cstate" category in realtime automated testplan.

Later works
------------
1. checkbox-iiotg is missing 'rt-tests' stage-package definition in order for cyclictest to run, I would raise another MR for cyclictest to be able to start running in core images (ref: https://git.launchpad.net/~checkbox-dev/checkbox-iiotg/+git/checkbox-iiotg-classic/tree/snap/snapcraft.yaml#n64)
2. I will squash all commit into one before merge into main branch.

Revision history for this message
Vic Liu (zongminl) wrote :

Some more minor changes need to be made. you can consider this MR approved once you've done the chages:
- Use "Intel IoTG" instead of "intel iotg"
- Correct the indentation in intliotg-desktop-22-04-automated-rt

review: Approve
Revision history for this message
Rick Wu (rickwu4444) wrote :

LGTM

review: Approve
Revision history for this message
Vincent Liao (liaou3) wrote (last edit ):

I have squashed all commits into one, ready to merge.

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1diff --git a/units/test-plan-core-rt.pxu b/units/test-plan-core-rt.pxu
2new file mode 100644
3index 0000000..c113fdc
4--- /dev/null
5+++ b/units/test-plan-core-rt.pxu
6@@ -0,0 +1,58 @@
7+# Copyright 2023 Canonical Ltd.
8+# All rights reserved.
9+#
10+# Test plans and (optionally) jobs unique to the realtime Ubuntu Core Intel IoTG devices.
11+#
12+
13+id: intliotg-ubuntucore-22-rt
14+unit: test plan
15+_name: Intel IoTG - Full manual + automated tests for realtime Ubuntu Core 22
16+_description:
17+ Combined manual and automated test plans for realtime Ubuntu Core Intel IoTG devices.
18+include:
19+nested_part:
20+ intliotg-ubuntucore-22-manual-rt
21+ intliotg-ubuntucore-22-automated-rt
22+
23+id: intliotg-ubuntucore-22-manual-rt
24+unit: test plan
25+_name: Intel IoTG - Manual only QA tests for realtime Ubuntu Core 22
26+_description:
27+ Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test
28+ plan contains all of the tests that require manual control of device
29+ hardware or some other user input to complete.
30+estimated_duration: 3600
31+include:
32+nested_part:
33+ intliotg-ubuntucore-22-manual
34+ tsn-manual
35+exclude:
36+ .*::.*suspend.*
37+
38+id: intliotg-ubuntucore-22-automated-rt
39+unit: test plan
40+_name: Intel IoTG - Automated only QA tests for realtime Ubuntu Core 22
41+_description:
42+ Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test
43+ plan contains all of the automated tests used to validate the realtime
44+ Intel IoTG device.
45+include:
46+nested_part:
47+ intliotg-ubuntucore-22-automated
48+ tsn-automated
49+exclude:
50+ .*::.*suspend.*
51+ power-management-cpu-cstate/.*
52+
53+id: intliotg-ubuntucore-22-stress-rt
54+unit: test plan
55+_name: Intel IoTG - Stress tests for realtime Ubuntu Core 22
56+_description:
57+ Ubuntu Core QA test plan that includes all stress tests required for
58+ realtime Intel IoTG devices.
59+include:
60+nested_part:
61+ intliotg-ubuntucore-22-stress
62+ rt-performance-tests-stress
63+exclude:
64+ .*::.*suspend.*
65diff --git a/units/test-plan-core.pxu b/units/test-plan-core.pxu
66index 0fab369..dc7a11e 100644
67--- a/units/test-plan-core.pxu
68+++ b/units/test-plan-core.pxu
69@@ -1,14 +1,14 @@
70 # Copyright 2022 Canonical Ltd.
71 # All rights reserved.
72 #
73-# Test plans and (optionally) jobs unique to the Ubuntu Core intliotg devices.
74+# Test plans and (optionally) jobs unique to the Ubuntu Core Intel IoTG devices.
75 #
76
77 id: intliotg-ubuntucore-22
78 unit: test plan
79-_name: intliotg - Full manual + automated tests for Ubuntu Core 22
80+_name: Intel IoTG - Full manual + automated tests for Ubuntu Core 22
81 _description:
82- Combined manual and automated test plans for Ubuntu Core intliotg devices.
83+ Combined manual and automated test plans for Ubuntu Core Intel IoTG devices.
84 include:
85 nested_part:
86 intliotg-ubuntucore-22-manual
87@@ -16,9 +16,9 @@ nested_part:
88
89 id: intliotg-ubuntucore-20
90 unit: test plan
91-_name: intliotg - Full manual + automated tests for Ubuntu Core 20
92+_name: Intel IoTG - Full manual + automated tests for Ubuntu Core 20
93 _description:
94- Combined manual and automated test plans for Ubuntu Core intliotg devices.
95+ Combined manual and automated test plans for Ubuntu Core Intel IoTG devices.
96 include:
97 nested_part:
98 intliotg-ubuntucore-20-manual
99@@ -26,9 +26,9 @@ nested_part:
100
101 id: intliotg-ubuntucore-22-manual
102 unit: test plan
103-_name: intliotg - Manual only QA tests for Ubuntu Core 22
104+_name: Intel IoTG - Manual only QA tests for Ubuntu Core 22
105 _description:
106- Ubuntu Core QA test plan for the intliotg hardware. This test plan contains
107+ Ubuntu Core QA test plan for the Intel IoTG hardware. This test plan contains
108 all of the tests that require manual control of device hardware
109 or some other user input to complete.
110 estimated_duration: 3600
111@@ -42,7 +42,6 @@ nested_part:
112 com.canonical.certification::edac-manual
113 usb-dwc3-manual
114 ishtp-manual
115- tsn-manual
116 thermal-manual
117 intel-mei-manual
118 com.canonical.qa.ceoem::ce-oem-manual
119@@ -54,9 +53,9 @@ exclude:
120
121 id: intliotg-ubuntucore-20-manual
122 unit: test plan
123-_name: intliotg - Manual only QA tests for Ubuntu Core 20
124+_name: Intel IoTG - Manual only QA tests for Ubuntu Core 20
125 _description:
126- Ubuntu Core QA test plan for the intliotg hardware. This test plan contains
127+ Ubuntu Core QA test plan for the Intel IoTG hardware. This test plan contains
128 all of the tests that require manual control of device hardware
129 or some other user input to complete.
130 estimated_duration: 3600
131@@ -70,7 +69,6 @@ nested_part:
132 com.canonical.certification::edac-manual
133 usb-dwc3-manual
134 ishtp-manual
135- tsn-manual
136 thermal-manual
137 intel-mei-manual
138 com.canonical.certification::client-cert-iot-ubuntucore-20-manual
139@@ -80,10 +78,10 @@ exclude:
140
141 id: intliotg-ubuntucore-22-automated
142 unit: test plan
143-_name: intliotg - Automated only QA tests for Ubuntu Core 22
144+_name: Intel IoTG - Automated only QA tests for Ubuntu Core 22
145 _description:
146- Ubuntu Core QA test plan for the intliotg hardware. This test plan contains
147- all of the automated tests used to validate the intliotg device.
148+ Ubuntu Core QA test plan for the Intel IoTG hardware. This test plan contains
149+ all of the automated tests used to validate the Intel IoTG device.
150 include:
151 com.canonical.certification::image/model-grade
152 com.canonical.certification::miscellanea/secure_boot_mode_.* # keep if secure boot is enabled
153@@ -96,7 +94,6 @@ nested_part:
154 com.canonical.certification::edac-automated
155 usb-dwc3-automated
156 ishtp-automated
157- tsn-automated
158 thermal-automated
159 intel-mei-automated
160 com.canonical.qa.ceoem::ce-oem-automated
161@@ -109,10 +106,10 @@ exclude:
162
163 id: intliotg-ubuntucore-20-automated
164 unit: test plan
165-_name: intliotg - Automated only QA tests for Ubuntu Core 20
166+_name: Intel IoTG - Automated only QA tests for Ubuntu Core 20
167 _description:
168- Ubuntu Core QA test plan for the intliotg hardware. This test plan contains
169- all of the automated tests used to validate the intliotg device.
170+ Ubuntu Core QA test plan for the Intel IoTG hardware. This test plan contains
171+ all of the automated tests used to validate the Intel IoTG device.
172 include:
173 com.canonical.certification::image/model-grade
174 com.canonical.certification::miscellanea/secure_boot_mode_.* # keep if secure boot is enabled
175@@ -125,7 +122,6 @@ nested_part:
176 com.canonical.certification::edac-automated
177 usb-dwc3-automated
178 ishtp-automated
179- tsn-automated
180 thermal-automated
181 intel-mei-automated
182 com.canonical.certification::client-cert-iot-ubuntucore-20-automated
183@@ -136,9 +132,9 @@ exclude:
184
185 id: intliotg-ubuntucore-22-stress
186 unit: test plan
187-_name: intliotg - Stress tests for Ubuntu Core 22
188+_name: Intel IoTG - Stress tests for Ubuntu Core 22
189 _description:
190- Ubuntu Core QA test plan that includes all stress tests required for intliotg devices
191+ Ubuntu Core QA test plan that includes all stress tests required for Intel IoTG devices
192 include:
193 nested_part:
194 device-connections-tp
195@@ -149,9 +145,9 @@ exclude:
196
197 id: intliotg-ubuntucore-20-stress
198 unit: test plan
199-_name: intliotg - Stress tests for Ubuntu Core 20
200+_name: Intel IoTG - Stress tests for Ubuntu Core 20
201 _description:
202- Ubuntu Core QA test plan that includes all stress tests required for intliotg devices
203+ Ubuntu Core QA test plan that includes all stress tests required for Intel IoTG devices
204 include:
205 nested_part:
206 device-connections-tp
207@@ -159,4 +155,3 @@ nested_part:
208 com.canonical.certification::client-cert-iot-ubuntucore-20-stress
209 exclude:
210 com.canonical.certification::stress-tests/hibernate.*
211-
212diff --git a/units/test-plan-desktop-rt.pxu b/units/test-plan-desktop-rt.pxu
213new file mode 100644
214index 0000000..efb6515
215--- /dev/null
216+++ b/units/test-plan-desktop-rt.pxu
217@@ -0,0 +1,58 @@
218+# Copyright 2023 Canonical Ltd.
219+# All rights reserved.
220+#
221+# Test plans and (optionally) jobs unique to the realtime Ubuntu Desktop Intel IoTG devices.
222+#
223+
224+id: intliotg-desktop-22-04-rt
225+unit: test plan
226+_name: Intel IoTG - Full manual + automated tests for realtime Ubuntu Desktop 22.04
227+_description:
228+ Combined manual and automated test plans for realtime Ubuntu Desktop Intel IoTG devices.
229+include:
230+nested_part:
231+ intliotg-desktop-22-04-manual-rt
232+ intliotg-desktop-22-04-automated-rt
233+
234+id: intliotg-desktop-22-04-manual-rt
235+unit: test plan
236+_name: Intel IoTG - Manual only QA tests for realtime Ubuntu Desktop 22.04
237+_description:
238+ Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test
239+ plan contains all of the tests that require manual control of device
240+ hardware or some other user input to complete.
241+estimated_duration: 3600
242+include:
243+nested_part:
244+ intliotg-desktop-22-04-manual
245+ tsn-manual
246+exclude:
247+ .*::.*suspend.*
248+
249+id: intliotg-desktop-22-04-automated-rt
250+unit: test plan
251+_name: Intel IoTG - Automated only QA tests for realtime Ubuntu Desktop 22.04
252+_description:
253+ Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test
254+ plan contains all of the automated tests used to validate the realtime
255+ Intel IoTG device.
256+include:
257+nested_part:
258+ intliotg-desktop-22-04-automated
259+ tsn-automated
260+exclude:
261+ .*::.*suspend.*
262+ power-management-cpu-cstate/.*
263+
264+id: intliotg-desktop-22-04-stress-rt
265+unit: test plan
266+_name: Intel IoTG - Stress tests for realtime Ubuntu Desktop 22.04 image
267+_description:
268+ Ubuntu Core QA test plan that includes all stress tests required for
269+ realtime Intel IoTG devices.
270+include:
271+nested_part:
272+ intliotg-desktop-22-04-stress
273+ rt-performance-tests-stress
274+exclude:
275+ .*::.*suspend.*
276diff --git a/units/test-plan-desktop.pxu b/units/test-plan-desktop.pxu
277index 1220382..4938653 100644
278--- a/units/test-plan-desktop.pxu
279+++ b/units/test-plan-desktop.pxu
280@@ -1,14 +1,14 @@
281 # Copyright 2022 Canonical Ltd.
282 # All rights reserved.
283 #
284-# Test plans and (optionally) jobs unique to the Ubuntu Desktop intliotg devices.
285+# Test plans and (optionally) jobs unique to the Ubuntu Desktop Intel IoTG devices.
286 #
287
288 id: intliotg-desktop-22-04
289 unit: test plan
290-_name: intliotg - Full manual + automated tests for Ubuntu Desktop 22.04
291+_name: Intel IoTG - Full manual + automated tests for Ubuntu Desktop 22.04
292 _description:
293- Combined manual and automated test plans for Ubuntu Desktop intliotg devices.
294+ Combined manual and automated test plans for Ubuntu Desktop Intel IoTG devices.
295 include:
296 nested_part:
297 intliotg-desktop-22-04-manual
298@@ -16,9 +16,9 @@ nested_part:
299
300 id: intliotg-desktop-20-04
301 unit: test plan
302-_name: intliotg - Full manual + automated tests for Ubuntu Desktop 20.04
303+_name: Intel IoTG - Full manual + automated tests for Ubuntu Desktop 20.04
304 _description:
305- Combined manual and automated test plans for Ubuntu Desktop intliotg devices.
306+ Combined manual and automated test plans for Ubuntu Desktop Intel IoTG devices.
307 include:
308 nested_part:
309 intliotg-desktop-20-04-manual
310@@ -26,9 +26,9 @@ nested_part:
311
312 id: intliotg-desktop-22-04-manual
313 unit: test plan
314-_name: intliotg - Manual only QA tests for Ubuntu Desktop 22.04
315+_name: Intel IoTG - Manual only QA tests for Ubuntu Desktop 22.04
316 _description:
317- Ubuntu Desktop QA test plan for the intliotg hardware. This test plan contains
318+ Ubuntu Desktop QA test plan for the Intel IoTG hardware. This test plan contains
319 all of the tests that require manual control of device hardware
320 or some other user input to complete.
321 estimated_duration: 3600
322@@ -40,7 +40,6 @@ nested_part:
323 usb-dwc3-manual
324 ishtp-manual
325 va-api-manual
326- tsn-manual
327 thermal-manual
328 intel-mei-manual
329 com.canonical.qa.ceoem::ce-oem-manual
330@@ -57,9 +56,9 @@ exclude:
331
332 id: intliotg-desktop-20-04-manual
333 unit: test plan
334-_name: intliotg - Manual only QA tests for Ubuntu Desktop 20.04
335+_name: Intel IoTG - Manual only QA tests for Ubuntu Desktop 20.04
336 _description:
337- Ubuntu Desktop QA test plan for the intliotg hardware. This test plan contains
338+ Ubuntu Desktop QA test plan for the Intel IoTG hardware. This test plan contains
339 all of the tests that require manual control of device hardware
340 or some other user input to complete.
341 estimated_duration: 3600
342@@ -71,7 +70,6 @@ nested_part:
343 usb-dwc3-manual
344 ishtp-manual
345 va-api-manual
346- tsn-manual
347 thermal-manual
348 intel-mei-manual
349 com.canonical.certification::client-cert-desktop-20-04-manual
350@@ -86,10 +84,10 @@ exclude:
351
352 id: intliotg-desktop-22-04-automated
353 unit: test plan
354-_name: intliotg - Automated only QA tests for Ubuntu Desktop 22.04
355+_name: Intel IoTG - Automated only QA tests for Ubuntu Desktop 22.04
356 _description:
357- Ubuntu Desktop QA test plan for the intliotg hardware. This test plan contains
358- all of the automated tests used to validate the intliotg device.
359+ Ubuntu Desktop QA test plan for the Intel IoTG hardware. This test plan contains
360+ all of the automated tests used to validate the Intel IoTG device.
361 include:
362 nested_part:
363 watchdog-intliotg-automated
364@@ -99,7 +97,6 @@ nested_part:
365 usb-dwc3-automated
366 ishtp-automated
367 va-api-automated
368- tsn-automated
369 thermal-automated
370 intel-mei-automated
371 com.canonical.qa.ceoem::ce-oem-automated
372@@ -110,10 +107,10 @@ exclude:
373
374 id: intliotg-desktop-20-04-automated
375 unit: test plan
376-_name: intliotg - Automated only QA tests for Ubuntu Desktop 20.04
377+_name: Intel IoTG - Automated only QA tests for Ubuntu Desktop 20.04
378 _description:
379- Ubuntu Desktop QA test plan for the intliotg hardware. This test plan contains
380- all of the automated tests used to validate the intliotg device.
381+ Ubuntu Desktop QA test plan for the Intel IoTG hardware. This test plan contains
382+ all of the automated tests used to validate the Intel IoTG device.
383 include:
384 nested_part:
385 watchdog-intliotg-automated
386@@ -123,7 +120,6 @@ nested_part:
387 usb-dwc3-automated
388 ishtp-automated
389 va-api-automated
390- tsn-automated
391 thermal-automated
392 intel-mei-automated
393 com.canonical.certification::client-cert-desktop-20-04-automated
394@@ -132,26 +128,24 @@ exclude:
395
396 id: intliotg-desktop-22-04-stress
397 unit: test plan
398-_name: intliotg - Stress tests for Ubuntu Desktop 22.04 image
399+_name: Intel IoTG - Stress tests for Ubuntu Desktop 22.04 image
400 _description:
401- Ubuntu Desktop QA test plan that includes all stress tests required for intliotg devices
402+ Ubuntu Desktop QA test plan that includes all stress tests required for Intel IoTG devices
403 include:
404 nested_part:
405 com.canonical.certification::stress-iperf3-automated # keep if ethernet is supported
406 com.canonical.certification::client-cert-iot-server-22-04-stress
407- rt-performance-tests-stress
408 exclude:
409 com.canonical.certification::stress-tests/hibernate.*
410
411 id: intliotg-desktop-20-04-stress
412 unit: test plan
413-_name: intliotg - Stress tests for Ubuntu Desktop 20.04 image
414+_name: Intel IoTG - Stress tests for Ubuntu Desktop 20.04 image
415 _description:
416- Ubuntu Desktop QA test plan that includes all stress tests required for intliotg devices
417+ Ubuntu Desktop QA test plan that includes all stress tests required for Intel IoTG devices
418 include:
419 nested_part:
420 com.canonical.certification::stress-iperf3-automated # keep if ethernet is supported
421 com.canonical.certification::client-cert-iot-server-20-04-stress
422 exclude:
423 com.canonical.certification::stress-tests/hibernate.*
424-
425diff --git a/units/test-plan-server-rt.pxu b/units/test-plan-server-rt.pxu
426new file mode 100644
427index 0000000..bfeed6f
428--- /dev/null
429+++ b/units/test-plan-server-rt.pxu
430@@ -0,0 +1,57 @@
431+# Copyright 2023 Canonical Ltd.
432+# All rights reserved.
433+#
434+# Test plans and (optionally) jobs unique to the realtime Ubuntu Server Intel IoTG devices.
435+#
436+
437+id: intliotg-server-22-04-rt
438+unit: test plan
439+_name: Intel IoTG - Full manual + automated tests for realtime Ubuntu Server 22.04
440+_description:
441+ Combined manual and automated test plans for realtime Ubuntu Server Intel IoTG devices.
442+include:
443+nested_part:
444+ intliotg-server-22-04-manual-rt
445+ intliotg-server-22-04-automated-rt
446+
447+id: intliotg-server-22-04-manual-rt
448+unit: test plan
449+_name: Intel IoTG - Manual only QA tests for realtime Ubuntu Server 22.04
450+_description:
451+ Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test
452+ plan contains all of the tests that require manual control of device
453+ hardware or some other user input to complete.
454+estimated_duration: 3600
455+include:
456+nested_part:
457+ intliotg-server-22-04-manual
458+ tsn-manual
459+exclude:
460+ .*::.*suspend.*
461+
462+id: intliotg-server-22-04-automated-rt
463+unit: test plan
464+_name: Intel IoTG - Automated only QA tests for realtime Ubuntu Server 22.04
465+_description:
466+ Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test
467+ plan contains all of the automated tests used to validate the realtime
468+ Intel IoTG device.
469+include:
470+nested_part:
471+ intliotg-server-22-04-automated
472+ tsn-automated
473+exclude:
474+ .*::.*suspend.*
475+ power-management-cpu-cstate/.*
476+
477+id: intliotg-server-22-04-stress-rt
478+unit: test plan
479+_name: Intel IoTG - Stress tests for realtime Ubuntu Server 22.04
480+_description:
481+ Ubuntu Core QA test plan that includes all stress tests required for
482+ realtime Intel IoTG devices.include:
483+nested_part:
484+ intliotg-server-22-04-stress
485+ rt-performance-tests-stress
486+exclude:
487+ .*::.*suspend.*
488diff --git a/units/test-plan-server.pxu b/units/test-plan-server.pxu
489index 8d86eb2..1871951 100644
490--- a/units/test-plan-server.pxu
491+++ b/units/test-plan-server.pxu
492@@ -1,14 +1,14 @@
493 # Copyright 2022 Canonical Ltd.
494 # All rights reserved.
495 #
496-# Test plans and (optionally) jobs unique to the Ubuntu Server intliotg devices.
497+# Test plans and (optionally) jobs unique to the Ubuntu Server Intel IoTG devices.
498 #
499
500 id: intliotg-server-22-04
501 unit: test plan
502-_name: intliotg - Full manual + automated tests for Ubuntu Server 22.04
503+_name: Intel IoTG - Full manual + automated tests for Ubuntu Server 22.04
504 _description:
505- Combined manual and automated test plans for Ubuntu Server intliotg devices.
506+ Combined manual and automated test plans for Ubuntu Server Intel IoTG devices.
507 include:
508 nested_part:
509 intliotg-server-22-04-manual
510@@ -16,9 +16,9 @@ nested_part:
511
512 id: intliotg-server-20-04
513 unit: test plan
514-_name: intliotg - Full manual + automated tests for Ubuntu Server 20.04
515+_name: Intel IoTG - Full manual + automated tests for Ubuntu Server 20.04
516 _description:
517- Combined manual and automated test plans for Ubuntu Server intliotg devices.
518+ Combined manual and automated test plans for Ubuntu Server Intel IoTG devices.
519 include:
520 nested_part:
521 intliotg-server-20-04-manual
522@@ -26,9 +26,9 @@ nested_part:
523
524 id: intliotg-server-22-04-manual
525 unit: test plan
526-_name: intliotg - Manual only QA tests for Ubuntu Server 22.04
527+_name: Intel IoTG - Manual only QA tests for Ubuntu Server 22.04
528 _description:
529- Ubuntu Server QA test plan for the intliotg hardware. This test plan contains
530+ Ubuntu Server QA test plan for the Intel IoTG hardware. This test plan contains
531 all of the tests that require manual control of device hardware
532 or some other user input to complete.
533 estimated_duration: 3600
534@@ -39,7 +39,6 @@ nested_part:
535 com.canonical.certification::edac-manual
536 usb-dwc3-manual
537 ishtp-manual
538- tsn-manual
539 thermal-manual
540 intel-mei-manual
541 com.canonical.qa.ceoem::ce-oem-manual
542@@ -52,9 +51,9 @@ exclude:
543
544 id: intliotg-server-20-04-manual
545 unit: test plan
546-_name: intliotg - Manual only QA tests for Ubuntu Server 20.04
547+_name: Intel IoTG - Manual only QA tests for Ubuntu Server 20.04
548 _description:
549- Ubuntu Server QA test plan for the intliotg hardware. This test plan contains
550+ Ubuntu Server QA test plan for the Intel IoTG hardware. This test plan contains
551 all of the tests that require manual control of device hardware
552 or some other user input to complete.
553 estimated_duration: 3600
554@@ -65,7 +64,6 @@ nested_part:
555 com.canonical.certification::edac-manual
556 usb-dwc3-manual
557 ishtp-manual
558- tsn-manual
559 thermal-manual
560 intel-mei-manual
561 com.canonical.certification::client-cert-iot-server-20-04-manual
562@@ -75,10 +73,10 @@ exclude:
563
564 id: intliotg-server-22-04-automated
565 unit: test plan
566-_name: intliotg - Automated only QA tests for Ubuntu Server 22.04
567+_name: Intel IoTG - Automated only QA tests for Ubuntu Server 22.04
568 _description:
569- Ubuntu Server QA test plan for the intliotg hardware. This test plan contains
570- all of the automated tests used to validate the intliotg device.
571+ Ubuntu Server QA test plan for the Intel IoTG hardware. This test plan contains
572+ all of the automated tests used to validate the Intel IoTG device.
573 include:
574 nested_part:
575 watchdog-intliotg-automated
576@@ -87,7 +85,6 @@ nested_part:
577 com.canonical.certification::edac-automated
578 usb-dwc3-automated
579 ishtp-automated
580- tsn-automated
581 thermal-automated
582 intel-mei-automated
583 com.canonical.qa.ceoem::ce-oem-automated
584@@ -99,10 +96,10 @@ exclude:
585
586 id: intliotg-server-20-04-automated
587 unit: test plan
588-_name: intliotg - Automated only QA tests for Ubuntu Server 20.04
589+_name: Intel IoTG - Automated only QA tests for Ubuntu Server 20.04
590 _description:
591- Ubuntu Server QA test plan for the intliotg hardware. This test plan contains
592- all of the automated tests used to validate the intliotg device.
593+ Ubuntu Server QA test plan for the Intel IoTG hardware. This test plan contains
594+ all of the automated tests used to validate the Intel IoTG device.
595 include:
596 nested_part:
597 watchdog-intliotg-automated
598@@ -111,7 +108,6 @@ nested_part:
599 com.canonical.certification::edac-automated
600 usb-dwc3-automated
601 ishtp-automated
602- tsn-automated
603 thermal-automated
604 intel-mei-automated
605 com.canonical.certification::client-cert-iot-server-20-04-automated
606@@ -121,26 +117,24 @@ exclude:
607
608 id: intliotg-server-22-04-stress
609 unit: test plan
610-_name: intliotg - Stress tests for Ubuntu Server 22.04
611+_name: Intel IoTG - Stress tests for Ubuntu Server 22.04
612 _description:
613- Ubuntu Server QA test plan that includes all stress tests required for intliotg devices
614+ Ubuntu Server QA test plan that includes all stress tests required for Intel IoTG devices
615 include:
616 nested_part:
617 com.canonical.certification::stress-iperf3-automated # keep if ethernet is supported
618 com.canonical.certification::client-cert-iot-server-22-04-stress
619- rt-performance-tests-stress
620 exclude:
621 com.canonical.certification::stress-tests/hibernate.*
622
623 id: intliotg-server-20-04-stress
624 unit: test plan
625-_name: intliotg - Stress tests for Ubuntu Server 20.04
626+_name: Intel IoTG - Stress tests for Ubuntu Server 20.04
627 _description:
628- Ubuntu Server QA test plan that includes all stress tests required for intliotg devices
629+ Ubuntu Server QA test plan that includes all stress tests required for Intel IoTG devices
630 include:
631 nested_part:
632 com.canonical.certification::stress-iperf3-automated # keep if ethernet is supported
633 com.canonical.certification::client-cert-iot-server-20-04-stress
634 exclude:
635 com.canonical.certification::stress-tests/hibernate.*
636-

Subscribers

People subscribed via source and target branches