Merge ~liaou3/checkbox-iiotg/+git/checkbox-provider-intliotg:refactor_testplan_with_nested into ~checkbox-dev/checkbox-iiotg/+git/checkbox-provider-intliotg:master
- Git
- lp:~liaou3/checkbox-iiotg/+git/checkbox-provider-intliotg
- refactor_testplan_with_nested
- Merge into master
Status: | Merged |
---|---|
Approved by: | Vincent Liao |
Approved revision: | d83e8d2d4f454c1de577d537e167b5ce44acd6e3 |
Merged at revision: | 991812880ae9f5ec8fc4f55d29b54e5e985a5c0d |
Proposed branch: | ~liaou3/checkbox-iiotg/+git/checkbox-provider-intliotg:refactor_testplan_with_nested |
Merge into: | ~checkbox-dev/checkbox-iiotg/+git/checkbox-provider-intliotg:master |
Diff against target: |
636 lines (+230/-74) 6 files modified
units/test-plan-core-rt.pxu (+58/-0) units/test-plan-core.pxu (+19/-24) units/test-plan-desktop-rt.pxu (+58/-0) units/test-plan-desktop.pxu (+19/-25) units/test-plan-server-rt.pxu (+57/-0) units/test-plan-server.pxu (+19/-25) |
Related bugs: |
Reviewer | Review Type | Date Requested | Status |
---|---|---|---|
Rick Wu | Approve | ||
Vic Liu | Approve | ||
StanleyHuang | Pending | ||
PeiYao Chang | Pending | ||
Doug Jacobs | Pending | ||
Patrick Liu | Pending | ||
Review via email: mp+444230@code.launchpad.net |
Commit message
Modify: Seperate realtime testplan from generic testplan.
Description of the change
Description
-----------
This MR is to seperate realtime testplan from generic test plan.
Changed
-------
1. Remove realtime related jobs or testplans from generic testplan.
- tsn
- rt-performance-
2. Create realtime testplan, basically it's the same as generic test plan, but
- Add tsn and rt-performance-
- Remove suspend related tests
Diff
----
1. For core testplan: https:/
2. For desktop testplan: https:/
3. For server testplan: https:/
Linked MR
---------
https:/
https:/
https:/
https:/
Vincent Liao (liaou3) wrote : | # |
@Rick
Please see my reply. Thanks!
Vic Liu (zongminl) wrote : | # |
- Please update the copyright year to 2023 on the files you touched
- +1 to what Rick mentions in the review, let's use the full name of Intel IoTG in the description (maybe in a separated commit to do this change to all the test plans)
- checkbox-iiotg is missing 'rt-tests' stage-package definition in order for cyclictest to run, please raise another MR for cyclictest to be able to start running in core images (ref: https:/
Please also check my incline comments for more details to be fixed
Vincent Liao (liaou3) wrote : | # |
@Vic
Please see my in-line reply for the question.
Vic Liu (zongminl) wrote : | # |
- Please update the copyright year to 2023
- Please use "Intel IoTG" in the name/descriptio
- Please remove all the series 20 (desktop 20.04, server 20.04 and ubuntu core 20) RT test plans, we don't need to support RT on focal
- Let's use regex power-managemen
Vincent Liao (liaou3) wrote (last edit ): | # |
@Vic @Rick
What I fixed
------------
1. change name from "intliotg" to "intel iotg" for being mre human readable in the field of name and description in testplan.
2. Update copyright from 2022 to 2023.
3. Remove realtime test on 20 due to it only support on 22 now.
4. Exclude all jobs under "power-
Later works
------------
1. checkbox-iiotg is missing 'rt-tests' stage-package definition in order for cyclictest to run, I would raise another MR for cyclictest to be able to start running in core images (ref: https:/
2. I will squash all commit into one before merge into main branch.
Vic Liu (zongminl) wrote : | # |
Some more minor changes need to be made. you can consider this MR approved once you've done the chages:
- Use "Intel IoTG" instead of "intel iotg"
- Correct the indentation in intliotg-
Vincent Liao (liaou3) wrote (last edit ): | # |
I have squashed all commits into one, ready to merge.
Preview Diff
1 | diff --git a/units/test-plan-core-rt.pxu b/units/test-plan-core-rt.pxu |
2 | new file mode 100644 |
3 | index 0000000..c113fdc |
4 | --- /dev/null |
5 | +++ b/units/test-plan-core-rt.pxu |
6 | @@ -0,0 +1,58 @@ |
7 | +# Copyright 2023 Canonical Ltd. |
8 | +# All rights reserved. |
9 | +# |
10 | +# Test plans and (optionally) jobs unique to the realtime Ubuntu Core Intel IoTG devices. |
11 | +# |
12 | + |
13 | +id: intliotg-ubuntucore-22-rt |
14 | +unit: test plan |
15 | +_name: Intel IoTG - Full manual + automated tests for realtime Ubuntu Core 22 |
16 | +_description: |
17 | + Combined manual and automated test plans for realtime Ubuntu Core Intel IoTG devices. |
18 | +include: |
19 | +nested_part: |
20 | + intliotg-ubuntucore-22-manual-rt |
21 | + intliotg-ubuntucore-22-automated-rt |
22 | + |
23 | +id: intliotg-ubuntucore-22-manual-rt |
24 | +unit: test plan |
25 | +_name: Intel IoTG - Manual only QA tests for realtime Ubuntu Core 22 |
26 | +_description: |
27 | + Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test |
28 | + plan contains all of the tests that require manual control of device |
29 | + hardware or some other user input to complete. |
30 | +estimated_duration: 3600 |
31 | +include: |
32 | +nested_part: |
33 | + intliotg-ubuntucore-22-manual |
34 | + tsn-manual |
35 | +exclude: |
36 | + .*::.*suspend.* |
37 | + |
38 | +id: intliotg-ubuntucore-22-automated-rt |
39 | +unit: test plan |
40 | +_name: Intel IoTG - Automated only QA tests for realtime Ubuntu Core 22 |
41 | +_description: |
42 | + Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test |
43 | + plan contains all of the automated tests used to validate the realtime |
44 | + Intel IoTG device. |
45 | +include: |
46 | +nested_part: |
47 | + intliotg-ubuntucore-22-automated |
48 | + tsn-automated |
49 | +exclude: |
50 | + .*::.*suspend.* |
51 | + power-management-cpu-cstate/.* |
52 | + |
53 | +id: intliotg-ubuntucore-22-stress-rt |
54 | +unit: test plan |
55 | +_name: Intel IoTG - Stress tests for realtime Ubuntu Core 22 |
56 | +_description: |
57 | + Ubuntu Core QA test plan that includes all stress tests required for |
58 | + realtime Intel IoTG devices. |
59 | +include: |
60 | +nested_part: |
61 | + intliotg-ubuntucore-22-stress |
62 | + rt-performance-tests-stress |
63 | +exclude: |
64 | + .*::.*suspend.* |
65 | diff --git a/units/test-plan-core.pxu b/units/test-plan-core.pxu |
66 | index 0fab369..dc7a11e 100644 |
67 | --- a/units/test-plan-core.pxu |
68 | +++ b/units/test-plan-core.pxu |
69 | @@ -1,14 +1,14 @@ |
70 | # Copyright 2022 Canonical Ltd. |
71 | # All rights reserved. |
72 | # |
73 | -# Test plans and (optionally) jobs unique to the Ubuntu Core intliotg devices. |
74 | +# Test plans and (optionally) jobs unique to the Ubuntu Core Intel IoTG devices. |
75 | # |
76 | |
77 | id: intliotg-ubuntucore-22 |
78 | unit: test plan |
79 | -_name: intliotg - Full manual + automated tests for Ubuntu Core 22 |
80 | +_name: Intel IoTG - Full manual + automated tests for Ubuntu Core 22 |
81 | _description: |
82 | - Combined manual and automated test plans for Ubuntu Core intliotg devices. |
83 | + Combined manual and automated test plans for Ubuntu Core Intel IoTG devices. |
84 | include: |
85 | nested_part: |
86 | intliotg-ubuntucore-22-manual |
87 | @@ -16,9 +16,9 @@ nested_part: |
88 | |
89 | id: intliotg-ubuntucore-20 |
90 | unit: test plan |
91 | -_name: intliotg - Full manual + automated tests for Ubuntu Core 20 |
92 | +_name: Intel IoTG - Full manual + automated tests for Ubuntu Core 20 |
93 | _description: |
94 | - Combined manual and automated test plans for Ubuntu Core intliotg devices. |
95 | + Combined manual and automated test plans for Ubuntu Core Intel IoTG devices. |
96 | include: |
97 | nested_part: |
98 | intliotg-ubuntucore-20-manual |
99 | @@ -26,9 +26,9 @@ nested_part: |
100 | |
101 | id: intliotg-ubuntucore-22-manual |
102 | unit: test plan |
103 | -_name: intliotg - Manual only QA tests for Ubuntu Core 22 |
104 | +_name: Intel IoTG - Manual only QA tests for Ubuntu Core 22 |
105 | _description: |
106 | - Ubuntu Core QA test plan for the intliotg hardware. This test plan contains |
107 | + Ubuntu Core QA test plan for the Intel IoTG hardware. This test plan contains |
108 | all of the tests that require manual control of device hardware |
109 | or some other user input to complete. |
110 | estimated_duration: 3600 |
111 | @@ -42,7 +42,6 @@ nested_part: |
112 | com.canonical.certification::edac-manual |
113 | usb-dwc3-manual |
114 | ishtp-manual |
115 | - tsn-manual |
116 | thermal-manual |
117 | intel-mei-manual |
118 | com.canonical.qa.ceoem::ce-oem-manual |
119 | @@ -54,9 +53,9 @@ exclude: |
120 | |
121 | id: intliotg-ubuntucore-20-manual |
122 | unit: test plan |
123 | -_name: intliotg - Manual only QA tests for Ubuntu Core 20 |
124 | +_name: Intel IoTG - Manual only QA tests for Ubuntu Core 20 |
125 | _description: |
126 | - Ubuntu Core QA test plan for the intliotg hardware. This test plan contains |
127 | + Ubuntu Core QA test plan for the Intel IoTG hardware. This test plan contains |
128 | all of the tests that require manual control of device hardware |
129 | or some other user input to complete. |
130 | estimated_duration: 3600 |
131 | @@ -70,7 +69,6 @@ nested_part: |
132 | com.canonical.certification::edac-manual |
133 | usb-dwc3-manual |
134 | ishtp-manual |
135 | - tsn-manual |
136 | thermal-manual |
137 | intel-mei-manual |
138 | com.canonical.certification::client-cert-iot-ubuntucore-20-manual |
139 | @@ -80,10 +78,10 @@ exclude: |
140 | |
141 | id: intliotg-ubuntucore-22-automated |
142 | unit: test plan |
143 | -_name: intliotg - Automated only QA tests for Ubuntu Core 22 |
144 | +_name: Intel IoTG - Automated only QA tests for Ubuntu Core 22 |
145 | _description: |
146 | - Ubuntu Core QA test plan for the intliotg hardware. This test plan contains |
147 | - all of the automated tests used to validate the intliotg device. |
148 | + Ubuntu Core QA test plan for the Intel IoTG hardware. This test plan contains |
149 | + all of the automated tests used to validate the Intel IoTG device. |
150 | include: |
151 | com.canonical.certification::image/model-grade |
152 | com.canonical.certification::miscellanea/secure_boot_mode_.* # keep if secure boot is enabled |
153 | @@ -96,7 +94,6 @@ nested_part: |
154 | com.canonical.certification::edac-automated |
155 | usb-dwc3-automated |
156 | ishtp-automated |
157 | - tsn-automated |
158 | thermal-automated |
159 | intel-mei-automated |
160 | com.canonical.qa.ceoem::ce-oem-automated |
161 | @@ -109,10 +106,10 @@ exclude: |
162 | |
163 | id: intliotg-ubuntucore-20-automated |
164 | unit: test plan |
165 | -_name: intliotg - Automated only QA tests for Ubuntu Core 20 |
166 | +_name: Intel IoTG - Automated only QA tests for Ubuntu Core 20 |
167 | _description: |
168 | - Ubuntu Core QA test plan for the intliotg hardware. This test plan contains |
169 | - all of the automated tests used to validate the intliotg device. |
170 | + Ubuntu Core QA test plan for the Intel IoTG hardware. This test plan contains |
171 | + all of the automated tests used to validate the Intel IoTG device. |
172 | include: |
173 | com.canonical.certification::image/model-grade |
174 | com.canonical.certification::miscellanea/secure_boot_mode_.* # keep if secure boot is enabled |
175 | @@ -125,7 +122,6 @@ nested_part: |
176 | com.canonical.certification::edac-automated |
177 | usb-dwc3-automated |
178 | ishtp-automated |
179 | - tsn-automated |
180 | thermal-automated |
181 | intel-mei-automated |
182 | com.canonical.certification::client-cert-iot-ubuntucore-20-automated |
183 | @@ -136,9 +132,9 @@ exclude: |
184 | |
185 | id: intliotg-ubuntucore-22-stress |
186 | unit: test plan |
187 | -_name: intliotg - Stress tests for Ubuntu Core 22 |
188 | +_name: Intel IoTG - Stress tests for Ubuntu Core 22 |
189 | _description: |
190 | - Ubuntu Core QA test plan that includes all stress tests required for intliotg devices |
191 | + Ubuntu Core QA test plan that includes all stress tests required for Intel IoTG devices |
192 | include: |
193 | nested_part: |
194 | device-connections-tp |
195 | @@ -149,9 +145,9 @@ exclude: |
196 | |
197 | id: intliotg-ubuntucore-20-stress |
198 | unit: test plan |
199 | -_name: intliotg - Stress tests for Ubuntu Core 20 |
200 | +_name: Intel IoTG - Stress tests for Ubuntu Core 20 |
201 | _description: |
202 | - Ubuntu Core QA test plan that includes all stress tests required for intliotg devices |
203 | + Ubuntu Core QA test plan that includes all stress tests required for Intel IoTG devices |
204 | include: |
205 | nested_part: |
206 | device-connections-tp |
207 | @@ -159,4 +155,3 @@ nested_part: |
208 | com.canonical.certification::client-cert-iot-ubuntucore-20-stress |
209 | exclude: |
210 | com.canonical.certification::stress-tests/hibernate.* |
211 | - |
212 | diff --git a/units/test-plan-desktop-rt.pxu b/units/test-plan-desktop-rt.pxu |
213 | new file mode 100644 |
214 | index 0000000..efb6515 |
215 | --- /dev/null |
216 | +++ b/units/test-plan-desktop-rt.pxu |
217 | @@ -0,0 +1,58 @@ |
218 | +# Copyright 2023 Canonical Ltd. |
219 | +# All rights reserved. |
220 | +# |
221 | +# Test plans and (optionally) jobs unique to the realtime Ubuntu Desktop Intel IoTG devices. |
222 | +# |
223 | + |
224 | +id: intliotg-desktop-22-04-rt |
225 | +unit: test plan |
226 | +_name: Intel IoTG - Full manual + automated tests for realtime Ubuntu Desktop 22.04 |
227 | +_description: |
228 | + Combined manual and automated test plans for realtime Ubuntu Desktop Intel IoTG devices. |
229 | +include: |
230 | +nested_part: |
231 | + intliotg-desktop-22-04-manual-rt |
232 | + intliotg-desktop-22-04-automated-rt |
233 | + |
234 | +id: intliotg-desktop-22-04-manual-rt |
235 | +unit: test plan |
236 | +_name: Intel IoTG - Manual only QA tests for realtime Ubuntu Desktop 22.04 |
237 | +_description: |
238 | + Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test |
239 | + plan contains all of the tests that require manual control of device |
240 | + hardware or some other user input to complete. |
241 | +estimated_duration: 3600 |
242 | +include: |
243 | +nested_part: |
244 | + intliotg-desktop-22-04-manual |
245 | + tsn-manual |
246 | +exclude: |
247 | + .*::.*suspend.* |
248 | + |
249 | +id: intliotg-desktop-22-04-automated-rt |
250 | +unit: test plan |
251 | +_name: Intel IoTG - Automated only QA tests for realtime Ubuntu Desktop 22.04 |
252 | +_description: |
253 | + Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test |
254 | + plan contains all of the automated tests used to validate the realtime |
255 | + Intel IoTG device. |
256 | +include: |
257 | +nested_part: |
258 | + intliotg-desktop-22-04-automated |
259 | + tsn-automated |
260 | +exclude: |
261 | + .*::.*suspend.* |
262 | + power-management-cpu-cstate/.* |
263 | + |
264 | +id: intliotg-desktop-22-04-stress-rt |
265 | +unit: test plan |
266 | +_name: Intel IoTG - Stress tests for realtime Ubuntu Desktop 22.04 image |
267 | +_description: |
268 | + Ubuntu Core QA test plan that includes all stress tests required for |
269 | + realtime Intel IoTG devices. |
270 | +include: |
271 | +nested_part: |
272 | + intliotg-desktop-22-04-stress |
273 | + rt-performance-tests-stress |
274 | +exclude: |
275 | + .*::.*suspend.* |
276 | diff --git a/units/test-plan-desktop.pxu b/units/test-plan-desktop.pxu |
277 | index 1220382..4938653 100644 |
278 | --- a/units/test-plan-desktop.pxu |
279 | +++ b/units/test-plan-desktop.pxu |
280 | @@ -1,14 +1,14 @@ |
281 | # Copyright 2022 Canonical Ltd. |
282 | # All rights reserved. |
283 | # |
284 | -# Test plans and (optionally) jobs unique to the Ubuntu Desktop intliotg devices. |
285 | +# Test plans and (optionally) jobs unique to the Ubuntu Desktop Intel IoTG devices. |
286 | # |
287 | |
288 | id: intliotg-desktop-22-04 |
289 | unit: test plan |
290 | -_name: intliotg - Full manual + automated tests for Ubuntu Desktop 22.04 |
291 | +_name: Intel IoTG - Full manual + automated tests for Ubuntu Desktop 22.04 |
292 | _description: |
293 | - Combined manual and automated test plans for Ubuntu Desktop intliotg devices. |
294 | + Combined manual and automated test plans for Ubuntu Desktop Intel IoTG devices. |
295 | include: |
296 | nested_part: |
297 | intliotg-desktop-22-04-manual |
298 | @@ -16,9 +16,9 @@ nested_part: |
299 | |
300 | id: intliotg-desktop-20-04 |
301 | unit: test plan |
302 | -_name: intliotg - Full manual + automated tests for Ubuntu Desktop 20.04 |
303 | +_name: Intel IoTG - Full manual + automated tests for Ubuntu Desktop 20.04 |
304 | _description: |
305 | - Combined manual and automated test plans for Ubuntu Desktop intliotg devices. |
306 | + Combined manual and automated test plans for Ubuntu Desktop Intel IoTG devices. |
307 | include: |
308 | nested_part: |
309 | intliotg-desktop-20-04-manual |
310 | @@ -26,9 +26,9 @@ nested_part: |
311 | |
312 | id: intliotg-desktop-22-04-manual |
313 | unit: test plan |
314 | -_name: intliotg - Manual only QA tests for Ubuntu Desktop 22.04 |
315 | +_name: Intel IoTG - Manual only QA tests for Ubuntu Desktop 22.04 |
316 | _description: |
317 | - Ubuntu Desktop QA test plan for the intliotg hardware. This test plan contains |
318 | + Ubuntu Desktop QA test plan for the Intel IoTG hardware. This test plan contains |
319 | all of the tests that require manual control of device hardware |
320 | or some other user input to complete. |
321 | estimated_duration: 3600 |
322 | @@ -40,7 +40,6 @@ nested_part: |
323 | usb-dwc3-manual |
324 | ishtp-manual |
325 | va-api-manual |
326 | - tsn-manual |
327 | thermal-manual |
328 | intel-mei-manual |
329 | com.canonical.qa.ceoem::ce-oem-manual |
330 | @@ -57,9 +56,9 @@ exclude: |
331 | |
332 | id: intliotg-desktop-20-04-manual |
333 | unit: test plan |
334 | -_name: intliotg - Manual only QA tests for Ubuntu Desktop 20.04 |
335 | +_name: Intel IoTG - Manual only QA tests for Ubuntu Desktop 20.04 |
336 | _description: |
337 | - Ubuntu Desktop QA test plan for the intliotg hardware. This test plan contains |
338 | + Ubuntu Desktop QA test plan for the Intel IoTG hardware. This test plan contains |
339 | all of the tests that require manual control of device hardware |
340 | or some other user input to complete. |
341 | estimated_duration: 3600 |
342 | @@ -71,7 +70,6 @@ nested_part: |
343 | usb-dwc3-manual |
344 | ishtp-manual |
345 | va-api-manual |
346 | - tsn-manual |
347 | thermal-manual |
348 | intel-mei-manual |
349 | com.canonical.certification::client-cert-desktop-20-04-manual |
350 | @@ -86,10 +84,10 @@ exclude: |
351 | |
352 | id: intliotg-desktop-22-04-automated |
353 | unit: test plan |
354 | -_name: intliotg - Automated only QA tests for Ubuntu Desktop 22.04 |
355 | +_name: Intel IoTG - Automated only QA tests for Ubuntu Desktop 22.04 |
356 | _description: |
357 | - Ubuntu Desktop QA test plan for the intliotg hardware. This test plan contains |
358 | - all of the automated tests used to validate the intliotg device. |
359 | + Ubuntu Desktop QA test plan for the Intel IoTG hardware. This test plan contains |
360 | + all of the automated tests used to validate the Intel IoTG device. |
361 | include: |
362 | nested_part: |
363 | watchdog-intliotg-automated |
364 | @@ -99,7 +97,6 @@ nested_part: |
365 | usb-dwc3-automated |
366 | ishtp-automated |
367 | va-api-automated |
368 | - tsn-automated |
369 | thermal-automated |
370 | intel-mei-automated |
371 | com.canonical.qa.ceoem::ce-oem-automated |
372 | @@ -110,10 +107,10 @@ exclude: |
373 | |
374 | id: intliotg-desktop-20-04-automated |
375 | unit: test plan |
376 | -_name: intliotg - Automated only QA tests for Ubuntu Desktop 20.04 |
377 | +_name: Intel IoTG - Automated only QA tests for Ubuntu Desktop 20.04 |
378 | _description: |
379 | - Ubuntu Desktop QA test plan for the intliotg hardware. This test plan contains |
380 | - all of the automated tests used to validate the intliotg device. |
381 | + Ubuntu Desktop QA test plan for the Intel IoTG hardware. This test plan contains |
382 | + all of the automated tests used to validate the Intel IoTG device. |
383 | include: |
384 | nested_part: |
385 | watchdog-intliotg-automated |
386 | @@ -123,7 +120,6 @@ nested_part: |
387 | usb-dwc3-automated |
388 | ishtp-automated |
389 | va-api-automated |
390 | - tsn-automated |
391 | thermal-automated |
392 | intel-mei-automated |
393 | com.canonical.certification::client-cert-desktop-20-04-automated |
394 | @@ -132,26 +128,24 @@ exclude: |
395 | |
396 | id: intliotg-desktop-22-04-stress |
397 | unit: test plan |
398 | -_name: intliotg - Stress tests for Ubuntu Desktop 22.04 image |
399 | +_name: Intel IoTG - Stress tests for Ubuntu Desktop 22.04 image |
400 | _description: |
401 | - Ubuntu Desktop QA test plan that includes all stress tests required for intliotg devices |
402 | + Ubuntu Desktop QA test plan that includes all stress tests required for Intel IoTG devices |
403 | include: |
404 | nested_part: |
405 | com.canonical.certification::stress-iperf3-automated # keep if ethernet is supported |
406 | com.canonical.certification::client-cert-iot-server-22-04-stress |
407 | - rt-performance-tests-stress |
408 | exclude: |
409 | com.canonical.certification::stress-tests/hibernate.* |
410 | |
411 | id: intliotg-desktop-20-04-stress |
412 | unit: test plan |
413 | -_name: intliotg - Stress tests for Ubuntu Desktop 20.04 image |
414 | +_name: Intel IoTG - Stress tests for Ubuntu Desktop 20.04 image |
415 | _description: |
416 | - Ubuntu Desktop QA test plan that includes all stress tests required for intliotg devices |
417 | + Ubuntu Desktop QA test plan that includes all stress tests required for Intel IoTG devices |
418 | include: |
419 | nested_part: |
420 | com.canonical.certification::stress-iperf3-automated # keep if ethernet is supported |
421 | com.canonical.certification::client-cert-iot-server-20-04-stress |
422 | exclude: |
423 | com.canonical.certification::stress-tests/hibernate.* |
424 | - |
425 | diff --git a/units/test-plan-server-rt.pxu b/units/test-plan-server-rt.pxu |
426 | new file mode 100644 |
427 | index 0000000..bfeed6f |
428 | --- /dev/null |
429 | +++ b/units/test-plan-server-rt.pxu |
430 | @@ -0,0 +1,57 @@ |
431 | +# Copyright 2023 Canonical Ltd. |
432 | +# All rights reserved. |
433 | +# |
434 | +# Test plans and (optionally) jobs unique to the realtime Ubuntu Server Intel IoTG devices. |
435 | +# |
436 | + |
437 | +id: intliotg-server-22-04-rt |
438 | +unit: test plan |
439 | +_name: Intel IoTG - Full manual + automated tests for realtime Ubuntu Server 22.04 |
440 | +_description: |
441 | + Combined manual and automated test plans for realtime Ubuntu Server Intel IoTG devices. |
442 | +include: |
443 | +nested_part: |
444 | + intliotg-server-22-04-manual-rt |
445 | + intliotg-server-22-04-automated-rt |
446 | + |
447 | +id: intliotg-server-22-04-manual-rt |
448 | +unit: test plan |
449 | +_name: Intel IoTG - Manual only QA tests for realtime Ubuntu Server 22.04 |
450 | +_description: |
451 | + Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test |
452 | + plan contains all of the tests that require manual control of device |
453 | + hardware or some other user input to complete. |
454 | +estimated_duration: 3600 |
455 | +include: |
456 | +nested_part: |
457 | + intliotg-server-22-04-manual |
458 | + tsn-manual |
459 | +exclude: |
460 | + .*::.*suspend.* |
461 | + |
462 | +id: intliotg-server-22-04-automated-rt |
463 | +unit: test plan |
464 | +_name: Intel IoTG - Automated only QA tests for realtime Ubuntu Server 22.04 |
465 | +_description: |
466 | + Ubuntu Core QA test plan for the realtime Intel IoTG hardware. This test |
467 | + plan contains all of the automated tests used to validate the realtime |
468 | + Intel IoTG device. |
469 | +include: |
470 | +nested_part: |
471 | + intliotg-server-22-04-automated |
472 | + tsn-automated |
473 | +exclude: |
474 | + .*::.*suspend.* |
475 | + power-management-cpu-cstate/.* |
476 | + |
477 | +id: intliotg-server-22-04-stress-rt |
478 | +unit: test plan |
479 | +_name: Intel IoTG - Stress tests for realtime Ubuntu Server 22.04 |
480 | +_description: |
481 | + Ubuntu Core QA test plan that includes all stress tests required for |
482 | + realtime Intel IoTG devices.include: |
483 | +nested_part: |
484 | + intliotg-server-22-04-stress |
485 | + rt-performance-tests-stress |
486 | +exclude: |
487 | + .*::.*suspend.* |
488 | diff --git a/units/test-plan-server.pxu b/units/test-plan-server.pxu |
489 | index 8d86eb2..1871951 100644 |
490 | --- a/units/test-plan-server.pxu |
491 | +++ b/units/test-plan-server.pxu |
492 | @@ -1,14 +1,14 @@ |
493 | # Copyright 2022 Canonical Ltd. |
494 | # All rights reserved. |
495 | # |
496 | -# Test plans and (optionally) jobs unique to the Ubuntu Server intliotg devices. |
497 | +# Test plans and (optionally) jobs unique to the Ubuntu Server Intel IoTG devices. |
498 | # |
499 | |
500 | id: intliotg-server-22-04 |
501 | unit: test plan |
502 | -_name: intliotg - Full manual + automated tests for Ubuntu Server 22.04 |
503 | +_name: Intel IoTG - Full manual + automated tests for Ubuntu Server 22.04 |
504 | _description: |
505 | - Combined manual and automated test plans for Ubuntu Server intliotg devices. |
506 | + Combined manual and automated test plans for Ubuntu Server Intel IoTG devices. |
507 | include: |
508 | nested_part: |
509 | intliotg-server-22-04-manual |
510 | @@ -16,9 +16,9 @@ nested_part: |
511 | |
512 | id: intliotg-server-20-04 |
513 | unit: test plan |
514 | -_name: intliotg - Full manual + automated tests for Ubuntu Server 20.04 |
515 | +_name: Intel IoTG - Full manual + automated tests for Ubuntu Server 20.04 |
516 | _description: |
517 | - Combined manual and automated test plans for Ubuntu Server intliotg devices. |
518 | + Combined manual and automated test plans for Ubuntu Server Intel IoTG devices. |
519 | include: |
520 | nested_part: |
521 | intliotg-server-20-04-manual |
522 | @@ -26,9 +26,9 @@ nested_part: |
523 | |
524 | id: intliotg-server-22-04-manual |
525 | unit: test plan |
526 | -_name: intliotg - Manual only QA tests for Ubuntu Server 22.04 |
527 | +_name: Intel IoTG - Manual only QA tests for Ubuntu Server 22.04 |
528 | _description: |
529 | - Ubuntu Server QA test plan for the intliotg hardware. This test plan contains |
530 | + Ubuntu Server QA test plan for the Intel IoTG hardware. This test plan contains |
531 | all of the tests that require manual control of device hardware |
532 | or some other user input to complete. |
533 | estimated_duration: 3600 |
534 | @@ -39,7 +39,6 @@ nested_part: |
535 | com.canonical.certification::edac-manual |
536 | usb-dwc3-manual |
537 | ishtp-manual |
538 | - tsn-manual |
539 | thermal-manual |
540 | intel-mei-manual |
541 | com.canonical.qa.ceoem::ce-oem-manual |
542 | @@ -52,9 +51,9 @@ exclude: |
543 | |
544 | id: intliotg-server-20-04-manual |
545 | unit: test plan |
546 | -_name: intliotg - Manual only QA tests for Ubuntu Server 20.04 |
547 | +_name: Intel IoTG - Manual only QA tests for Ubuntu Server 20.04 |
548 | _description: |
549 | - Ubuntu Server QA test plan for the intliotg hardware. This test plan contains |
550 | + Ubuntu Server QA test plan for the Intel IoTG hardware. This test plan contains |
551 | all of the tests that require manual control of device hardware |
552 | or some other user input to complete. |
553 | estimated_duration: 3600 |
554 | @@ -65,7 +64,6 @@ nested_part: |
555 | com.canonical.certification::edac-manual |
556 | usb-dwc3-manual |
557 | ishtp-manual |
558 | - tsn-manual |
559 | thermal-manual |
560 | intel-mei-manual |
561 | com.canonical.certification::client-cert-iot-server-20-04-manual |
562 | @@ -75,10 +73,10 @@ exclude: |
563 | |
564 | id: intliotg-server-22-04-automated |
565 | unit: test plan |
566 | -_name: intliotg - Automated only QA tests for Ubuntu Server 22.04 |
567 | +_name: Intel IoTG - Automated only QA tests for Ubuntu Server 22.04 |
568 | _description: |
569 | - Ubuntu Server QA test plan for the intliotg hardware. This test plan contains |
570 | - all of the automated tests used to validate the intliotg device. |
571 | + Ubuntu Server QA test plan for the Intel IoTG hardware. This test plan contains |
572 | + all of the automated tests used to validate the Intel IoTG device. |
573 | include: |
574 | nested_part: |
575 | watchdog-intliotg-automated |
576 | @@ -87,7 +85,6 @@ nested_part: |
577 | com.canonical.certification::edac-automated |
578 | usb-dwc3-automated |
579 | ishtp-automated |
580 | - tsn-automated |
581 | thermal-automated |
582 | intel-mei-automated |
583 | com.canonical.qa.ceoem::ce-oem-automated |
584 | @@ -99,10 +96,10 @@ exclude: |
585 | |
586 | id: intliotg-server-20-04-automated |
587 | unit: test plan |
588 | -_name: intliotg - Automated only QA tests for Ubuntu Server 20.04 |
589 | +_name: Intel IoTG - Automated only QA tests for Ubuntu Server 20.04 |
590 | _description: |
591 | - Ubuntu Server QA test plan for the intliotg hardware. This test plan contains |
592 | - all of the automated tests used to validate the intliotg device. |
593 | + Ubuntu Server QA test plan for the Intel IoTG hardware. This test plan contains |
594 | + all of the automated tests used to validate the Intel IoTG device. |
595 | include: |
596 | nested_part: |
597 | watchdog-intliotg-automated |
598 | @@ -111,7 +108,6 @@ nested_part: |
599 | com.canonical.certification::edac-automated |
600 | usb-dwc3-automated |
601 | ishtp-automated |
602 | - tsn-automated |
603 | thermal-automated |
604 | intel-mei-automated |
605 | com.canonical.certification::client-cert-iot-server-20-04-automated |
606 | @@ -121,26 +117,24 @@ exclude: |
607 | |
608 | id: intliotg-server-22-04-stress |
609 | unit: test plan |
610 | -_name: intliotg - Stress tests for Ubuntu Server 22.04 |
611 | +_name: Intel IoTG - Stress tests for Ubuntu Server 22.04 |
612 | _description: |
613 | - Ubuntu Server QA test plan that includes all stress tests required for intliotg devices |
614 | + Ubuntu Server QA test plan that includes all stress tests required for Intel IoTG devices |
615 | include: |
616 | nested_part: |
617 | com.canonical.certification::stress-iperf3-automated # keep if ethernet is supported |
618 | com.canonical.certification::client-cert-iot-server-22-04-stress |
619 | - rt-performance-tests-stress |
620 | exclude: |
621 | com.canonical.certification::stress-tests/hibernate.* |
622 | |
623 | id: intliotg-server-20-04-stress |
624 | unit: test plan |
625 | -_name: intliotg - Stress tests for Ubuntu Server 20.04 |
626 | +_name: Intel IoTG - Stress tests for Ubuntu Server 20.04 |
627 | _description: |
628 | - Ubuntu Server QA test plan that includes all stress tests required for intliotg devices |
629 | + Ubuntu Server QA test plan that includes all stress tests required for Intel IoTG devices |
630 | include: |
631 | nested_part: |
632 | com.canonical.certification::stress-iperf3-automated # keep if ethernet is supported |
633 | com.canonical.certification::client-cert-iot-server-20-04-stress |
634 | exclude: |
635 | com.canonical.certification::stress-tests/hibernate.* |
636 | - |
@Vincent,
Please see my in-line comments.