Ubuntu Manual Tests

Merge ~waveform/ubuntu-manual-tests:noble-tests into ubuntu-manual-tests:main

  1. Git
  2. lp:~waveform/ubuntu-manual-tests
  3. noble-tests
  4. Merge into main
Proposed by Dave Jones
Status: Merged
Merged at revision: 7fe21f69ab565356ebcf626b7756d3f0284ecfbf
Proposed branch: ~waveform/ubuntu-manual-tests:noble-tests
Merge into: ubuntu-manual-tests:main
Diff against target: 366 lines (+109/-4)
2 files modified
definitions/pi_desktop_cases.xml (+54/-4)
definitions/pi_server_cases.xml (+55/-0)
Reviewer Review Type Date Requested Status
Tim Andersson Approve
Review via email: mp+464108@code.launchpad.net

Commit message

Add bluetooth and power LED checks to Pi server test-cases, and bluetooth checks to the Pi desktop test-cases; also tidies up a couple of references (like launching settings)

To post a comment you must log in.
Revision history for this message
Tim Andersson (andersson123) wrote :

LGTM!

review: Approve
Revision history for this message
Tim Andersson (andersson123) wrote :

I've made this follow up MP to update the testcases, I merged this a bit prematurely :)

Revision history for this message
Tim Andersson (andersson123) wrote :

https://code.launchpad.net/~ubuntu-testcase/ubuntu-manual-tests/+git/ubuntu-manual-tests/+merge/464114

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1diff --git a/definitions/pi_desktop_cases.xml b/definitions/pi_desktop_cases.xml
2index a6a3824..cdd878b 100644
3--- a/definitions/pi_desktop_cases.xml
4+++ b/definitions/pi_desktop_cases.xml
5@@ -24,6 +24,14 @@
6
7 <ut:define name="post-install"></ut:define>
8
9+ <ut:test id="power-led">
10+ <dt>Watch the power LED</dt>
11+ <dd>
12+ Ensure it turns out at boot time, and stays lit as the kernel starts
13+ (when the rainbow screen disappears)
14+ </dd>
15+ </ut:test>
16+
17 <ut:test id="startup-splash">
18 <dt>Watch the boot screen</dt>
19 <dd>Check that the Ubuntu logo, and spinner appear during boot time</dd>
20@@ -115,7 +123,7 @@
21
22 <ut:test id="ram-free">
23 <dt>
24- Click the power icon at the top right of the screen, select Settings from
25+ Launch Settings from
26 the menu that appears, then "About" in the left panel of the window that
27 appears
28 </dt>
29@@ -155,16 +163,18 @@
30 <dt>
31 Configure wifi via Network Manager
32 <ul>
33- <li>Click the power icon at the top right of the screen</li>
34- <li>Select the WiFi entry from the menu and Select Network under that</li>
35- <li>Select your local WiFi network from the scan list</li>
36+ <li>Launch settings</li>
37+ <li>Select the WiFi entry from the menu</li>
38+ <li>Select your local WiFi network from the visible networks list</li>
39 <li>Enter the password for your local WiFi network when prompted</li>
40 <li>Wait a few seconds (to allow DHCP to complete), then run <code>ip
41 addr</code></li>
42 <li>Check that a valid IP address is recorded on the <ut:var
43 name="intf" /> interface</li>
44+ <li>Disconnect ethernet, if any is plugged in</li>
45 <li>Check <code>ping google.com</code> successfully pings a few times
46 (<tt>Ctrl+C</tt> to cancel)</li>
47+ <li>Reconnect ethernet, if it was connected before</li>
48 </ul>
49 </dt>
50 <dd>
51@@ -173,6 +183,28 @@
52 </dd>
53 </ut:test>
54
55+ <ut:test id="bluetooth">
56+ <dt>
57+ Configure bluetooth and pair a device
58+ <ul>
59+ <li>Launch settings</li>
60+ <li>Select the Bluetooth entry from the menu (you must be on this page
61+ for the Pi to be &quot;discoverable&quot;)</li>
62+ <li>On another Bluetooth device (e.g. an Android phone) make sure it
63+ is &quot;discoverable&quot; (e.g. on Android go into Bluetooth
64+ settings)</li>
65+ <li>Ensure the other device shows up in the &quot;Devices&quot; list
66+ on the Bluetooth settings page, then select it</li>
67+ <li>Confirm the pincode on both devices</li>
68+ <li>Ensure the other device now shows as anything other that &quot;Not
69+ Set Up&quot; in the &quot;Devices&quot; list</li>
70+ </ul>
71+ </dt>
72+ <dd>
73+ The Bluetooth interface can scan for, and pair with, another device
74+ </dd>
75+ </ut:test>
76+
77 <ut:test id="www-video">
78 <dt>
79 Start Firefox and play a YouTube video
80@@ -199,6 +231,8 @@
81 <li>Start a terminal session</li>
82 <li>Run <code>wget https://archive.org/download/BigBuckBunny_124/Content/big_buck_bunny_720p_surround.mp4</code></li>
83 <li>Once the download has completed, run <code>totem big_buck_bunny_720p_surround.mp4</code></li>
84+ <li>The utility may prompt to install codecs; accept the recommendation
85+ and install whatever codecs are required</li>
86 </ul>
87 </dt>
88 <dd>
89@@ -221,6 +255,7 @@
90
91 <ut:case id="1745_RaspberryPi 4 4GB Desktop">
92 <ut:define name="model">Raspberry Pi 4 4GB</ut:define>
93+ <ut:include ref="power-led" />
94 <ut:include ref="startup-splash" />
95 <ut:include ref="startup-sound" />
96 <ut:include ref="startup-timezone" />
97@@ -232,6 +267,7 @@
98 <ut:incldue ref="dual-monitor" />
99 <ut:include ref="ethernet"><ut:define name="intf">eth0</ut:define></ut:include>
100 <ut:include ref="wifi"><ut:define name="intf">wlan0</ut:define></ut:include>
101+ <ut:include ref="bluetooth" />
102 <ut:include ref="www-video" />
103 <ut:include ref="local-video" />
104 <ut:include ref="lock-screen" />
105@@ -239,6 +275,7 @@
106
107 <ut:case id="1746_RaspberryPi 4 8GB Desktop">
108 <ut:define name="model">Raspberry Pi 4 8GB</ut:define>
109+ <ut:include ref="power-led" />
110 <ut:include ref="startup-splash" />
111 <ut:include ref="startup-sound" />
112 <ut:include ref="startup-timezone" />
113@@ -250,6 +287,7 @@
114 <ut:incldue ref="dual-monitor" />
115 <ut:include ref="ethernet"><ut:define name="intf">eth0</ut:define></ut:include>
116 <ut:include ref="wifi"><ut:define name="intf">wlan0</ut:define></ut:include>
117+ <ut:include ref="bluetooth" />
118 <ut:include ref="www-video" />
119 <ut:include ref="local-video" />
120 <ut:include ref="lock-screen" />
121@@ -257,6 +295,7 @@
122
123 <ut:case id="1747_RaspberryPi 400 Desktop">
124 <ut:define name="model">Raspberry Pi 400</ut:define>
125+ <ut:include ref="power-led" />
126 <ut:include ref="startup-splash" />
127 <ut:include ref="startup-sound" />
128 <ut:include ref="startup-timezone" />
129@@ -268,6 +307,7 @@
130 <ut:incldue ref="dual-monitor" />
131 <ut:include ref="ethernet"><ut:define name="intf">eth0</ut:define></ut:include>
132 <ut:include ref="wifi"><ut:define name="intf">wlan0</ut:define></ut:include>
133+ <ut:include ref="bluetooth" />
134 <ut:include ref="www-video" />
135 <ut:include ref="local-video" />
136 <ut:include ref="lock-screen" />
137@@ -280,6 +320,7 @@
138 (1st) partition and uncomment the <code>#dtoverlay=dwc2,dr_mode=host</code>
139 line to ensure the USB ports on the IO board operate correctly</p>
140 </ut:define>
141+ <ut:include ref="power-led" />
142 <ut:include ref="startup-splash" />
143 <ut:include ref="startup-sound" />
144 <ut:include ref="startup-timezone" />
145@@ -291,6 +332,7 @@
146 <ut:incldue ref="dual-monitor" />
147 <ut:include ref="ethernet"><ut:define name="intf">eth0</ut:define></ut:include>
148 <ut:include ref="wifi"><ut:define name="intf">wlan0</ut:define></ut:include>
149+ <ut:include ref="bluetooth" />
150 <ut:include ref="www-video" />
151 <ut:include ref="local-video" />
152 <ut:include ref="lock-screen" />
153@@ -303,6 +345,7 @@
154 (1st) partition and uncomment the <code>#dtoverlay=dwc2,dr_mode=host</code>
155 line to ensure the USB ports on the IO board operate correctly</p>
156 </ut:define>
157+ <ut:include ref="power-led" />
158 <ut:include ref="startup-splash" />
159 <ut:include ref="startup-sound" />
160 <ut:include ref="startup-timezone" />
161@@ -314,6 +357,7 @@
162 <ut:incldue ref="dual-monitor" />
163 <ut:include ref="ethernet"><ut:define name="intf">eth0</ut:define></ut:include>
164 <ut:include ref="wifi"><ut:define name="intf">wlan0</ut:define></ut:include>
165+ <ut:include ref="bluetooth" />
166 <ut:include ref="www-video" />
167 <ut:include ref="local-video" />
168 <ut:include ref="lock-screen" />
169@@ -326,6 +370,7 @@
170 (1st) partition and uncomment the <code>#dtoverlay=dwc2,dr_mode=host</code>
171 line to ensure the USB ports on the IO board operate correctly</p>
172 </ut:define>
173+ <ut:include ref="power-led" />
174 <ut:include ref="startup-splash" />
175 <ut:include ref="startup-sound" />
176 <ut:include ref="startup-timezone" />
177@@ -337,6 +382,7 @@
178 <ut:incldue ref="dual-monitor" />
179 <ut:include ref="ethernet"><ut:define name="intf">eth0</ut:define></ut:include>
180 <ut:include ref="wifi"><ut:define name="intf">wlan0</ut:define></ut:include>
181+ <ut:include ref="bluetooth" />
182 <ut:include ref="www-video" />
183 <ut:include ref="local-video" />
184 <ut:include ref="lock-screen" />
185@@ -344,6 +390,7 @@
186
187 <ut:case id="1791_RaspberryPi 5 4GB Desktop">
188 <ut:define name="model">Raspberry Pi 5 4GB</ut:define>
189+ <ut:include ref="power-led" />
190 <ut:include ref="startup-splash" />
191 <ut:include ref="startup-sound" />
192 <ut:include ref="startup-timezone" />
193@@ -355,6 +402,7 @@
194 <ut:incldue ref="dual-monitor" />
195 <ut:include ref="ethernet"><ut:define name="intf">eth0</ut:define></ut:include>
196 <ut:include ref="wifi"><ut:define name="intf">wlan0</ut:define></ut:include>
197+ <ut:include ref="bluetooth" />
198 <ut:include ref="www-video" />
199 <ut:include ref="local-video" />
200 <ut:include ref="lock-screen" />
201@@ -362,6 +410,7 @@
202
203 <ut:case id="1792_RaspberryPi 5 8GB Desktop">
204 <ut:define name="model">Raspberry Pi 5 8GB</ut:define>
205+ <ut:include ref="power-led" />
206 <ut:include ref="startup-splash" />
207 <ut:include ref="startup-sound" />
208 <ut:include ref="startup-timezone" />
209@@ -373,6 +422,7 @@
210 <ut:incldue ref="dual-monitor" />
211 <ut:include ref="ethernet"><ut:define name="intf">eth0</ut:define></ut:include>
212 <ut:include ref="wifi"><ut:define name="intf">wlan0</ut:define></ut:include>
213+ <ut:include ref="bluetooth" />
214 <ut:include ref="www-video" />
215 <ut:include ref="local-video" />
216 <ut:include ref="lock-screen" />
217diff --git a/definitions/pi_server_cases.xml b/definitions/pi_server_cases.xml
218index c7cb6b6..94cc3ca 100644
219--- a/definitions/pi_server_cases.xml
220+++ b/definitions/pi_server_cases.xml
221@@ -23,6 +23,17 @@
222 </ut:template>
223
224 <ut:define name="post-install"></ut:define>
225+ <ut:define name="actpwr"></ut:define>
226+
227+ <ut:test id="power-led">
228+ <dt>
229+ After powering on the machine, look at the power LED
230+ </dt>
231+ <dd>
232+ The power LED illuminates and stays illuminated while the kernel continues
233+ to boot. <ut:var name="actpwr" />
234+ </dd>
235+ </ut:test>
236
237 <ut:test id="flash-kernel">
238 <dt>
239@@ -155,6 +166,34 @@
240 </dd>
241 </ut:test>
242
243+ <ut:test id="bluetooth">
244+ <dt>
245+ Configure bluetooth, scan for, and pair, a device
246+ <ul>
247+ <li>Run <code>sudo bluetoothctl</code></li>
248+ <li>Check bluetoothctl prints <code>Agent registered</code></li>
249+ <li>Check the MAC address looks "real" (not some obviously blank
250+ value like AA:AA:AA:AA:AA:AA)</li>
251+ <li>Run <code>scan on</code></li>
252+ <li>Make some other Bluetooth device visible for pairing (e.g. go into
253+ Bluetooth settings on your Android phone)</li>
254+ <li>Verify the other Bluetooth device appears in console output</li>
255+ <li>Run <code>pair XX:XX:XX:XX:XX:XX</code>
256+ where XX:XX:XX:XX:XX:XX is the other device's MAC address, as it
257+ appears in scan output
258+ </li>
259+ <li>Verify the passcode on both devices</li>
260+ <li>Check output includes "Pairing successful"</li>
261+ <li>Disable scanning with <code>scan off</code></li>
262+ <li>Exit tool with <code>quit</code></li>
263+ </ul>
264+ </dt>
265+ <dd>
266+ The Bluetooth interface should have a valid MAC address (not
267+ AA:AA:AA:AA:AA:AA), can see and pair with another Bluetooth device.
268+ </dd>
269+ </ut:test>
270+
271 <ut:test id="audio">
272 <dt>
273 With <ut:var name="device" />, and an available MP3 file:
274@@ -184,6 +223,7 @@
275
276 <ut:case id="1711_RaspberryPi 4 2GB Post-install">
277 <ut:define name="model">Raspberry Pi 4 2GB</ut:define>
278+ <ut:include ref="power-led" />
279 <ut:include ref="flash-kernel" />
280 <ut:include ref="reboot" />
281 <ut:include ref="shutdown" />
282@@ -211,6 +251,7 @@
283
284 <ut:case id="1719_RaspberryPi 4 4GB Post-install">
285 <ut:define name="model">Raspberry Pi 4 4GB</ut:define>
286+ <ut:include ref="power-led" />
287 <ut:include ref="flash-kernel" />
288 <ut:include ref="reboot" />
289 <ut:include ref="shutdown" />
290@@ -238,6 +279,7 @@
291
292 <ut:case id="1720_RaspberryPi 4 8GB Post-install">
293 <ut:define name="model">Raspberry Pi 4 8GB</ut:define>
294+ <ut:include ref="power-led" />
295 <ut:include ref="flash-kernel" />
296 <ut:include ref="reboot" />
297 <ut:include ref="shutdown" />
298@@ -265,6 +307,7 @@
299
300 <ut:case id="1721_RaspberryPi 3B+ Post-install">
301 <ut:define name="model">Raspberry Pi 3B+</ut:define>
302+ <ut:include ref="power-led" />
303 <ut:include ref="flash-kernel" />
304 <ut:include ref="reboot" />
305 <ut:include ref="shutdown" />
306@@ -285,6 +328,7 @@
307
308 <ut:case id="1722_RaspberryPi 3B Post-install">
309 <ut:define name="model">Raspberry Pi 3B</ut:define>
310+ <ut:include ref="power-led" />
311 <ut:include ref="flash-kernel" />
312 <ut:include ref="reboot" />
313 <ut:include ref="shutdown" />
314@@ -305,6 +349,7 @@
315
316 <ut:case id="1723_RaspberryPi 3A+ Post-install">
317 <ut:define name="model">Raspberry Pi 3A+</ut:define>
318+ <ut:include ref="power-led" />
319 <ut:include ref="flash-kernel" />
320 <ut:include ref="reboot" />
321 <ut:include ref="shutdown" />
322@@ -324,6 +369,7 @@
323
324 <ut:case id="1724_RaspberryPi 2 Post-install">
325 <ut:define name="model">Raspberry Pi 2</ut:define>
326+ <ut:include ref="power-led" />
327 <ut:include ref="flash-kernel" />
328 <ut:include ref="reboot" />
329 <ut:include ref="shutdown" />
330@@ -371,6 +417,7 @@
331
332 <ut:case id="1740_RaspberryPi 400 Post-install">
333 <ut:define name="model">Raspberry Pi 400</ut:define>
334+ <ut:include ref="power-led" />
335 <ut:include ref="flash-kernel" />
336 <ut:include ref="reboot" />
337 <ut:include ref="shutdown" />
338@@ -470,6 +517,12 @@
339
340 <ut:case id="1752_RaspberryPi Zero 2 Post-install">
341 <ut:define name="model">Raspberry Pi Zero 2</ut:define>
342+ <ut:include ref="power-led">
343+ <ut:define name="actpwr">
344+ On the Pi Zero 2W, the LED may blink off periodically to show disk
345+ activity, but should otherwise remain lit.
346+ </ut:define>
347+ </ut:include>
348 <ut:include ref="flash-kernel" />
349 <ut:include ref="reboot" />
350 <ut:include ref="shutdown" />
351@@ -485,6 +538,7 @@
352
353 <ut:case id="1793_RaspberryPi 5 4GB Post-install">
354 <ut:define name="model">Raspberry Pi 5 4GB</ut:define>
355+ <ut:include ref="power-led" />
356 <ut:include ref="flash-kernel" />
357 <ut:include ref="reboot" />
358 <ut:include ref="shutdown" />
359@@ -508,6 +562,7 @@
360
361 <ut:case id="1794_RaspberryPi 5 8GB Post-install">
362 <ut:define name="model">Raspberry Pi 5 8GB</ut:define>
363+ <ut:include ref="power-led" />
364 <ut:include ref="flash-kernel" />
365 <ut:include ref="reboot" />
366 <ut:include ref="shutdown" />

Subscribers

People subscribed via source and target branches