Merge lp:~ki7mt/ubuntu-manual-tests/server-upgrade-cli into lp:ubuntu-manual-tests

[Greg Beam]

lp:1172452
https://bugs.launchpad.net/ubuntu-manual-tests/+bug/1172452

Test Case(s): server-upgrade (command-line) tests.

This needs a thorough review, as there are many test variables which affect the outcome.

See commit log for details.
.

[Nicholas Skaggs (nskaggs)]

Both this and https://code.launchpad.net/~ki7mt/ubuntu-manual-tests/lp1168084-fix/+merge/201878 need a good looking at. Thanks for providing these testcases!

[Nicholas Skaggs (nskaggs)]

I have some minor edits to suggest as far as grammar and layout go. Overall, I think this is ready to go. Make the tweaks and we'll merge. Remember to check spelling and grammar one last time when you are finished. Thanks again!

---
A couple tweaks in language. In general the expected results don't need to read "should". State the result as fact. Something like this example below.
<dd>Old packages should be removed</dd>

to

<dd>Old packages are removed</dd>

When prompting to run something on the command line I'd suggest using the <pre> tag to set it apart nicely. IE,
<dt>Check release-upgrade setting: <pre>grep '^Prompt=' /etc/update-manager/release-upgrades</pre></dt>

Use <em> to se apart prompts. For example,
<dt>When asked, <em>Restart services during package upgrades without asking</em>, select "Yes"</dt>

review: Needs Fixing

[Nicholas Skaggs (nskaggs)]

Are you able to finish this? Just a couple minor edits are needed. Thanks!

[lp:~ki7mt/ubuntu-manual-tests/server-upgrade-cli]

262. By Greg Beam on 2014-05-20

updates from review comments

[Elfy (elfy)]

This testcase is still showing "should's" can we get those changed pleased.

Eg

<dt>In the terminal: sudo apt-get update && sudo apt-get upgrade</dt>
        <dd>APT should update</dd>
        <dd>If asked to install files, type <em>Y</em></dd>
        <dd>New version files should install</dd>

needs to be

<dt>In the terminal: sudo apt-get update && sudo apt-get upgrade</dt>
        <dd>APT updates</dd>
        <dd>If asked to install files, type <em>Y</em></dd>
        <dd>New version files install</dd>

You can put my name as the reviewer, I'll get these merged and synced as soon as I see it.

[Elfy (elfy)]

missed the review type ...

review: Needs Fixing

[lp:~ki7mt/ubuntu-manual-tests/server-upgrade-cli]

263. By Greg Beam on 2014-06-25

Fix syntax and edit grammer

264. By Greg Beam on 2014-06-25

add case names and descriptions

[Elfy (elfy)]

Thanks ki7mt - they look good to me.

review: Approve

=== added file 'testcases/image/Server_Upgrade_CLI'
--- testcases/image/Server_Upgrade_CLI	1970-01-01 00:00:00 +0000
+++ testcases/image/Server_Upgrade_CLI	2014-06-25 19:08:46 +0000
@@ -0,0 +1,111 @@
+Test-case name: server_upgrade_cli_NEVER
+This will test protection from do-release-upgrade
+<dl>
+    <dt>Login into the system locally, or via SSH</dt>
+    <dt>In the terminal: sudo apt-get update && sudo apt-get upgrade</dt>
+        <dd>APT will update</dd>
+        <dd>If asked to install files, type <em>Y</em></dd>
+        <dd>New version files install</dd>
+    <dt>Check release-upgrade setting: grep '^Prompt=' /etc/update-manager/release-upgrades</dt>
+        <dd>Return: Prompt=normal</dd>
+        <dd>If Prompt=normal then: sudo sed -i 's/Prompt=never/Prompt=never/'</dd>
+        <dd>If Prompt=lts then: sudo sed -i 's/Prompt=lts/Prompt=never/'</dd>
+    <dt>Check release-setting again: grep '^Prompt=' /etc/update-manager/release-upgrades</dt>
+        <dd>Return: Prompt=normal</dd>
+        <dd> If sed command fails, edit manually, changing to: Prompt=never</dd>
+    <dt>Start the upgrade: sudo do-release-upgrade</dt>
+        <dd>Checking for new Ubuntu release</dd>
+        <dd>No new release be found</dd>
+        <dd>Return to the command prompt</dd>
+</dl>
+
+Test-case name: server_upgrade_cli_NORMAL
+This will test the next sequential release
+<dl>
+    <dt>Login into the system locally, or via SSH</dt>
+    <dt>In the terminal: sudo apt-get update && sudo apt-get upgrade</dt>
+        <dd>APT will update</dd>
+        <dd>If asked to install files, type <em>Y</em></dd>
+        <dd>New version files install</dd>
+    <dt>Check release-upgrade setting: grep '^Prompt=' /etc/update-manager/release-upgrades</dt>
+        <dd>Return: Prompt=normal</dd>
+        <dd>If Prompt=never then: sudo sed -i 's/Prompt=never/Prompt=normal/'</dd>
+        <dd>If Prompt=lts then: sudo sed -i 's/Prompt=lts/Prompt=normal/'</dd>
+    <dt>Re-Check release-setting: grep '^Prompt=' /etc/update-manager/release-upgrades</dt>
+        <dd>Return: Prompt=normal</dd>
+        <dd> If sed command fails, edit manually, changing to: Prompt=normal</dd>
+    <dt>Check current release: lsb_release -r</dt>
+        <dd>Note the release version</dd>
+    <dt>Start the upgrade: sudo do-release-upgrade</dt>
+        <dd>APT will check release data and update package list</dd>
+        <dd>If a new release is found, APT will add repositories and upgrade</dd>
+    <dt>When asked to start the upgrade, type <em>Y</em></dt>
+    <dt>When asked, restart services during package upgrades without asking, select <em>Yes</em></dt>
+    <dt>When asked, remove obsolete packages, type <em>Y</em></dt>
+    <dt>Login into the system</dt>
+    <dt>Check release version: lsb_release -r</dt>
+        <dd>Compare results to step(5), will be the next sequential release.</dd>
+</dl>
+
+Test-case name: server_upgrade_cli_LTS
+This will test upgrading LTS to LTS
+<dl>
+    <dt>Login into the system locally, or via SSH</dt>
+    <dt>In the terminal: sudo apt-get update && sudo apt-get upgrade</dt>
+        <dd>APT will update</dd>
+        <dd>If asked to install files, type <em>Y</em></dd>
+        <dd>New version files install</dd>
+    <dt>Check release-upgrade setting: grep '^Prompt=' /etc/update-manager/release-upgrades</dt>
+        <dd>Return: Prompt=normal</dd>
+        <dd>If Prompt=normal then: sudo sed -i 's/Prompt=normal/Prompt=lts/'</dd>
+        <dd>If Prompt=never then: sudo sed -i 's/Prompt=never/Prompt=lts/'</dd>
+    <dt>Re-Check release-setting: grep '^Prompt=' /etc/update-manager/release-upgrades</dt>
+        <dd>Return: Prompt=normal</dd>
+        <dd> If sed command fails, edit manually, changing to: Prompt=LTS</dd>
+    <dt>Check current release: lsb_release -r</dt>
+        <dd>Note the release version</dd>
+    <dt>Start the upgrade: sudo do-release-upgrade</dt>
+        <dd>APT will check release data and update package list</dd>
+        <dd>If a new release is found, APT will add repositories and upgrade</dd>
+    <dt>When asked to start the upgrade, type <em>Y</em></dt>
+    <dt>When asked, restart services during package upgrades without asking, select <em>Yes</em></dt>
+    <dt>When asked, Remove obsolete packages, type <em>Y</em></dt>
+    <dt>To finished the upgrade, restart required, type <em>Y</em></dt>
+        <dd>The system will reboot.</dd>
+    <dt>Login into the system</dt>
+    <dt>Check the release version: lsb_release -r</dt>
+        <dd>Compare results to step(5), will be the next sequential LTS release.</dd>
+</dl>
+
+Test-case name: server_upgrade_cli_DEV
+This will test upgrading to a development release
+<dl>
+    <dt>Login into the system locally, or via SSH</dt>
+    <dt>In the terminal: sudo apt-get update && sudo apt-get upgrade</dt>
+        <dd>APT will update</dd>
+        <dd>If asked to install files, type <em>Y</em></dd>
+        <dd>New version files install</dd>
+    <dt>Check release-upgrade setting: grep '^Prompt=' /etc/update-manager/release-upgrades</dt>
+        <dd>Return: Prompt=normal</dd>
+        <dd>If Prompt=never then: sudo sed -i 's/Prompt=never/Prompt=normal/'</dd>
+        <dd>If Prompt=LTS then: sudo sed -i 's/Prompt=lts/Prompt=normal/'</dd>
+    <dt>Re-Check release-setting: grep '^Prompt=' /etc/update-manager/release-upgrades</dt>
+        <dd>Return: Prompt=normal</dd>
+        <dd> If sed command fails, edit manually, changing to: Prompt=LTS</dd>
+    <dt>Check current release: lsb_release -r></dt>
+        <dd>Note the release version</dd>
+    <dt>Start the upgrade: sudo do-release-upgrade -d</dt>
+        <dd>APT will check release data and update package list</dd>
+        <dd>If a new release is found, APT will add new repositories and start the upgrade</dd>
+    <dt>When asked to start the upgrade, type <em>Y</em></dt>
+        <dd>The installation will continue</dd>
+    <dt>When asked, restart services during package upgrades without asking, select <em>Yes</em></dt>
+    <dt>When asked, remove obsolete packages, type <em>Y</em></dt>
+    <dt>To finished the upgrade, restart required, type <em>Y</em></dt>
+        <dd>The system will reboot.</dd>
+    <dt>Login into the system</dt>
+    <dt>Check the release version: lsb_release -r</dt>
+        <dd>Compare results to step(5), will be the next development release.</dd>
+</dl>
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>