Merge lp:~elfy/ubuntu-manual-tests/upgrades into lp:ubuntu-manual-tests

[Elfy]

New testcases to allow us to seperate LTS upgrade testing from normal cycle to cycle upgrades

[Nicholas Skaggs (nskaggs)]

I would support changing these tests to expect LTS, and the current upgrade tests to expect normal only. By that I mean changing the following lines for the LTS tests:

25 + <dt>Open a terminal and enter the command <code>grep Prompt=
26 + /etc/update-manager/release-upgrades</code></dt>
27 + <dd>If you have upgraded from a normal release to normal release, terminal will show Prompt=normal</dd>
28 + <dd>If you have upgraded from a lts release to lts release, terminal will show Prompt=lts</dd>
29 +</dl>

to

25 + <dt>Open a terminal and enter the command <code>grep Prompt=
26 + /etc/update-manager/release-upgrades</code></dt>
28 + <dd>If you have upgraded from a lts release to lts release, terminal will show Prompt=lts</dd>
29 +</dl>

And conversely, the normal upgrade tests should then look like

25 + <dt>Open a terminal and enter the command <code>grep Prompt=
26 + /etc/update-manager/release-upgrades</code></dt>
27 + <dd>If you have upgraded from a normal release to normal release, terminal will show Prompt=normal</dd>
29 +</dl>

review: Needs Fixing

[Nicholas Skaggs (nskaggs)]

<dd>If you have upgraded from a normal release to normal release, terminal will show Prompt=normal</dd>

We could probably refactor the language to look more like

<dd>Terminal will show Prompt=normal</dd>

and

<dd>Terminal will show Prompt=lts</dd>

Depending on which is should show of course :-)

[lp:~elfy/ubuntu-manual-tests/upgrades]

276. By Elfy on 2014-03-05

Change as per comments

277. By Elfy on 2014-03-05

and the changes in the second comment

[Nicholas Skaggs (nskaggs)]

review: Approve

=== modified file 'testcases/image/1310_Upgrade'
--- testcases/image/1310_Upgrade	2014-01-29 20:08:27 +0000
+++ testcases/image/1310_Upgrade	2014-03-05 20:00:21 +0000
@@ -20,8 +20,7 @@
 
         <dt>Open a terminal and enter the command <code>grep Prompt=
                 /etc/update-manager/release-upgrades</code></dt>
-                    <dd>If you have upgraded from a normal release to normal release, terminal will show Prompt=normal</dd>
-                    <dd>If you have upgraded from a lts release to lts release, terminal will show Prompt=lts</dd>
+                    <dd>Terminal will show Prompt=normal</dd>
 </dl>
 
 <strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.

=== modified file 'testcases/image/1498_Upgrade (image)'
--- testcases/image/1498_Upgrade (image)	2014-02-28 11:58:58 +0000
+++ testcases/image/1498_Upgrade (image)	2014-03-05 20:00:21 +0000
@@ -45,8 +45,7 @@
         <dd>New version will be shown on the Description line</dd>
     <dt>Open a terminal and enter the command <code>grep Prompt=
             /etc/update-manager/release-upgrades</code></dt>
-                <dd>If you have upgraded from a normal release to normal release, terminal will show Prompt=normal</dd>
-                <dd>If you have upgraded from a lts release to lts release, terminal will show Prompt=lts</dd>
+                <dd>Terminal will show Prompt=normal</dd>
             <dt>Verify that your pre-upgrade files and installed applications are still present</dt>
         </dl>
 

=== added file 'testcases/image/Upgrade LTS'
--- testcases/image/Upgrade LTS	1970-01-01 00:00:00 +0000
+++ testcases/image/Upgrade LTS	2014-03-05 20:00:21 +0000
@@ -0,0 +1,27 @@
+To execute this test, a pre-existing ubuntu (or derivative) installation is needed
+
+<em>Proceed in your native language if you wish. Instructions will remain in English</em>
+
+<dl>
+    <dt>Install all updates available for the release you want to upgrade by running update-manager. Click Check if any update is available, and click Install to install them</dt>
+    <dt>Ensure FAMILY is looking from all new versions by running 'software sources'. Select the updates tab, and make sure the 'Notify me of a new FAMILY version' option has the 'For any new version' selection</dt>
+    <dt>Run update-manager -d -c from a terminal</dt>
+    <dt>Click the upgrade version button</dt>
+    <dt>Watch it upgrade, noting any errors</dt>
+    <dt>Reboot into your new system:</dt>
+        <dd>
+            <ul>
+                <li>Were any errors encountered during the upgrade?</li>
+                <li>Were any errors encountered after rebooting to new desktop?</li>
+                <li>Does your hardware still work properly?</li>
+                <li>Are you experiencing any application or background service crashes?</li>
+            </ul>
+        </dd>
+
+        <dt>Open a terminal and enter the command <code>grep Prompt=
+                /etc/update-manager/release-upgrades</code></dt>
+                    <dd>Terminal will show Prompt=lts</dd>
+</dl>
+
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>

=== added file 'testcases/image/Upgrade LTS (Image)'
--- testcases/image/Upgrade LTS (Image)	1970-01-01 00:00:00 +0000
+++ testcases/image/Upgrade LTS (Image)	2014-03-05 20:00:21 +0000
@@ -0,0 +1,53 @@
+To execute this test, a pre-existing ubuntu (or derivative) installation is needed
+
+<strong>Upgrade will only be offered as an alternative when there is 1 installed FAMILY system</strong>
+
+<em>Proceed in your native language if you wish. Instructions will remain in English</em>
+
+<dl>
+    <dt>Boot up the image</dt>
+        <dd>The system boots properly and loads the installer displaying Welcome dialog with language selection and 'Try FAMILY' and 'Install FAMILY' buttons</dd>
+    <dt>Click on the Install FAMILY button </dt>
+        <dd>The 'Preparing to install FAMILY' screen is displayed</dd>
+    <dt>On the screen Preparing to install FAMILY, note the state of each check mark for the following components</dt>
+        <dd>
+            <ul>
+                <li>Your system have at least the amount a space indicated</li>
+                <li>(If on a 'laptop'). Is plugged to a power source</li>
+                <li>Is connected to the Internet</li>
+            </ul>
+        </dd>
+        <dd>Check marks represent the state of your system accurately</dd>
+    <dt>Check the box 'Download updates while installing' if a network is available </dt>
+    <dt>Click on the Continue button</dt>
+        <dd>'Installation type' screen is displayed</dd>
+    <dt>Select the 'Upgrade FAMILY' option </dt>
+    <dt>Click 'Install Now' button </dt>
+        <dd>'Where are you?' screen is displayed</dd>
+    <dt>If connected, verify that your timezone is proposed correctly </dt>
+    <dt>Click on the Continue button</dt>
+        <dd>'Keyboard layout' screen is displayed</dd>
+    <dt>Verify that your keyboard layout is set rightly</dt>
+    <dt>Click on the Continue button</dt>
+        <dd>'Who are you?' screen is displayed</dd>
+    <dt>Insert all the requested fields and choose if you want autologin or encrypted home</dt>
+    <dt>Click on the Continue button</dt>
+        <dd>The 'Welcome to FAMILY' slide is displayed</dd>
+    <dt>Wait for the installer to finish</dt>
+        <dd>An 'Installation Complete' dialog appears</dd>
+    <dt>Click the Restart now button</dt>
+        <dd>GUI is shut down, a prompt to remove media and press Enter appears</dd>
+    <dt>Remove the disc and press enter</dt>
+        <dd>The machine has been rebooted</dd>
+    <dt>Allow the machine to reboot</dt>
+        <dd>The system boots properly and loads into the new ubuntu (or derivative name)</dd>
+    <dt>Open a Terminal and enter the command <code>lsb_release -a</code></dt>
+        <dd>New version will be shown on the Description line</dd>
+    <dt>Open a terminal and enter the command <code>grep Prompt=
+            /etc/update-manager/release-upgrades</code></dt>
+                <dd>Terminal will show Prompt=lts</dd>
+            <dt>Verify that your pre-upgrade files and installed applications are still present</dt>
+        </dl>
+
+        <strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+            If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>