Merge ubuntu-manual-tests:calamares_installer-prompt_firmware_types into ubuntu-manual-tests:main

[ԜаӀtеr Ⅼарсһуnѕkі]

Update for Calamares+installer-prompt: firmware types

More in a series of continued rewriting of testcases for the Calamares installer and installer-prompt.

This one covers different installer types.

[Erich Eickmeyer (eeickmeyer)]

LGTM, approved

review: Approve

[Tim Andersson (andersson123)]

This has been updated on the isotracker

[ԜаӀtеr Ⅼарсһуnѕkі (wxl)]

Tim, just so you're aware, I wrote a whole new test suite across four merges:

 1. different tests for the different partitioning schemes
 2. different tests for the types
 3. different tests for firmware types
 4. miscellany:
    - a test for encryption
    - a test with no internet
    - a test for updates
    - a test in a different language
    - a test of autologin
    - a test for OEM

So those others need to get on the tracker, too.

[ԜаӀtеr Ⅼарсһуnѕkі (wxl)]

Sorry, five merges. The first one was just a rewrite of the two existing testcases: entire disk and live.

[Tim Andersson (andersson123)]

Hey! I have already added these to the tracker, but the priorities are probably wrong, given your list above, I'll amend the calamares test suites accordingly

[Tim Andersson (andersson123)]

Please can you take a look at:
https://iso.qa.ubuntu.com/qatracker/milestones/450/builds/300328/testcases

and

https://iso.qa.ubuntu.com/qatracker/milestones/450/builds/300330/testcases

And confirm with me that this suffices for you?

I can amend as you please

[ԜаӀtеr Ⅼарсһуnѕkі (wxl)]

Oh there's no priority intended by that list, so it all looks good to me. Although I think Ubuntu Unity needs the same testsuite.

[Tim Andersson (andersson123)]

Thanks Walter! I've also updated the Ubuntu Unity testsuite.

diff --git a/testcases/image/Install using Calamares+installer-prompt (BIOS) b/testcases/image/Install using Calamares+installer-prompt (BIOS)
new file mode 100755
index 0000000..7d0daf9
--- /dev/null
+++ b/testcases/image/Install using Calamares+installer-prompt (BIOS)
@@ -0,0 +1,40 @@
+<em>Proceed in your native language if you wish. Instructions will remain in English</em>
+
+<dl>
+    <dt>Before running this test, ensure that you are using a BIOS firmware to boot</dt>
+    <dt>Boot up the image</dt>
+        <dd>FAMILY boot screen is displayed</dd>
+    <dt>When installer-prompt starts select your language in the first prompt</dt>
+        <dd>Language is selected, all labels are changed to translated versions</dd>
+	<dd>Current internet connection is shown in the second prompt</dd>
+    <dt>Press "Install FAMILY" and wait for Calamares installer to start</dt>
+    <dt>After the "Welcome" pane is shown click "Next"</dt>
+    <dt>The "Location" pane is shown with a map and options to select region, time zone, language, and number/date locale</dt>
+    <dt>Select the appropriate locale options and click "Next"</dt>
+        <dd>The display should reflect your selections</dd>    
+    <dt>In the "Keyboard" pane, select your keyboard layout and click "Next"</dt>
+        <dd>Test the keyboard layout in the given box, which should be set correctly</dd>
+    <dt>At the "Customize" pane, click "Next"</dt>
+        <dd>"Normal Installation" should be selected, but there are also options for "Full Installation" and "Minimal Installation"</dd>
+        <dd>"Download and install updates following installation" should be unchecked</dd>
+        <dd>The checkboxes under "Install additional third-party packages" should be unchecked</dd>
+    <dt>At the "Partions" pane, select the "Erase disk" radio button and click "Next"</dt>
+        <dd>In the top left corner, "BIOS" is displayed</dd>
+        <dd>At the top, the correct storage device should be selected</dd>
+        <dd>Under the radio button, "Swap to file" should be selected from the drop down and "No swap" is the other option</dd>
+        <dd>Next to the swap drop down, "ext4" is selected from a second drop down and "xfs" and "btrfs" are the other options</dd>
+	<dd>Above the partition layout, "Encrypt system" should be unchecked</dd>
+        <dd>At the bottom, a partition layout should be shown which uses all disk space</dd>
+	<dd>Below the partition layout, the bootloader should show that it's being installed to the correct location</dd>
+    <dt>At the "Users" pane, enter details about the main system user and click "Next"</dt>
+        <dd>All details should be correctly filled in</dd>
+    <dt>At the "Summary" pane, confirm the details you entered throughout the install are accurate and click "Install", then "Install now"</dt>
+        <dd>All details should match what you entered</dd>
+        <dd>The slideshow should correctly display</dd>
+    <dt>At the "Finish" pane, "Restart now" is checked. Click "Done" to restart</dt>
+    <dt>Remove the media when prompted and hit enter as instructed</dt>
+    <dt>Allow the machine to reboot</dt>
+        <dd>The system boots properly and loads into FAMILY showing the username you entered</dd>
+</dl>
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
diff --git a/testcases/image/Install using Calamares+installer-prompt (EFI + Secure Boot) b/testcases/image/Install using Calamares+installer-prompt (EFI + Secure Boot)
new file mode 100755
index 0000000..20dcd03
--- /dev/null
+++ b/testcases/image/Install using Calamares+installer-prompt (EFI + Secure Boot)
@@ -0,0 +1,40 @@
+<em>Proceed in your native language if you wish. Instructions will remain in English</em>
+
+<dl>
+    <dt>Before running this test, ensure that you are using an EFI firmware with Secure Boot enabled to boot</dt>
+    <dt>Boot up the image</dt>
+        <dd>FAMILY boot screen is displayed</dd>
+    <dt>When installer-prompt starts select your language in the first prompt</dt>
+        <dd>Language is selected, all labels are changed to translated versions</dd>
+	<dd>Current internet connection is shown in the second prompt</dd>
+    <dt>Press "Install FAMILY" and wait for Calamares installer to start</dt>
+    <dt>After the "Welcome" pane is shown click "Next"</dt>
+    <dt>The "Location" pane is shown with a map and options to select region, time zone, language, and number/date locale</dt>
+    <dt>Select the appropriate locale options and click "Next"</dt>
+        <dd>The display should reflect your selections</dd>    
+    <dt>In the "Keyboard" pane, select your keyboard layout and click "Next"</dt>
+        <dd>Test the keyboard layout in the given box, which should be set correctly</dd>
+    <dt>At the "Customize" pane, click "Next"</dt>
+        <dd>"Normal Installation" should be selected, but there are also options for "Full Installation" and "Minimal Installation"</dd>
+        <dd>"Download and install updates following installation" should be unchecked</dd>
+        <dd>The checkboxes under "Install additional third-party packages" should be unchecked</dd>
+    <dt>At the "Partions" pane, select the "Erase disk" radio button and click "Next"</dt>
+        <dd>In the top left corner, "EFI" is displayed</dd>
+        <dd>At the top, the correct storage device should be selected</dd>
+        <dd>Under the radio button, "Swap to file" should be selected from the drop down and "No swap" is the other option</dd>
+        <dd>Next to the swap drop down, "ext4" is selected from a second drop down and "xfs" and "btrfs" are the other options</dd>
+	<dd>Above the partition layout, "Encrypt system" should be unchecked</dd>
+        <dd>At the bottom, a partition layout should be shown which uses all disk space</dd>
+	<dd>Below the partition layout, the bootloader should show that it's being installed to the correct location</dd>
+    <dt>At the "Users" pane, enter details about the main system user and click "Next"</dt>
+        <dd>All details should be correctly filled in</dd>
+    <dt>At the "Summary" pane, confirm the details you entered throughout the install are accurate and click "Install", then "Install now"</dt>
+        <dd>All details should match what you entered</dd>
+        <dd>The slideshow should correctly display</dd>
+    <dt>At the "Finish" pane, "Restart now" is checked. Click "Done" to restart</dt>
+    <dt>Remove the media when prompted and hit enter as instructed</dt>
+    <dt>Allow the machine to reboot</dt>
+        <dd>The system boots properly and loads into FAMILY showing the username you entered</dd>
+</dl>
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>
diff --git a/testcases/image/Install using Calamares+installer-prompt (EFI) b/testcases/image/Install using Calamares+installer-prompt (EFI)
new file mode 100755
index 0000000..5b34cf7
--- /dev/null
+++ b/testcases/image/Install using Calamares+installer-prompt (EFI)
@@ -0,0 +1,40 @@
+<em>Proceed in your native language if you wish. Instructions will remain in English</em>
+
+<dl>
+    <dt>Before running this test, ensure that you are using an EFI firmware to boot</dt>
+    <dt>Boot up the image</dt>
+        <dd>FAMILY boot screen is displayed</dd>
+    <dt>When installer-prompt starts select your language in the first prompt</dt>
+        <dd>Language is selected, all labels are changed to translated versions</dd>
+	<dd>Current internet connection is shown in the second prompt</dd>
+    <dt>Press "Install FAMILY" and wait for Calamares installer to start</dt>
+    <dt>After the "Welcome" pane is shown click "Next"</dt>
+    <dt>The "Location" pane is shown with a map and options to select region, time zone, language, and number/date locale</dt>
+    <dt>Select the appropriate locale options and click "Next"</dt>
+        <dd>The display should reflect your selections</dd>    
+    <dt>In the "Keyboard" pane, select your keyboard layout and click "Next"</dt>
+        <dd>Test the keyboard layout in the given box, which should be set correctly</dd>
+    <dt>At the "Customize" pane, click "Next"</dt>
+        <dd>"Normal Installation" should be selected, but there are also options for "Full Installation" and "Minimal Installation"</dd>
+        <dd>"Download and install updates following installation" should be unchecked</dd>
+        <dd>The checkboxes under "Install additional third-party packages" should be unchecked</dd>
+    <dt>At the "Partions" pane, select the "Erase disk" radio button and click "Next"</dt>
+        <dd>In the top left corner, "EFI" is displayed</dd>
+        <dd>At the top, the correct storage device should be selected</dd>
+        <dd>Under the radio button, "Swap to file" should be selected from the drop down and "No swap" is the other option</dd>
+        <dd>Next to the swap drop down, "ext4" is selected from a second drop down and "xfs" and "btrfs" are the other options</dd>
+	<dd>Above the partition layout, "Encrypt system" should be unchecked</dd>
+        <dd>At the bottom, a partition layout should be shown which uses all disk space</dd>
+	<dd>Below the partition layout, the bootloader should show that it's being installed to the correct location</dd>
+    <dt>At the "Users" pane, enter details about the main system user and click "Next"</dt>
+        <dd>All details should be correctly filled in</dd>
+    <dt>At the "Summary" pane, confirm the details you entered throughout the install are accurate and click "Install", then "Install now"</dt>
+        <dd>All details should match what you entered</dd>
+        <dd>The slideshow should correctly display</dd>
+    <dt>At the "Finish" pane, "Restart now" is checked. Click "Done" to restart</dt>
+    <dt>Remove the media when prompted and hit enter as instructed</dt>
+    <dt>Allow the machine to reboot</dt>
+        <dd>The system boots properly and loads into FAMILY showing the username you entered</dd>
+</dl>
+<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result.
+    If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong>