Merge lp:~popey/ubuntu-weather-app/manual-tests into lp:ubuntu-weather-app

[Alan Pope 🍺🐧🐱 🦄]

Add manual tests

[Ubuntu Phone Apps Jenkins Bot (ubuntu-phone-apps-jenkins-bot)]

PASSED: Continuous integration, rev:129
http://91.189.93.70:8080/job/ubuntu-weather-app-reboot-ci/255/
Executed test runs:
    SUCCESS: http://91.189.93.70:8080/job/ubuntu-weather-app-reboot-utopic-amd64-ci/225
    SUCCESS: http://91.189.93.70:8080/job/ubuntu-weather-app-reboot-vivid-amd64-ci/255

Click here to trigger a rebuild:
http://91.189.93.70:8080/job/ubuntu-weather-app-reboot-ci/255/rebuild

review: Approve (continuous-integration)

[Nicholas Skaggs (nskaggs)]

These are fine, but will need a provider and folder layout to make them plug and play. I'll bundle them and try them before providing a diff.

[Nicholas Skaggs (nskaggs)]

These work. Some comments

Avoid using dashes for the file name
s/first-run/firstrun/

Prefix the tests file names with 'weather-'

You are missing a colon
s/_description/_description:/g

review: Needs Fixing

[lp:~popey/ubuntu-weather-app/manual-tests]

130. By Alan Pope 🍺🐧🐱 🦄 on 2015-09-29

update based on feedback from balloons

[Ubuntu Phone Apps Jenkins Bot (ubuntu-phone-apps-jenkins-bot)]

PASSED: Continuous integration, rev:130
http://91.189.93.70:8080/job/ubuntu-weather-app-reboot-ci/258/
Executed test runs:
    SUCCESS: http://91.189.93.70:8080/job/ubuntu-weather-app-reboot-utopic-amd64-ci/228
    SUCCESS: http://91.189.93.70:8080/job/ubuntu-weather-app-reboot-vivid-amd64-ci/258

Click here to trigger a rebuild:
http://91.189.93.70:8080/job/ubuntu-weather-app-reboot-ci/258/rebuild

review: Approve (continuous-integration)

[Jenkins Bot (ubuntu-core-apps-jenkins-bot)]

FAILED: Continuous integration, rev:130
https://core-apps-jenkins.ubuntu.com/job/weather-app-ci/5/
Executed test runs:
    None: https://core-apps-jenkins.ubuntu.com/job/generic-update-mp/59/console

Click here to trigger a rebuild:
https://core-apps-jenkins.ubuntu.com/job/weather-app-ci/5/rebuild

review: Needs Fixing (continuous-integration)

[Jenkins Bot (ubuntu-core-apps-jenkins-bot)]

PASSED: Continuous integration, rev:130
https://core-apps-jenkins.ubuntu.com/job/weather-app-ci/8/
Executed test runs:
    None: https://core-apps-jenkins.ubuntu.com/job/generic-update-mp/63/console

Click here to trigger a rebuild:
https://core-apps-jenkins.ubuntu.com/job/weather-app-ci/8/rebuild

review: Approve (continuous-integration)

[Victor Thompson (vthompson)]

See 1 inline comment.

Also:
1. Please add an entry to the changelog, we're trying to maintain this file as we make fixes/updates.
2. There seem to be a lot of indentation issues. Is that problematic at all? Will it show up in an odd fashion to those running through the tests?

review: Needs Fixing

Unmerged revisions

130. By Alan Pope 🍺🐧🐱 🦄 on 2015-09-29

update based on feedback from balloons

129. By Alan Pope 🍺🐧🐱 🦄 on 2015-09-29

Add manual tests

=== added directory 'tests/manual'
=== added file 'tests/manual/weather-firstrun.pxu'
--- tests/manual/weather-firstrun.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/weather-firstrun.pxu	2015-09-29 23:44:36 +0000
@@ -0,0 +1,64 @@
+id: firstrun/check-icon
+plugin: manual
+_summary: Test to check correct icon is used
+estimated_duration: 600
+_description:
+    Test to check correct icon is used
+    1. Install weather reboot
+        Weather icon with a cloud and 12-spiked sun should appear in the dash
+
+id: firstrun/location-check
+plugin: manual
+_summary: Test to confirm location is requested
+estimated_duration: 600
+_description:
+    Test to confirm location is requested
+    1. Launch weather reboot
+        Expect to see 'location acceptance screen'
+
+id: firstrun/location-deny
+plugin: manual
+_summary: Test to confirm effect of denying location access
+estimated_duration: 600
+_description:
+    Test to confirm effect of denying location access
+    1. Launch weather reboot
+        Expect to see 'location acceptance screen'
+	2. Choose 'deny'
+		Expect to see the "Cannoy determine your location", "Manually add" screen
+
+id: firstrun/location-allow
+plugin: manual
+_summary: Test to confirm effect of allowing location access
+estimated_duration: 600
+_description:
+    Test to confirm effect of allowing location access
+	1. Close weather app (if already open)
+	2. Launch System Settings
+	3. Choose "Security & Privacy"
+	4. Choose "Location Access"
+	5. Switch location access for weather app on
+		This reverses the location denial from the previous test
+    6. Launch weather reboot
+        Expect to _not_ see 'location acceptance screen'
+	7. Wait for a short while
+		Expect to see weather for your current location
+
+id: firstrun/pull-refresh
+plugin: manual
+_summary: Test to confirm pull to refresh works
+estimated_duration: 600
+_description:
+    Test to confirm pull to refresh works
+    1. Launch weather reboot
+        Expect to see weather details for current location
+	2. Pull down the screen to refresh
+		Expect to see 'Pull down to refresh' then 'Release to refresh'
+	3. Let go of the screen
+		Expect view to refresh - although you may not see any difference if the data recently refreshed
+
+
+
+
+
+

=== added file 'tests/manual/weather-forecasts.pxu'
--- tests/manual/weather-forecasts.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/weather-forecasts.pxu	2015-09-29 23:44:36 +0000
@@ -0,0 +1,57 @@
+id: forecasts/test-daily-forecast
+plugin: manual
+_summary: Test to future day forecast is shown
+estimated_duration: 600
+_description:
+    Test to future day forecast is shown
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Scroll up
+		Expect to see weather for at least the following 4 days
+
+id: forecasts/test-hourly-forecast-detail
+plugin: manual
+_summary: Test to ensure hourly forecast detail is shown
+estimated_duration: 600
+_description:
+    Test to ensure hourly forecast detail is shown
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Tap large current weather icon (cloud/sun/rain) in the top half of the display
+		Expect to see weather for the following hours
+	3. Swipe right and left
+		Expect to see further details about the weather on coming hours
+	4. Tap in that area again
+		Expect the previously shown current weather icon to be displayed
+
+id: forecasts/test-daily-forecast-detail
+plugin: manual
+_summary: Test to ensure daily forecast detail is shown
+estimated_duration: 600
+_description:
+    Test to ensure daily forecast detail is shown
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Scroll up
+		Expect to see weather for at least the following 4 days
+	3. Tap any day in the future
+		Expect to see further details about the weather on that day
+	4. Tap any other day
+		Expect the previously tapped day to shrink, and the newly tapped day to expand
+	5. Tap the same day again
+		Expect the tapped day detail to shrink
+
+id: forecasts/test-final-day
+plugin: manual
+_summary: Test to ensure UI expands properly
+estimated_duration: 600
+_description:
+    Test to ensure UI expands properly
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Scroll up to the very bottom
+		Expect to see weather for at least the following 4 days
+	3. Tap the final day in the list
+		Expect it to expand, and still be on screen (i.e. not expanded off-screen)
+
+

=== added file 'tests/manual/weather-locations.pxu'
--- tests/manual/weather-locations.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/weather-locations.pxu	2015-09-29 23:44:36 +0000
@@ -0,0 +1,76 @@
+id: locations/show-list-of-locations
+plugin: manual
+_summary: Test to see a list of locations
+estimated_duration: 600
+_description:
+    Test to see a list of locations
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Swipe up from the bottom of the screen
+		Expect to see a list of locations (only one location on first run, or no locations if gps access denied)
+
+id: locations/add-pre-defined-location
+plugin: manual
+_summary: Test to add a location from a pre-defined list
+estimated_duration: 600
+_description:
+    Test to add a location from a pre-defined list
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Swipe up from the bottom of the screen
+		Expect to see a list of locations (only one location on first run, or no locations if gps access denied)
+	3. Press "+" icon
+		Expect to see a pre-defined list of city names
+	4. Tap any city on the list
+		Expect to see it added to the list of locations
+	5. Continue to add more cities
+		There is a hard wired limit of 7 locations currently
+
+id: locations/switch-location-by-swipe
+plugin: manual
+_summary: Test to switch locations by swiping
+estimated_duration: 600
+_description:
+    Test to switch locations by swiping
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Swipe left
+		Expect to switch location
+	3. Swipe right
+		Expect to switch back to previous location
+
+id: locations/switch-location-by-edge
+plugin: manual
+_summary: Test to switch locations using bottom edge
+estimated_duration: 600
+_description:
+    Test to switch locations using bottom edge
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Swipe up from the bottom of the screen
+		Expect to see a list of locations
+	3. Tap a location
+		Expect to be returned to the main screen, showing weather for selected location
+
+id: locations/delete-location
+plugin: manual
+_summary: Test to remove locations
+estimated_duration: 600
+_description:
+    Test to remove locations
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Swipe up from the bottom of the screen
+		Expect to see a list of locations
+	3. Swipe a location to the right
+		Expect to see a delete option
+	4. Swipe location left again
+		Expect location NOT to be deleted
+	5. Swipe a location to the right
+		Expect to see a delete option
+	6. Tap delete (trash) button
+		Expect location to be deleted
+
+
+
+

=== added file 'tests/manual/weather-settings.pxu'
--- tests/manual/weather-settings.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/weather-settings.pxu	2015-09-29 23:44:36 +0000
@@ -0,0 +1,35 @@
+id: settings/change-units-temp
+plugin: manual
+_summary: Test to change temperature units
+estimated_duration: 600
+_description:
+    Test to change temperature units
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Tap settings cog in top right corner
+		Expect to see a list of settings
+	3. Tap "Units"
+		Expect to see 'Units' screen
+	4. Tap "Temperature"
+		Expect to see options unfolded
+	5. Switch to different temperature units and go back to main screen
+		Expect units shown to be different
+
+id: settings/change-units-speed
+plugin: manual
+_summary: Test to change wind speed units
+estimated_duration: 600
+_description:
+    Test to change wind speed units
+    1. Launch weather app
+		Expect to see weather for your current location
+	2. Tap settings cog in top right corner
+		Expect to see a list of settings
+	3. Tap "Units"
+		Expect to see 'Units' screen
+	4. Tap "Wind Speed"
+		Expect to see options unfolded
+	5. Switch to different wind speed units and go back to main screen
+		Expect wind speed units shown to be different
+
+