Merge lp:~kissiel/checkbox/shakedown-testplan into lp:checkbox

[Maciej Kisielewski]

After BQ Aquarius E4.5 Ubuntu got released, phone delivery team wanted to have a tool for assess whether returned device got returned because of technical issues. Some of the tests required where already present in the barajas provider. Other were coarsely defined by Julia from phone-delivery team.
You may find the list here: https://docs.google.com/a/canonical.com/spreadsheets/d/1mNDxm9UV8X-uqByy87mYjLjB9CSlvt-hL32EY-tbKgk/edit#gid=0

This MR translates the above list into plainbox test plan and adds definitions
of jobs that were absent in the ubuntu-touch provider.

[Sylvain Pineau (sylvain-pineau)]

Thanks, +1.

review: Approve

=== added file 'providers/plainbox-provider-ubuntu-touch/units/shakedown.pxu'
--- providers/plainbox-provider-ubuntu-touch/units/shakedown.pxu	1970-01-01 00:00:00 +0000
+++ providers/plainbox-provider-ubuntu-touch/units/shakedown.pxu	2015-04-27 07:41:59 +0000
@@ -0,0 +1,151 @@
+# This file contains the definition of the Shakedown Testplan and definitions
+# of jobs custom to that testplan
+
+unit: test plan
+id: shakedown
+_name: Shakedown testplan
+_description:
+ This test plan should be used when the device is returned, to establish if
+ it was returned because there's a technical problem with the device.
+include:
+ 2014.com.ubuntu::Audio-04
+ 2014.com.ubuntu::Audio-05
+ 2014.com.ubuntu::Audio-06
+ 2014.com.ubuntu::Audio-07
+ 2014.com.ubuntu::Audio-08
+ 2014.com.ubuntu::Audio-18
+ 2014.com.ubuntu::Audio-19
+ 2014.com.ubuntu::Battery-06
+ 2014.com.ubuntu::Bluetooth-01
+ 2014.com.ubuntu::Bluetooth-02
+ 2014.com.ubuntu::Bluetooth-03
+ 2014.com.ubuntu::Bluetooth-04
+ 2014.com.ubuntu::Bluetooth-05
+ 2014.com.ubuntu::ID-Location-03
+ 2014.com.ubuntu::ID-Location-04
+ 2014.com.ubuntu::Msg-01
+ 2014.com.ubuntu::Msg-02
+ 2014.com.ubuntu::Msg-03
+ 2014.com.ubuntu::Msg-11
+ 2014.com.ubuntu::Msg-12
+ 2014.com.ubuntu::Msg-13
+ 2014.com.ubuntu::SD-01
+ 2014.com.ubuntu::SD-02
+ 2014.com.ubuntu::SD-06
+ 2014.com.ubuntu::SD-07
+ 2014.com.ubuntu::Screen-07
+ 2014.com.ubuntu::Screen-08
+ 2014.com.ubuntu::Screen-09
+ 2014.com.ubuntu::Screen-10
+ 2014.com.ubuntu::Screen-11
+ 2014.com.ubuntu::Sensors-01
+ 2014.com.ubuntu::Sensors-02
+ 2014.com.ubuntu::Sensors-03
+ 2014.com.ubuntu::Sensors-04
+ 2014.com.ubuntu::Sensors-07
+ 2014.com.ubuntu::Settings-01
+ 2014.com.ubuntu::Tel-01
+ 2014.com.ubuntu::Tel-36
+ 2014.com.ubuntu::Tel-38
+ 2014.com.ubuntu::Tel-46
+ 2014.com.ubuntu::Tel-47
+ 2014.com.ubuntu::Tel-48
+ 2014.com.ubuntu::Tel-49
+ 2014.com.ubuntu::Tel-50
+ 2014.com.ubuntu::Tel-51
+ 2014.com.ubuntu::Tel-52
+ 2014.com.ubuntu::Tel-53
+ 2014.com.ubuntu::Wifi-11
+ shakedown/.*
+
+unit: category
+id: shakedown-custom
+_name: Custom shakedown tests
+
+unit: job
+id: shakedown/screenshot
+plugin: manual
+category_id: shakedown-custom
+_summary: Ensure that DUT can take and store screenshots
+_purpose:
+ Purpose of this test is to check whether the device can take and store
+ screenshots
+_steps:
+ 1. Make sure screen is active
+ 2. Press volume up and volume down buttons simultaneously
+_verification:
+ 1. Open gallery app
+ 2. Is the screenshot present?
+
+id: shakedown/sd-card-full-warning
+plugin: manual
+category_id: shakedown-custom
+_summary: Check if DUT warns when SD cards is full
+_purpose:
+ Purpose of this test is to check whether the device warns the user about SD
+ card being full.
+_steps:
+ 1. Prepare SD card with no free space on it.
+ 2. Insert into sd card slot.
+_verification:
+ 1. Does warning about SD card being full show up?
+
+id: shakedown/battery-consumption-rate
+plugin: manual
+category_id: shakedown-custom
+_summary: Check if battery depletion rate is normal
+_purpose:
+ Purpose of this test is to make sure that device's battery depletes in a
+ normal rate
+_steps:
+ 1. Make sure the battery is fully charged.
+ 2. Open System Settings
+ 3. Open Security & Privacy
+ 4. Select Phone Locking
+ 5. Select lock interval `never`
+ 6. Leave the device on idle for 30 minutes
+_verification:
+ 1. Check charge level
+ 2. Is it above or equal to 95%?
+
+id: shakedown/sim-information
+plugin: manual
+category_id: shakedown-custom
+_summary: Ensure that sim information can be read
+_steps:
+ 1. Ensure SIM is present
+ 2. Open System Settings
+ 3. Open About this phone
+_verification:
+ 1. Is SIM present under Phone number?
+
+id: shakedown/apn-information
+plugin: manual
+category_id: shakedown-custom
+_summary: Ensure that DUT can gather APN information
+_purpose:
+ Purpose of this test is to check if the device can gather APN information
+_steps:
+ 1. Ensure SIM is present
+ 2. Open System Settings
+ 3. Select Cellular
+ 4. Select Carrier
+ 5. Open APN menu
+_verification:
+ 1. Is operator's APN shown in the menu?
+
+id: shakedown/apn-login
+plugin:manual
+category_id: shakedown-custom
+_summary: Ensure that DUT can login into APN
+_purpose:
+ Purpose of this test is to check if the device can login into APN
+_steps:
+ 1. Ensure SIM is present
+ 2. Open System Settings
+ 3. Select Cellular
+ 4. Select Carrier
+ 5. Open APN menu
+ 6. Select one of the operator's APNs
+_verification:
+ 1. Is checkmark visible on the right of selected APN's name?