1
=== modified file 'README'
2
--- README	2015-04-01 05:57:42 +0000
3
+++ README	2015-05-18 21:41:52 +0000
4
@@ -40,11 +40,11 @@
5
40
40
6
41
    $ ctest
41
    $ ctest
7
42
42
8
43
9
44
= Automated UI tests =
43
= Automated UI tests =
10
45
44
11
46
webbrowser-app uses autopilot (https://launchpad.net/autopilot) to test its UI.
45
webbrowser-app uses autopilot (https://launchpad.net/autopilot) to test its UI.
13
47
To run the tests, you will need to install python3-autopilot and autopilot-qt5.
46
To run the tests locally, you will need to install python3-autopilot and
14
47
autopilot-qt5.
15
48
Then do the following:
48
Then do the following:
16
49
49
17
50
    $ cd tests/autopilot/
50
    $ cd tests/autopilot/
18
@@ -54,6 +54,8 @@
19
54
54
20
55
    $ autopilot3 list webbrowser_app
55
    $ autopilot3 list webbrowser_app
21
56
56
22
57
In order to run the tests in a virtual machine with an environment closer to
23
58
what a user will get in Ubuntu Touch, see the Dep8 tests section.
24
57
59
25
58
= Code coverage =
60
= Code coverage =
26
59
61
27
@@ -68,6 +70,59 @@
28
68
This will generate a coverage report in XML format (coverage.xml) and an
70
This will generate a coverage report in XML format (coverage.xml) and an
29
69
interactive human-readable report in HTML format (coveragereport/index.html).
71
interactive human-readable report in HTML format (coveragereport/index.html).
30
70
72
31
73
= Dep8 tests =
32
74
33
75
Dep8 tests excercise the package "as-installed".
34
76
35
77
Currently, the webbrowser-app has one suite of dep8 tests that uses autopilot
36
78
(https://launchpad.net/autopilot) to test from the point of view of the user.
37
79
38
80
To run the tests you will need autopkgtest:
39
81
40
82
    $ sudo apt-get install autopkgtest
41
83
42
84
You can use multiple test beds to execute the tests. Below you will find
43
85
instructions to run them in a virtual machine
44
86
You can find more information with:
45
87
46
88
    $ man adt-run
47
89
48
90
== Run dep8 tests ==
49
91
50
92
To run the tests in a qemu virtual machine, you will first have to create it
51
93
(see /usr/share/doc/autopkgtest/README.running-tests.rst.gz). We output the
52
94
image to ~/ rather than the current directory, so it will be in a safer
53
95
place to avoid rebuilding images every time. You can store it in any
54
96
directory you wish. This image is better consumed "fresh", building it daily
55
97
will avoid long updates/upgrades when running the tests.
56
98
57
99
    $ adt-buildvm-ubuntu-cloud -r vivid -a amd64 -o ~/
58
100
59
101
Then run the tests using adt-run with the qemu virtualization host against
60
102
the current archive.
61
103
62
104
    $ adt-run -B -U --unbuilt-tree . \
63
105
      -o ~/adt-browser-test/$(date +%Y-%m-%d-%H-%M) \
64
106
      --- qemu ~/adt-vivid-amd64-cloud.img
65
107
66
108
The tests can also be run on a local phone.
67
109
68
110
    $ adt-run -B -U --unbuilt-tree . \
69
111
      -o ~/adt-browser-test/$(date +%Y-%m-%d-%H-%M) \
70
112
      --- ssh -s adb -- -p <password> --serial <ADB_SERIAL> 
71
113
72
114
== Examine the dep8 autopilot results ==
73
115
74
116
To examine the test results, which are in subunit format, additional tools are
75
117
required.
76
118
77
119
    $ sudo add-apt-repository ppa:thomir/trv
78
120
    $ sudo apt-get update
79
121
    $ sudo apt-get install trv
80
122
    $ trv
81
123
82
124
You can find the results file in the directory
83
125
~/adt-browser-test/$(date +%Y-%m-%d-%H-%M)/artifacts.
84
71
126
85
72
= Settings =
127
= Settings =
86
73
128
87
@@ -93,4 +148,3 @@
88
93
148
89
94
 - restoreSession: whether to restore the previous browsing session at startup
149
 - restoreSession: whether to restore the previous browsing session at startup
90
95
   (defaults to true)
150
   (defaults to true)
91
96
92
97
151
93
=== added directory 'debian/tests'
94
=== added file 'debian/tests/control'
95
--- debian/tests/control	1970-01-01 00:00:00 +0000
96
+++ debian/tests/control	2015-05-18 21:41:52 +0000
97
@@ -0,0 +1,26 @@
98
1
# Copyright 2015 Canonical
99
2
#
100
3
# This program is free software: you can redistribute it and/or modify it
101
4
# under the terms of the GNU General Public License version 3, as published
102
5
# by the Free Software Foundation.
103
6
#
104
7
# This program is distributed in the hope that it will be useful,
105
8
# but WITHOUT ANY WARRANTY; without even the implied warranty of
106
9
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
107
10
# GNU General Public License for more details.
108
11
#
109
12
# You should have received a copy of the GNU General Public License
110
13
# along with this program. If not, see <http://www.gnu.org/licenses/>.
111
14
112
15
# autopkgtest is a test dependency so we don't need to copy
113
16
# ubuntu-touch-session to the testbed but can use it from autopkgtest instead
114
17
115
18
Test-Command: debian/tests/touch-session-autopilot webbrowser_app
116
19
Restrictions: allow-stderr
117
20
Classes: ubuntu-touch
118
21
Depends: webbrowser-app-autopilot, autopkgtest, python3-evdev
119
22
120
23
Test-Command: debian/tests/touch-session-autopilot webapp_container
121
24
Restrictions: allow-stderr
122
25
Classes: ubuntu-touch
123
26
Depends: webapp-container-autopilot, autopkgtest, python3-evdev
124
0
27
125
=== added file 'debian/tests/touch-session-autopilot'
126
--- debian/tests/touch-session-autopilot	1970-01-01 00:00:00 +0000
127
+++ debian/tests/touch-session-autopilot	2015-05-18 21:41:52 +0000
128
@@ -0,0 +1,35 @@
129
1
#!/bin/sh
130
2
131
3
# Copyright 2015 Canonical
132
4
#
133
5
# This program is free software: you can redistribute it and/or modify it
134
6
# under the terms of the GNU General Public License version 3, as published
135
7
# by the Free Software Foundation.
136
8
#
137
9
# This program is distributed in the hope that it will be useful,
138
10
# but WITHOUT ANY WARRANTY; without even the implied warranty of
139
11
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
140
12
# GNU General Public License for more details.
141
13
#
142
14
# You should have received a copy of the GNU General Public License
143
15
# along with this program. If not, see <http://www.gnu.org/licenses/>.
144
16
145
17
# This runs the $1 autopilot suite ensuring that the testbed is configured
146
18
# properly
147
19
148
20
SUITE=$1
149
21
150
22
set -e
151
23
152
24
if ! pgrep -f unity-system-compositor ; then
153
25
   # We're not using Mir, setup enough of an X stack
154
26
155
27
   # FIXME: We won't need an X stack once Mir provides mirvfb or any other
156
28
   # mean to test consistently on all platforms -- vila 2015-04-22
157
29
   sudo -A ADT_NORMAL_USER=${USER} sh -e /usr/share/autopkgtest/setup-commands/ubuntu-touch-session
158
30
   # Import the environment produced above in the current shell
159
31
   set -a
160
32
   . /etc/environment
161
33
fi
162
34
163
35
autopilot3 run -v -f subunit -o ${ADT_ARTIFACTS} ${SUITE}
Status:	Rejected
Rejected by:	Olivier Tilloy on 2016-03-15
Proposed branch:	lp:~canonical-platform-qa/webbrowser-app/autopkgtest
Merge into:	lp:webbrowser-app
Diff against target:	163 lines (+118/-3) 3 files modified README (+57/-3) debian/tests/control (+26/-0) debian/tests/touch-session-autopilot (+35/-0)
To merge this branch:	bzr merge lp:~canonical-platform-qa/webbrowser-app/autopkgtest
Related bugs:	Link a bug report
Reviewer	Review Type	Date Requested	Status
Olivier Tilloy			Disapprove on 2016-03-15
PS Jenkins bot	continuous-integration		Needs Fixing on 2015-05-27
Martin Pitt		2015-04-20	Needs Fixing on 2015-05-05
Review via email: mp+256858@code.launchpad.net