Merge lp:~osomon/notes-app/fix-swipe-to-delete-tests into lp:notes-app

Proposed by Olivier Tilloy
Status: Merged
Merged at revision: 219
Proposed branch: lp:~osomon/notes-app/fix-swipe-to-delete-tests
Merge into: lp:notes-app
Diff against target: 44 lines (+11/-7)
1 file modified
tests/autopilot/notes_app/tests/test_delete.py (+11/-7)
To merge this branch: bzr merge lp:~osomon/notes-app/fix-swipe-to-delete-tests
Reviewer Review Type Date Requested Status
PS Jenkins bot continuous-integration Needs Fixing
Ubuntu Phablet Team Pending
Review via email: mp+193177@code.launchpad.net

Commit message

Fix the slide-to-delete tests by ensuring that the confirmation button is where we expect it to be before clicking it.

To post a comment you must log in.
Revision history for this message
PS Jenkins bot (ps-jenkins) wrote :

FAILED: Continuous integration, rev:218
http://jenkins.qa.ubuntu.com/job/notes-app-ci/230/
Executed test runs:
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty/181
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty-touch/175/console
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-amd64-ci/12
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/12
        deb: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/12/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-i386-ci/12
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/170
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/181
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/181/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/175
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/175/artifact/work/output/*zip*/output.zip
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-maguro/2798/console
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-mako/2849/console
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/636
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/635

Click here to trigger a rebuild:
http://10.97.0.26:8080/job/notes-app-ci/230/rebuild

review: Needs Fixing (continuous-integration)
Revision history for this message
PS Jenkins bot (ps-jenkins) wrote :

FAILED: Continuous integration, rev:218
http://jenkins.qa.ubuntu.com/job/notes-app-ci/231/
Executed test runs:
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty/206
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty-touch/200/console
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-amd64-ci/13
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/13
        deb: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/13/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-i386-ci/13
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/193
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/206
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/206/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/200
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/200/artifact/work/output/*zip*/output.zip
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-maguro/2821/console
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-mako/2872/console
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/682
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/681

Click here to trigger a rebuild:
http://10.97.0.26:8080/job/notes-app-ci/231/rebuild

review: Needs Fixing (continuous-integration)
219. By Olivier Tilloy

Be more consistent in the swipe gestures.

Revision history for this message
PS Jenkins bot (ps-jenkins) wrote :

FAILED: Continuous integration, rev:219
http://jenkins.qa.ubuntu.com/job/notes-app-ci/232/
Executed test runs:
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty/211
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty-touch/205/console
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-amd64-ci/14
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/14
        deb: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/14/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-i386-ci/14
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/198
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/211
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/211/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/205
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/205/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-maguro/2825
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-mako/2876/console
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/691
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/690

Click here to trigger a rebuild:
http://10.97.0.26:8080/job/notes-app-ci/232/rebuild

review: Needs Fixing (continuous-integration)
Revision history for this message
PS Jenkins bot (ps-jenkins) wrote :

FAILED: Continuous integration, rev:219
http://jenkins.qa.ubuntu.com/job/notes-app-ci/233/
Executed test runs:
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty/215
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty-touch/209
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-amd64-ci/15
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/15
        deb: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/15/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-i386-ci/15
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/202
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/215
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/215/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/209
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/209/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-maguro/2830
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-mako/2881
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/700
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/698

Click here to trigger a rebuild:
http://10.97.0.26:8080/job/notes-app-ci/233/rebuild

review: Needs Fixing (continuous-integration)
Revision history for this message
Francis Ginther (fginther) wrote :

There could be a regression in autopilot exposed on the otto run. I reran the job, but removed the daily-build ppa and all the tests passed:
https://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/210/
https://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/215/

I also tested with lp:notes-app, first with the PPA:
https://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/207/

and then without:
https://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/209/

But runs had failures, but the run without the PPA only had the one.

I tried a few other projects, but didn't see any noticeable differences between runs with and without the PPA. Also, some projects (notably ubuntu-ui-toolkit) are passing with the PPA.

I've made some inquires to the desktop integration team to find out what might have changed. Will try to update here if I learn anything.

Revision history for this message
Olivier Tilloy (osomon) wrote :

Thanks Francis for the detailed investigation.
Is the daily-build PPA disabled from the CI config for notes-app now? If not, can we remove it?

Revision history for this message
Francis Ginther (fginther) wrote :

> Thanks Francis for the detailed investigation.
> Is the daily-build PPA disabled from the CI config for notes-app now? If not,
> can we remove it?

I will do that as a short term solution. In general we want to avoid this as it makes resolving build dependencies harder and forces issues to just move from upstream merger to daily release integration testing. In other words, we may be able to get your change in trunk, but it might be blocked by the same problem in daily release testing.

Revision history for this message
Olivier Tilloy (osomon) wrote :

> > Thanks Francis for the detailed investigation.
> > Is the daily-build PPA disabled from the CI config for notes-app now? If
> not,
> > can we remove it?
>
> I will do that as a short term solution. In general we want to avoid this as
> it makes resolving build dependencies harder and forces issues to just move
> from upstream merger to daily release integration testing. In other words, we
> may be able to get your change in trunk, but it might be blocked by the same
> problem in daily release testing.

I’m fine with keeping the PPA enabled, but then we need to understand why building with it fails, and we need to fix the problem. Any idea which dependencies are breaking those tests? Or can you point me to the relevant logs so I can look into it myself?

Revision history for this message
PS Jenkins bot (ps-jenkins) wrote :

FAILED: Continuous integration, rev:219
http://jenkins.qa.ubuntu.com/job/notes-app-ci/236/
Executed test runs:
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty/228
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty-touch/220
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-amd64-ci/18
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/18
        deb: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/18/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-i386-ci/18
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/219
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/228
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/228/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/220
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/220/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-maguro/2841
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-mako/2892
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/727
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/726

Click here to trigger a rebuild:
http://10.97.0.26:8080/job/notes-app-ci/236/rebuild

review: Needs Fixing (continuous-integration)
Revision history for this message
PS Jenkins bot (ps-jenkins) wrote :

FAILED: Continuous integration, rev:219
http://jenkins.qa.ubuntu.com/job/notes-app-ci/237/
Executed test runs:
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty/233
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-trusty-touch/225/console
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-amd64-ci/19
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/19
        deb: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-armhf-ci/19/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/notes-app-trusty-i386-ci/19
    UNSTABLE: http://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-trusty/224
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/233
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-amd64/233/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/225
        deb: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-builder-trusty-armhf/225/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-maguro/2847
    FAILURE: http://jenkins.qa.ubuntu.com/job/generic-mediumtests-runner-mako/2898/console
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/740
    SUCCESS: http://10.97.0.26:8080/job/touch-flash-device/741

Click here to trigger a rebuild:
http://10.97.0.26:8080/job/notes-app-ci/237/rebuild

review: Needs Fixing (continuous-integration)
Revision history for this message
Francis Ginther (fginther) wrote :

I was wrong about this being related to autopilot. I was able to reproduce the failures on my local system, but not by upgrading autopilot, but by upgrading qtdeclarative5-ubuntu-ui-toolkit-plugin. I have not dug into this any further, but I did file a bug:

https://bugs.launchpad.net/ubuntu-ui-toolkit/+bug/1246564

Revision history for this message
Olivier Tilloy (osomon) wrote :

Thanks for nailing this Francis. This is in fact a duplicate of bug #1244523, for which a MR is already pending.

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1=== modified file 'tests/autopilot/notes_app/tests/test_delete.py'
2--- tests/autopilot/notes_app/tests/test_delete.py 2013-10-10 09:30:43 +0000
3+++ tests/autopilot/notes_app/tests/test_delete.py 2013-10-30 15:48:05 +0000
4@@ -9,7 +9,7 @@
5
6 from __future__ import absolute_import
7
8-from testtools.matchers import Equals
9+from testtools.matchers import Equals, GreaterThan, LessThan
10 from autopilot.matchers import Eventually
11
12 from notes_app.tests import NotesAppTestCase, DatabaseMixin
13@@ -50,10 +50,12 @@
14
15 # Verify that sliding the note right removes the note
16 x, y, w, h = note.globalRect
17- tx = x + (w / 8)
18- ty = y + (h / 2)
19- self.pointing_device.drag(tx, ty, w, ty)
20+ ty = int(y + h / 2)
21+ self.pointing_device.drag(int(x + 0.1 * w), ty, int(x + 0.9 * w), ty)
22 confirm = self.main_window.get_note_delete_confirmation_button(note)
23+ xmax = note.globalRect[0] + note.globalRect[2] / 4
24+ self.assertThat(lambda: confirm.globalRect[0],
25+ Eventually(LessThan(xmax)))
26 self.pointing_device.click_object(confirm)
27
28 self.assertThat(
29@@ -64,10 +66,12 @@
30
31 # Verify that sliding the note left removes the note
32 x, y, w, h = note.globalRect
33- tx = x + (w - w / 8)
34- ty = y + (h / 2)
35- self.pointing_device.drag(tx, ty, w / 2, ty)
36+ ty = int(y + h / 2)
37+ self.pointing_device.drag(int(x + 0.9 * w), ty, int(x + 0.1 * w), ty)
38 confirm = self.main_window.get_note_delete_confirmation_button(note)
39+ xmin = note.globalRect[0] + note.globalRect[2] / 2
40+ self.assertThat(lambda: confirm.globalRect[0],
41+ Eventually(GreaterThan(xmin)))
42 self.pointing_device.click_object(confirm)
43
44 self.assertThat(

Subscribers

People subscribed via source and target branches