Ubuntu
unity8 package

Three consistent autopilot test failures

Bug #1446846 reported by Michał Sawicz
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
unity8 (Ubuntu)
Fix Released
High
Nick Dedekind
Vivid
New
Undecided
Unassigned

Bug Description

We seem to have stabilized on three tests failing repeatedly:

unity8.indicators.tests.test_action_latency.TestClientRevertsToServerValue.test_slider_reverts_on_late_response(Native Device)
unity8.application_lifecycle.tests.test_application_lifecycle.ApplicationLifecycleTests.test_greeter_hides_on_app_open
unity8.indicators.tests.test_action_latency.TestBuffering.test_slider_buffers_activations(Native Device)

Example run:

https://jenkins.qa.ubuntu.com/job/generic-deb-autopilot-runner-vivid-mako/2076/#showFailuresLink

The two latency ones are relatively new tests, the lifecycle one seems to be a new consistent failure.

What's even more important is that they're reliably reproducible locally using the steps below:

http://ubuntu-test-cases-touch.readthedocs.org/en/latest/

ProblemType: Bug
DistroRelease: Ubuntu 15.04
Package: unity8 8.02+15.04.20150409.1-0ubuntu1
ProcVersionSignature: Ubuntu 3.19.0-13.13-generic 3.19.3
Uname: Linux 3.19.0-13-generic x86_64
ApportVersion: 2.17.2-0ubuntu1
Architecture: amd64
CurrentDesktop: Unity
Date: Tue Apr 21 22:18:54 2015
SourcePackage: unity8
SystemImageInfo:
 current build number: 0
 device name:
 channel: daily
 last update: Unknown
UpgradeStatus: No upgrade log present (probably fresh install)

See original description

Related branches

lp:~nick-dedekind/unity8/fix-autopilot-failures-1446846
PS Jenkins bot (community): Needs Fixing (continuous-integration)
Michael Zanetti (community): Needs Fixing
Albert Astals Cid (community): Approve
Diff: 226 lines (+96/-20)
3 files modified
tests/autopilot/unity8/application_lifecycle/tests/test_application_lifecycle.py (+13/-3)
tests/autopilot/unity8/indicators/tests/test_action_latency.py (+4/-2)
tests/mocks/indicator-service/mock-indicator-service.c (+79/-15)
lp:~canonical-platform-qa/unity8/fix1446846-test_slider_revert
On hold for merging into lp:unity8
Leo Arias (community): Disapprove
Albert Astals Cid (community): Needs Fixing
PS Jenkins bot (community): Needs Fixing (continuous-integration)
Diff: 26 lines (+8/-2)
1 file modified
tests/autopilot/unity8/indicators/__init__.py (+8/-2)
lp:~nick-dedekind/ubuntu-settings-components/fix-maximumWaitBufferInterval
Albert Astals Cid (community): Approve
PS Jenkins bot (community): Approve (continuous-integration)
Registry Administrators: Pending requested
Diff: 313 lines (+84/-57)
3 files modified
plugins/Ubuntu/Settings/Components/serverpropertysynchroniser.cpp (+60/-41)
plugins/Ubuntu/Settings/Components/serverpropertysynchroniser.h (+5/-2)
tests/qmltests/Components/tst_ServerPropertySynchroniser.qml (+19/-14)
lp:ubuntu/wily/unity8
Revision history for this message
Michał Sawicz (saviq) wrote :
description: updated
Revision history for this message
Michał Sawicz (saviq) wrote :

I think I realized why the lifecycle test fails - the fake app in fixture is suspended as soon as it's launched (because screen is locked if you have a passcode/password, as we do on a phone provisioned with the CI script), and the following dbus introspection timeouts are from the app, not from unity8.

Revision history for this message
Leo Arias (elopio) wrote :

unity8.indicators.tests.test_action_latency.TestClientRevertsToServerValue.test_slider_reverts_on_late_response fails because the wait_for is placed after the finger touch is released. As the slider reverts the value, if the next statement is not fast enough it will find the original value instead of the new one.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package unity8 - 8.02+15.10.20150518.1-0ubuntu1

---------------
unity8 (8.02+15.10.20150518.1-0ubuntu1) wily; urgency=medium

  [ Albert Astals Cid ]
  * Add overrides to override functions
  * Implement "rating-edit" preview widget (LP: #1318144)
  * Make the DashContent::test_mainNavigation test more stable (LP:
    #1450809)
  * Use art height as implicitHeight when the header is overlayed and
    there's no summary

  [ CI Train Bot ]
  * New rebuild forced.
  * Resync trunk.

  [ Daniel d'Andrada ]
  * Introducing FloatingFlickable
  * Make Ubuntu.Gestures components install TouchRegistry by themselves

  [ Michael Terry ]
  * Fix a possible crash in our PAM threading code. (LP: #1425362) (LP:
    #1425362)
  * Fix the lockscreen becoming unresponsive after testing an app on the
    device from QtCreator. (LP: #1435364)

  [ Nick Dedekind ]
  * Fixed desktop stage app focus.
  * Fixed issue in laggy indicator autpilot tests (LP: #1446846)

 -- CI Train Bot <email address hidden> Mon, 18 May 2015 23:04:39 +0000

Changed in unity8 (Ubuntu):
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.