autopilot tests fail on newly flashed devices because GRID_UNIT_PX is not set

Bug #1627056 reported by Olivier Tilloy
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
ubuntu-touch-session (Ubuntu)
Fix Released
High
Łukasz Zemczak
webbrowser-app (Ubuntu)
Invalid
High
Olivier Tilloy

Bug Description

The autopilot tests for webbrowser_app have been failing in CI (system-apps jenkins instance) for about a month.
Before that they reliably passed.
They are being run on a krillin device that is being flashed anew for every single run. The device hasn’t changed.

The last known successful run was on August 10: https://jenkins.canonical.com/system-apps/job/test-0-autopkgtest/243/.

The next run on a webbrowser-app branch didn’t happen until August 27, and it failed: https://jenkins.canonical.com/system-apps/job/test-0-autopkgtest/308/.

Something happened in between those two dates that broke the tests.
It might be something in the infrastructure rather than in webbrowser-app itself, given that the tests all pass when run on my krillin at home.

I am attaching the full log for the first failing run on August 27.

Related branches

Revision history for this message
Olivier Tilloy (osomon) wrote :
Revision history for this message
Olivier Tilloy (osomon) wrote :

On the webbrowser-app side, 8 branches landed on the 25th of August (https://bazaar.launchpad.net/~phablet-team/webbrowser-app/trunk/revision/1527). None of these branches immediately stand out as potential culprits.

On the system-apps jenkins instance side (https://code.launchpad.net/~system-apps-team/system-apps-jenkins/+git/system-apps-jenkins/+ref/master), nothing happened in this time frame.

Changed in webbrowser-app (Ubuntu):
status: New → Confirmed
Revision history for this message
Olivier Tilloy (osomon) wrote :

46 of the failures share this common stack trace:

  File "/usr/lib/python3/dist-packages/webbrowser_app/tests/__init__.py", line 138, in open_tabs_view
    tabs_view = self.main_window.get_tabs_view()
  File "/usr/lib/python3/dist-packages/webbrowser_app/emulators/browser.py", line 129, in get_tabs_view
    return self.wait_select_single(TabsList, visible=True)
  File "/usr/lib/python3/dist-packages/autopilot/introspection/dbus.py", line 369, in wait_select_single
    raise StateNotFoundError(type_name, **kwargs)
autopilot.exceptions.StateNotFoundError: Object not found with name '<class 'webbrowser_app.emulators.browser.TabsList'>' and properties {'visible': True}.

Revision history for this message
Olivier Tilloy (osomon) wrote :

What fails is most likely the call to self.drag_bottom_edge_upwards(0.75) in open_tabs_view().

Olivier Tilloy (osomon)
Changed in webbrowser-app (Ubuntu):
assignee: nobody → Olivier Tilloy (osomon)
Olivier Tilloy (osomon)
Changed in webbrowser-app (Ubuntu):
importance: Undecided → High
Revision history for this message
Olivier Tilloy (osomon) wrote :

I can reproduce the failures on my arale after reflashing it with --bootstrap.
I did some bisecting, and the issue started happening with image 406 (http://people.canonical.com/~lzemczak/landing-team/ubuntu-touch/rc-proposed/meizu.en/arale/406.commitlog).

Revision history for this message
Olivier Tilloy (osomon) wrote :

I’m attaching the commit log for image 406 (arale), which contains numerous changes.

Revision history for this message
Olivier Tilloy (osomon) wrote :

When flashing image 405 (with --bootstrap) and then upgrading to image 406 with:

  ubuntu-device-flash touch --channel=ubuntu-touch/rc-proposed/meizu.en --revision 406

then the autopilot tests pass. So there is something when bootstrapping image 406 and higher, which doesn’t happen when simply upgrading older images.

Revision history for this message
Olivier Tilloy (osomon) wrote :

It appears that the regression was introduced by the change to ubuntu-touch-session: https://bazaar.launchpad.net/~phablet-team/ubuntu-touch-session/trunk/revision/288.

If I set the value of GRID_UNIT_PX in ~/.profile on the device and reboot, the tests pass again.

Olivier Tilloy (osomon)
Changed in ubuntu-touch-session (Ubuntu):
assignee: nobody → Łukasz Zemczak (sil2100)
Changed in webbrowser-app (Ubuntu):
status: Confirmed → Invalid
summary: - 48 webbrowser_app autopilot test failures on krillin in CI
+ autopilot tests fail on newly flashed devices because GRID_UNIT_PX is
+ not set
Changed in ubuntu-touch-session (Ubuntu):
status: New → In Progress
importance: Undecided → High
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package ubuntu-touch-session - 0.108+16.10.20161011-0ubuntu1

---------------
ubuntu-touch-session (0.108+16.10.20161011-0ubuntu1) yakkety; urgency=medium

  [ Łukasz 'sil2100' Zemczak ]
  * Re-add the GRID_UNIT_PX .profile addition as it seems to be required
    by some autopilot tests. (LP: #1627056)

 -- Łukasz Zemczak <email address hidden> Tue, 11 Oct 2016 10:23:10 +0000

Changed in ubuntu-touch-session (Ubuntu):
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.