Code review comment for lp:~nskaggs/music-app/fix-shuffle-test

Revision history for this message
Andrew Hayzen (ahayzen) wrote :

Not sure how useful this is, but I ran autopilot with this branch on a Nexus 4 five times and got the following results.

First run:
Ran 8 tests in 200.609s
OK

Second run:
Traceback (most recent call last):
File "/home/phablet/autopilot/music_app/tests/test_music.py", line 146, in test_previous_and_mp3
self.assertThat(title, Eventually(Equals("TestMP3Title")))
File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 412, in assertThat
raise MismatchError(matchee, matcher, mismatch, verbose)
MismatchError: After 10.0 seconds test failed: 'TestMP3Title' != u'Swansong'

Ran 8 tests in 214.126s
FAILED (failures=1)

Third run:
Traceback (most recent call last):
File "/home/phablet/autopilot/music_app/tests/test_music.py", line 168, in test_shuffle
self.assertThat(self.main_view.random, Eventually(Equals(True)))
File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 412, in assertThat
raise MismatchError(matchee, matcher, mismatch, verbose)
MismatchError: After 10.0 seconds test on MainView.random failed: True != dbus.Boolean(False, variant_level=1)

Ran 8 tests in 199.545s
FAILED (failures=1)

Fourth run:
Ran 8 tests in 199.184s
OK

Fifth run:
Traceback (most recent call last):
File "/home/phablet/autopilot/music_app/tests/test_music.py", line 168, in test_shuffle
self.assertThat(self.main_view.random, Eventually(Equals(True)))
File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 412, in assertThat
raise MismatchError(matchee, matcher, mismatch, verbose)
MismatchError: After 10.0 seconds test on MainView.random failed: True != dbus.Boolean(False, variant_level=1)

Ran 8 tests in 201.106s
FAILED (failures=1)

If you need any more information please let me know.

« Back to merge proposal