Merge lp:~lukas-kde/unity8/stabilizeFlakyWizardTest into lp:unity8

Proposed by Lukáš Tinkl on 2016-05-06
Status: Merged
Approved by: Michael Terry on 2016-05-06
Approved revision: 2397
Merged at revision: 2406
Proposed branch: lp:~lukas-kde/unity8/stabilizeFlakyWizardTest
Merge into: lp:unity8
Diff against target: 32 lines (+3/-12)
1 file modified
tests/qmltests/Wizard/tst_Wizard.qml (+3/-12)
To merge this branch: bzr merge lp:~lukas-kde/unity8/stabilizeFlakyWizardTest
Reviewer Review Type Date Requested Status
Unity8 CI Bot continuous-integration Needs Fixing on 2016-05-06
Michael Terry 2016-05-06 Approve on 2016-05-06
Review via email: mp+293999@code.launchpad.net

Commit Message

Stabilize flaky wizard tests

Description of the Change

Stabilize flaky wizard tests

Increase the timeout while waiting for a page to load a bit and make sure animations are settled.

To post a comment you must log in.
Unity8 CI Bot (unity8-ci-bot) wrote :

FAILED: Continuous integration, rev:2395
https://unity8-jenkins.ubuntu.com/job/lp-unity8-ci/1141/
Executed test runs:
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/test-0-autopkgtest/label=amd64,release=vivid+overlay,testname=qmluitests.sh/695
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/test-0-autopkgtest/label=amd64,release=xenial+overlay,testname=qmluitests.sh/695
    FAILURE: https://unity8-jenkins.ubuntu.com/job/test-0-autopkgtest/label=phone-armhf,release=vivid+overlay,testname=autopilot.sh/695/console
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-0-fetch/1533
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-1-sourcepkg/release=vivid+overlay/1493
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-1-sourcepkg/release=xenial+overlay/1493
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=amd64,release=vivid+overlay/1493
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=amd64,release=vivid+overlay/1493/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=amd64,release=xenial+overlay/1493
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=amd64,release=xenial+overlay/1493/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=armhf,release=vivid+overlay/1493
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=armhf,release=vivid+overlay/1493/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=armhf,release=xenial+overlay/1493
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=armhf,release=xenial+overlay/1493/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=i386,release=vivid+overlay/1493
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=i386,release=vivid+overlay/1493/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=i386,release=xenial+overlay/1493
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=i386,release=xenial+overlay/1493/artifact/output/*zip*/output.zip

Click here to trigger a rebuild:
https://unity8-jenkins.ubuntu.com/job/lp-unity8-ci/1141/rebuild

review: Needs Fixing (continuous-integration)
Michael Terry (mterry) wrote :

Might you want to move

+ var contentAnimation = findInvisibleChild(page, "contentAnimation");
+ tryCompareFunction(function() { return contentAnimation.running; }, false);

directly into the waitForPage() method so all tests benefit from the fix?

review: Needs Fixing
2396. By Lukáš Tinkl on 2016-05-06

move the animation test into waitForPage()

Lukáš Tinkl (lukas-kde) wrote :

> Might you want to move
>
> + var contentAnimation = findInvisibleChild(page,
> "contentAnimation");
> + tryCompareFunction(function() { return contentAnimation.running;
> }, false);
>
> directly into the waitForPage() method so all tests benefit from the fix?

Good idea, done

2397. By Lukáš Tinkl on 2016-05-06

... and below the check for the page name

Michael Terry (mterry) wrote :

OK looks good now. Could just use tryCompare instead of tryCompareFunction, but no biggie.

review: Approve
Unity8 CI Bot (unity8-ci-bot) wrote :

FAILED: Continuous integration, rev:2396
https://unity8-jenkins.ubuntu.com/job/lp-unity8-ci/1142/
Executed test runs:
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/test-0-autopkgtest/label=amd64,release=vivid+overlay,testname=qmluitests.sh/696
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/test-0-autopkgtest/label=amd64,release=xenial+overlay,testname=qmluitests.sh/696
    UNSTABLE: https://unity8-jenkins.ubuntu.com/job/test-0-autopkgtest/label=phone-armhf,release=vivid+overlay,testname=autopilot.sh/696
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-0-fetch/1534
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-1-sourcepkg/release=vivid+overlay/1494
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-1-sourcepkg/release=xenial+overlay/1494
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=amd64,release=vivid+overlay/1494
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=amd64,release=vivid+overlay/1494/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=amd64,release=xenial+overlay/1494
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=amd64,release=xenial+overlay/1494/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=armhf,release=vivid+overlay/1494
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=armhf,release=vivid+overlay/1494/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=armhf,release=xenial+overlay/1494
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=armhf,release=xenial+overlay/1494/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=i386,release=vivid+overlay/1494
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=i386,release=vivid+overlay/1494/artifact/output/*zip*/output.zip
    SUCCESS: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=i386,release=xenial+overlay/1494
        deb: https://unity8-jenkins.ubuntu.com/job/build-2-binpkg/arch=i386,release=xenial+overlay/1494/artifact/output/*zip*/output.zip

Click here to trigger a rebuild:
https://unity8-jenkins.ubuntu.com/job/lp-unity8-ci/1142/rebuild

review: Needs Fixing (continuous-integration)

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1=== modified file 'tests/qmltests/Wizard/tst_Wizard.qml'
2--- tests/qmltests/Wizard/tst_Wizard.qml 2016-04-27 15:01:10 +0000
3+++ tests/qmltests/Wizard/tst_Wizard.qml 2016-05-06 13:51:58 +0000
4@@ -144,7 +144,9 @@
5 var pages = findChild(wizard, "wizardPages");
6 var stack = findChild(pages, "pageStack");
7 // don't simply call tryCompare here, because stack.currentPage will be swapped out itself
8- tryCompareFunction(function() { return stack.currentPage.objectName; }, name);
9+ tryCompareFunction(function() { return stack.currentPage.objectName; }, name, 15000);
10+ var contentAnimation = findInvisibleChild(stack.currentPage, "contentAnimation");
11+ tryCompareFunction(function() { return contentAnimation.running; }, false);
12 tryCompare(stack.currentPage, "opacity", 1.0);
13 tryCompare(stack.currentPage, "enabled", true);
14 tryCompare(stack.currentPage, "skipValid", true);
15@@ -153,17 +155,6 @@
16 return stack.currentPage;
17 }
18
19- function verifyPageIsBlocked(name) {
20- var pages = findChild(wizard, "wizardPages");
21- var stack = findChild(pages, "pageStack");
22- // don't simply call tryCompare here, because stack.currentPage will be swapped out itself
23- tryCompareFunction(function() { return stack.currentPage.objectName; }, name);
24- tryCompare(stack.currentPage, "enabled", false);
25- tryCompare(stack.currentPage, "skipValid", false);
26- waitForRendering(stack.currentPage);
27- return stack.currentPage;
28- }
29-
30 function goToPage(name, skipSim, skipLocation, skipReporting) {
31 if (skipSim === undefined) {
32 skipSim = false;

Subscribers

People subscribed via source and target branches