Merge lp:~ubuntu-sdk-team/ubuntu-ui-toolkit/SEGFAULTingUnitTests into lp:ubuntu-ui-toolkit/staging

[Cris Dywan]

Allow SEGFAULTing tests to be flagged as exceptions

[ubuntu-sdk-build-bot (ubuntu-sdk-build-bot)]

FAILED: Continuous integration, rev:1941
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-armhf-stable/641/
Executed test runs:
    None: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2570/console

Click here to trigger a rebuild:
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-armhf-stable/641/rebuild

review: Needs Fixing (continuous-integration)

[ubuntu-sdk-build-bot (ubuntu-sdk-build-bot)]

FAILED: Continuous integration, rev:1941
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-amd64-devel/455/
Executed test runs:
    None: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2571/console

Click here to trigger a rebuild:
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-amd64-devel/455/rebuild

review: Needs Fixing (continuous-integration)

[ubuntu-sdk-build-bot (ubuntu-sdk-build-bot)]

FAILED: Continuous integration, rev:1941
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-amd64-stable/674/
Executed test runs:
    None: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2572/console

Click here to trigger a rebuild:
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-amd64-stable/674/rebuild

review: Needs Fixing (continuous-integration)

[ubuntu-sdk-build-bot (ubuntu-sdk-build-bot)]

FAILED: Continuous integration, rev:1941
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-i386-gles-stable/429/
Executed test runs:
    None: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2576/console

Click here to trigger a rebuild:
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-i386-gles-stable/429/rebuild

review: Needs Fixing (continuous-integration)

[ubuntu-sdk-build-bot (ubuntu-sdk-build-bot)]

FAILED: Continuous integration, rev:1941
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci/278/
Executed test runs:
    FAILURE: https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-armhf-stable/641/console
    FAILURE: https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-amd64-stable/674/console
    FAILURE: https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-amd64-devel/455/console
    FAILURE: https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci-i386-gles-stable/429/console
    None: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2577/console
    SUCCESS: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2570
    SUCCESS: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2572
    SUCCESS: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2571
    SUCCESS: https://jenkins.ubuntu.com/ubuntu-sdk/job/generic-update-mp/2576

Click here to trigger a rebuild:
https://jenkins.ubuntu.com/ubuntu-sdk/job/ubuntu-ui-toolkit-ci/278/rebuild

review: Needs Fixing (continuous-integration)

Unmerged revisions

1941. By Cris Dywan on 2016-04-13

Enable aggressive garbage collection for all unit tests

=== modified file 'tests/checkresults.sh'
--- tests/checkresults.sh	2016-04-08 16:49:52 +0000
+++ tests/checkresults.sh	2016-04-13 09:55:29 +0000
@@ -33,8 +33,8 @@
 
     EXCEPTIONS='tst_components_benchmark \
                 tst_tabbar.qml \
-                tst_datepicker.qml \
-                tst_datepicker13.qml \
+                tst_datepicker12.bug1567840.SEGFAULT.qml \
+                tst_datepicker13.bug1567840.SEGFAULT.qml \
                 tst_swipearea \
                 tst_qquick_image_extension \
                 tst_page.qml \

=== modified file 'tests/unit/runtest.sh'
--- tests/unit/runtest.sh	2016-04-11 11:15:58 +0000
+++ tests/unit/runtest.sh	2016-04-13 09:55:29 +0000
@@ -66,9 +66,9 @@
 function create_fallback_xml {
   cat << EOF > $_XML
 <?xml version="1.0" encoding="UTF-8" ?>
-<testsuite errors="1" failures="1" tests="1" name="$_TESTFILE">
+<testsuite errors="$1" failures="1" tests="1" name="$_TESTFILE">
   <testcase result="fail" name="${_TESTFILE}_Execution">
-    <failure message="$1" result="fail"/>
+    $2
   </testcase>
 </testsuite>
 EOF
@@ -112,12 +112,17 @@
     # https://bugs.launchpad.net/ubuntu-ui-toolkit/+bug/1256999
     # https://bugreports.qt-project.org/browse/QTBUG-36243
 	
+    QV4_MM_AGGRESSIVE_GC=1 \
     ALARM_BACKEND=memory SUPPRESS_DEPRECATED_NOTE=no \
     QT_LOGGING_RULES="[PERFORMANCE].warning=false" \
     $_CMD $_ARGS 2>&1 | grep -v 'QFontDatabase: Cannot find font directory'
     if [ ! -s $_XML ]; then
         # Write fallback in case it crashed and the file is empty
-        create_fallback_xml "Test results corrupted (crash)"
+        if [[ $_XML == *".SEGFAULT"* ]]; then
+            create_fallback_xml 0 '<!-- message="Test results corrupted (crashed)" type="qwarn" -->'
+        else
+            create_fallback_xml 1 '<failure message="Test results corrupted (crashed)" result="fail"/>'
+        fi
     fi
     if [ "x$UITK_TEST_KEEP_RUNNING" != "x1" ]; then
         ${BUILD_DIR}/tests/checkresults.sh $_XML
@@ -140,7 +145,7 @@
 }
 
 # Always create XML in case the test can't be run, eg. .so file missing
-create_fallback_xml "Test couldn't be run"
+create_fallback_xml 1 '<failure message="Test couldnt be run" result="fail"/>'
 create_test_cmd
 execute_test_cmd
 RESULT=$?

=== renamed file 'tests/unit_x11/tst_components/tst_datepicker12.qml.SEGFAULT.bug1567840' => 'tests/unit_x11/tst_components/tst_datepicker12.bug1567840.SEGFAULT.qml'
=== renamed file 'tests/unit_x11/tst_components/tst_datepicker13.SEGFAULT.bug1567840' => 'tests/unit_x11/tst_components/tst_datepicker13.bug1567840.SEGFAULT.qml'