Merge lp:~canonical-platform-qa/qa-jenkins-jobs/add-regression-list into lp:qa-jenkins-jobs

[Allan LeSage]

Add ust regression tests list.

See https://code.launchpad.net/~canonical-platform-qa/ubuntu-system-tests/add-regression-list/+merge/300375 , this just takes advantage of the now-explicit regression tests list so that we can re-run each individual test on error.

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:162
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/21/
Executed test runs:
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/2914
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/2914/artifact/work/output/*zip*/output.zip
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/2914
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/2914/artifact/work/output/*zip*/output.zip
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/439/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/21/rebuild

review: Approve (continuous-integration)

[Max Brustkern (nuclearbob)]

This looks good. If the other branch doesn't land, will the output be a failure, or can we make it just be empty? If it's still empty, will the other stuff work as expected? If not, we should make sure the regression list lands.

On the subject of the other merge, if I were maintaining that, I'd probably land it reluctantly and then work on a solution to generate the list automatically with minimal dependencies, but that might take a while.

[Allan LeSage (allanlesage)]

Too late, the other branch landed! Your criticism is welcome on the other branch Max but I'm going to use the "because pragmatism" argument, with a less maintenance-heavy solution being discussed with rhuddie.

[Max Brustkern (nuclearbob)]

Looks good!

review: Approve

=== modified file 'jobs/ubuntu-system-tests/ubuntu-system-tests-builder.sh'
--- jobs/ubuntu-system-tests/ubuntu-system-tests-builder.sh	2016-05-26 22:22:08 +0000
+++ jobs/ubuntu-system-tests/ubuntu-system-tests-builder.sh	2016-07-18 18:15:16 +0000
@@ -21,7 +21,7 @@
 
 case "$TESTS_TO_RUN" in
   "regression")
-    TESTS_TO_RUN=""
+    TESTS_TO_RUN=$(bzr cat "$UBUNTU_SYSTEM_TESTS_BRANCH/test_lists/regression.tests" | tr '\n' ' ')
     ;;
   "sanity")
     TESTS_TO_RUN=$(bzr cat "$UBUNTU_SYSTEM_TESTS_BRANCH/test_lists/sanity.tests" | tr '\n' ' ')