Merge lp:~heber013/qa-jenkins-jobs/adding-job-test-proposed-package into lp:qa-jenkins-jobs

[Heber Parrucci]

Adding jobs to monitor when there is a new version of a package available and run the corresponding tests.

Adding jobs to monitor when there is a new version of a package available and run the corresponding tests.

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:311
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/197/
Executed test runs:
    FAILURE: https://platform-qa-jenkins.ubuntu.com/job/build-zesty-amd64-package/51/console
    FAILURE: https://platform-qa-jenkins.ubuntu.com/job/build-zesty-i386-package/51/console
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/2467/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/197/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:311
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/198/
Executed test runs:
    FAILURE: https://platform-qa-jenkins.ubuntu.com/job/build-zesty-amd64-package/52/console
    FAILURE: https://platform-qa-jenkins.ubuntu.com/job/build-zesty-i386-package/52/console
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/2469/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/198/rebuild

review: Needs Fixing (continuous-integration)

[Jean-Baptiste Lallement (jibel)]

Thanks. Approved!

review: Approve

=== added file 'jobs/ubuntu-system-tests/package-jobs.yaml'
--- jobs/ubuntu-system-tests/package-jobs.yaml	1970-01-01 00:00:00 +0000
+++ jobs/ubuntu-system-tests/package-jobs.yaml	2018-02-16 18:04:33 +0000
@@ -0,0 +1,237 @@
+# vim: sw=4 ts=4 et
+
+# QA Jenkins Jobs
+# Copyright 2018 Canonical Ltd.
+
+# This program is free software: you can redistribute it and/or modify it
+# under the terms of the GNU General Public License version 3, as published
+# by the Free Software Foundation.
+
+# This program is distributed in the hope that it will be useful, but
+# WITHOUT ANY WARRANTY; without even the implied warranties of
+# MERCHANTABILITY, SATISFACTORY QUALITY, or FITNESS FOR A PARTICULAR
+# PURPOSE.  See the GNU General Public License for more details.
+
+# You should have received a copy of the GNU General Public License along
+# with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+- project:
+    name: trigger-ust-package
+    flavor:
+        - ubuntu
+    model:
+        - desktop
+    release:
+        - bionic
+    node: iso-testing||venonat-upgrade
+    arch:
+        - amd64
+        - i386
+    jobs:
+        - 'trigger-ust-package-{flavor}-{release}-{model}-{arch}'
+        - 'ust-package-{flavor}-{release}-{model}-{arch}'
+
+- job-template:
+    name: 'trigger-ust-package-{flavor}-{release}-{model}-{arch}'
+    description: |
+      Check whether it is necesary to trigger tests for a package
+    triggers:
+      - daily
+    node: iso-testing||venonat-upgrade
+    parameters:
+        - ubuntu-system-tests-common-parameters:
+            release: '{release}'
+            model: '{model}'
+            flavor: '{flavor}'
+            arch: '{arch}'
+        - string:
+            name: SHARED_IMG_PATH
+            default: '/var/cache/ust/img/{release}-{model}-{arch}.img'
+            description: 'The disk image path.'
+        - string:
+            name: UBUNTU_SYSTEM_TESTS_BRANCH
+            default: lp:ubuntu-system-tests
+            description: Launchpad branch of ubuntu-system-tests from which to run tests.
+        - string:
+            name: TESTS_TO_RUN
+            default: ubuntu_system_tests.tests.test_gnome_software
+            description: List of tests to run. Default run all tests.
+        - string:
+            name: QAKIT_BRANCH
+            default: lp:qakit
+            description: Launchpad branch of qakit project to use.
+        - string:
+            name: QAKIT_CONFIG
+            default:
+            description: Qakit config path
+        - string:
+            name: PACKAGE_NAME
+            default: gnome-software
+            description: Package name to check new version and run tests for.
+        - string:
+            name: POCKET
+            default: proposed
+            description: Pocket name to check new version and run tests for.
+    builders:
+        - clear-artifacts
+        - branch-bzr-project:
+            project-url: '$QAKIT_BRANCH'
+            project-name: 'qakit'
+        - shell: |
+            #!/bin/bash -ex
+            cd qakit
+            python2 -m qakit.ust.launch_tests_for_package --source_name $PACKAGE_NAME -p $POCKET --parameter PACKAGE_VERSION -d -j ust-package-$FLAVOR-$RELEASE-$MODEL-$ARCH -t $TESTS_TO_RUN -b $UBUNTU_SYSTEM_TESTS_BRANCH
+
+- job-template:
+    name: 'ust-package-{flavor}-{release}-{model}-{arch}'
+    description: 'Run tests against image.'
+    wrappers:
+      - timeout:
+          timeout: 120
+          fail: true
+    parameters:
+        - ubuntu-system-tests-common-parameters:
+            release: '{release}'
+            model: '{model}'
+            flavor: '{flavor}'
+            arch: '{arch}'
+        - ubuntu-system-tests-run-parameters:
+        - string:
+            name: PACKAGE_NAME
+            default: gnome-software
+            description: Package name to install and run tests for.
+        - string:
+            name: PACKAGE_VERSION
+            default:
+            description: Package version to install and run tests for.
+        - string:
+            name: POCKET
+            default: proposed
+            description: Pocket name to check new version and run tests for.
+        - bool:
+            name: CLEAN_DISK_IMG_AFTER_RUN
+            default: true
+            description: whether to delete the disk image at the end.
+    builders:
+        - clear-artifacts
+        - ust-set-common-variables
+        - ubuntu-system-tests-config-builder
+        - conditional-step:
+            condition-kind: shell
+            condition-command: |
+              #!/bin/bash
+              [ -z $SHARED_IMG_PATH ]
+            steps:
+                - shell: |
+                    #!/bin/bash
+                    GENERATED_IMG_PATH=/var/cache/ust/img/$(basename $WORKSPACE)-{release}-{model}-{arch}.img
+                    cat > $WORKSPACE/shared-var <<EOF
+                    GENERATED_IMG_PATH=$GENERATED_IMG_PATH
+                    EOF
+                - inject:
+                    properties-file: $WORKSPACE/shared-var
+                - trigger-builds:
+                    - project:
+                          - 'ust-build-image-{flavor}-{release}-{model}-{arch}'
+                      block: true
+                      node-parameters: true
+                      predefined-parameters: |
+                        SHARED_IMG_PATH=$GENERATED_IMG_PATH
+        - ubuntu-system-tests-run-tests-builder
+    publishers:
+        - archive:
+            artifacts: 'results/**/*'
+            allow-empty: 'true'
+        - postbuildscript:
+            builders:
+                - subunit-to-junit-results-builder
+                - grafana-info:
+                    device: 'vm'
+                    model: '{model}'
+                    os: '{flavor}'
+                    release: '{release}'
+                    arch: '{arch}'
+                    class: "$PACKAGE_NAME/$POCKET"
+                    conf: ''
+                - grafana-tests-upload:
+                    results_type: 'pyunit'
+                    results_file: 'results/*.pyunit'
+                    info_file: 'global_info.json'
+            script-only-if-succeeded: False
+            script-only-if-failed: False
+        - junit:
+            results: 'results/test-results.xml'
+            test-stability: 'true'
+
+- parameter:
+    name: ubuntu-system-tests-common-parameters
+    parameters:
+        - string:
+            name: FLAVOR
+            default: '{flavor}'
+            description: Distribution flavor, default ubuntu.
+        - string:
+            name: ARCH
+            default: '{arch}'
+            description: Architecture of hardware.
+        - string:
+            name: RELEASE
+            default: '{release}'
+            description: Release version tested.
+        - string:
+            name: MODEL
+            default: '{model}'
+            description: Name of model.
+        - string:
+            name: CONFIG_SECTION
+            description: The config section to use
+            default: default
+        - string:
+            name: https_proxy
+            description: The https proxy to use
+            default: https://squid.internal:3128
+
+- parameter:
+    name: ubuntu-system-tests-run-parameters
+    parameters:
+        - string:
+            name: UBUNTU_SYSTEM_TESTS_BRANCH
+            default: lp:ubuntu-system-tests
+            description: Launchpad branch of ubuntu-system-tests from which to run tests.
+        - string:
+            name: TESTS_TO_RUN
+            default: ubuntu_system_tests.tests
+            description: List of tests to run. Default run all tests.
+        - string:
+            name: SHARED_IMG_PATH
+            description: The disk image path.
+
+- builder:
+    name: ust-set-common-variables
+    builders:
+        - shell:
+            !include-raw: 'ust-set-common-variables.sh'
+
+- builder:
+    name: ubuntu-system-tests-config-builder
+    builders:
+        - shell:
+            !include-raw: 'ubuntu-system-tests-config-builder.sh'
+
+- builder:
+    name: ubuntu-system-tests-image-builder
+    builders:
+        - shell:
+            !include-raw: 'ubuntu-system-tests-image-builder.sh'
+
+- builder:
+    name: ubuntu-system-tests-run-tests-builder
+    builders:
+        - shell:
+            !include-raw: 'ubuntu-system-tests-run-tests-builder.sh'
+
+- builder:
+    name: subunit-to-junit-results-builder
+    builders:
+        - shell:
+            !include-raw: 'subunit-to-junit.sh'

=== modified file 'jobs/ubuntu-system-tests/ubuntu-system-tests-run-tests-builder.sh'
--- jobs/ubuntu-system-tests/ubuntu-system-tests-run-tests-builder.sh	2017-08-28 15:09:06 +0000
+++ jobs/ubuntu-system-tests/ubuntu-system-tests-run-tests-builder.sh	2018-02-16 18:04:33 +0000
@@ -37,7 +37,11 @@
 python3 setup.py develop
 
 # Run setup on the image to install tests dependencies
-python3 -m ubuntu_system_tests.run setup --headless --silent --config $CONFIG_PATH --img $SHARED_IMG_PATH -e $CONFIG_SECTION
+parameters="ubuntu_system_tests.run setup --headless --silent --config $CONFIG_PATH --img $SHARED_IMG_PATH -e $CONFIG_SECTION"
+if [ ! -z ${PACKAGE_NAME+x} ]; then
+    parameters="$parameters --install-packages $PACKAGE_NAME/$RELEASE-$POCKET"
+fi
+python3 -m ${parameters}
 rs=$?
 #if something failed in the setup, exit with failure
 [ $rs != 0 ] && exit $rs