Merge lp:~canonical-platform-qa/qa-jenkins-jobs/add-vis-job into lp:qa-jenkins-jobs

[Allan LeSage]

Add a basic 'vis' job which stores Jenkins build/test info from qakit in a mongo instance, generates HTML graphics and rsyncs to cranberry.

Add a basic 'vis' job which stores Jenkins build/test info from qakit in a mongo instance, generates HTML graphics and rsyncs to cranberry.

[Max Brustkern (nuclearbob)]

I think right now, auto updates would overwrite the default rsync password. Can we setup an ssh key or store a credentials file on the jenkins slave and source that as part of the job? Other than that, looks good to me.

review: Needs Information

[Allan LeSage (allanlesage)]

Explain more about "auto updates would overwrite the default rsync password." I'd prefer not to set up a key.

[Max Brustkern (nuclearbob)]

I think every time the jobs get deployed, they'll deploy this:
       - string:
           name: RSYNC_PASSWORD
           default:
description: The rsync password used to send vis data to cranberry via role account
and set the default value for RSYNC_PASSWORD to be blank again.

[Allan LeSage (allanlesage)]

Ok, the rsync password enables rsync to a "role account" on cranberry, can you explain or do you know how a key would help in this case?

[Max Brustkern (nuclearbob)]

We should still be able to use a password if you want, we'll just want a file with something like:
export RSYNC_PASSWORD=whatever
and then in the job:
. /path/to/that/file

A passwordless key is theoretically marginally more secure than that since it involves more encryption, but for something that's always on the internal network, it shouldn't make much difference.

[Allan LeSage (allanlesage)]

Path to which file?

[Max Brustkern (nuclearbob)]

The file that contains the password.

[platform-qa-bot (platform-qa-bot)]

FAILED: Continuous integration, rev:52
No commit message was specified in the merge proposal. Click on the following link and set the commit message (if you want a jenkins rebuild you need to trigger it yourself):
https://code.launchpad.net/~canonical-platform-qa/qa-jenkins-jobs/add-vis-job/+merge/297236/+edit-commit-message

https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/2/
Executed test runs:
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/369
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/369/artifact/work/output/*zip*/output.zip
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/369
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/369/artifact/work/output/*zip*/output.zip
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/324/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/2/rebuild

review: Needs Fixing (continuous-integration)

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:52
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/6/
Executed test runs:
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/376
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/376/artifact/work/output/*zip*/output.zip
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/376
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/376/artifact/work/output/*zip*/output.zip
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/330/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/6/rebuild

review: Approve (continuous-integration)

[lp:~canonical-platform-qa/qa-jenkins-jobs/add-vis-job]

53. By Allan LeSage on 2016-07-08

Merge trunk.

54. By Allan LeSage on 2016-07-08

Updates.

[Allan LeSage (allanlesage)]

Moved to a password-file as suggested, also updated for new datatables-based vis.

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:54
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/15/
Executed test runs:
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/466
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/466/artifact/work/output/*zip*/output.zip
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/466
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/466/artifact/work/output/*zip*/output.zip
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/402/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/15/rebuild

review: Approve (continuous-integration)

[Max Brustkern (nuclearbob)]

A few diff questions, but I think this looks pretty much good.

[lp:~canonical-platform-qa/qa-jenkins-jobs/add-vis-job]

55. By Allan LeSage on 2016-07-11

Merge trunk.

56. By Allan LeSage on 2016-07-11

Max' suggestions.

[platform-qa-bot (platform-qa-bot)]

PASSED: Continuous integration, rev:56
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/16/
Executed test runs:
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/470
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-amd64-package/470/artifact/work/output/*zip*/output.zip
    SUCCESS: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/470
        deb: https://platform-qa-jenkins.ubuntu.com/job/build-wily-i386-package/470/artifact/work/output/*zip*/output.zip
    None: https://platform-qa-jenkins.ubuntu.com/job/generic-update-mp/405/console

Click here to trigger a rebuild:
https://platform-qa-jenkins.ubuntu.com/job/qa-jenkins-jobs-ci/16/rebuild

review: Approve (continuous-integration)

[Max Brustkern (nuclearbob)]

Ship it!

review: Approve

=== added directory 'jobs/vis'
=== added file 'jobs/vis/jobs.yaml'
--- jobs/vis/jobs.yaml	1970-01-01 00:00:00 +0000
+++ jobs/vis/jobs.yaml	2016-07-11 17:50:59 +0000
@@ -0,0 +1,36 @@
+# vim: sw=4 ts=4 et
+
+# QA Jenkins Jobs
+# Copyright 2016 Canonical Ltd.
+
+# This program is free software: you can redistribute it and/or modify it
+# under the terms of the GNU General Public License version 3, as published
+# by the Free Software Foundation.
+
+# This program is distributed in the hope that it will be useful, but
+# WITHOUT ANY WARRANTY; without even the implied warranties of
+# MERCHANTABILITY, SATISFACTORY QUALITY, or FITNESS FOR A PARTICULAR
+# PURPOSE.  See the GNU General Public License for more details.
+
+# You should have received a copy of the GNU General Public License along
+# with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+- project:
+    name: vis
+    jobs:
+        - 'vis'
+
+- job:
+    name: 'vis'
+    description: |
+        Retrieve Jenkins build data, generate HTML representation of test status.
+    parameters:
+        - string:
+            name: QAKIT_BRANCH
+            default: lp:qakit
+            description: Launchpad branch from which to run qakit scripts.
+    builders:
+        - shell:
+            !include-raw: 'vis.sh'
+    triggers:
+        - timed: "@hourly"

=== added file 'jobs/vis/vis.sh'
--- jobs/vis/vis.sh	1970-01-01 00:00:00 +0000
+++ jobs/vis/vis.sh	2016-07-11 17:50:59 +0000
@@ -0,0 +1,32 @@
+
+export https_proxy="https://squid.internal:3128/"
+
+virtualenv --python=python3 ve3
+. ve3/bin/activate
+pip3 install jenkinsapi
+pip3 install bson
+pip3 install pymongo
+
+rm -rf qakit
+bzr branch $QAKIT_BRANCH qakit
+cd qakit
+
+python3 qakit/vis/retrieve_jenkins_results.py -v --mongo-host $MONGO_HOST --jenkins-url https://platform-qa-jenkins.ubuntu.com/ -p ust_
+
+mkdir -p ${WORKSPACE}/results
+rm -rf ${WORKSPACE}/results/*
+python3 qakit/vis/visualize.py --mongo-host $MONGO_HOST -o ${WORKSPACE}/results/ust_rc-proposed_krillin_sanity.html ust_rc-proposed_krillin_sanity
+python3 qakit/vis/visualize.py --mongo-host $MONGO_HOST -o ${WORKSPACE}/results/ust_rc-proposed_krillin_regression.html ust_rc-proposed_krillin_regression
+python3 qakit/vis/visualize.py --mongo-host $MONGO_HOST -o ${WORKSPACE}/results/ust_rc-proposed_arale_sanity.html ust_rc-proposed_arale_sanity
+python3 qakit/vis/visualize.py --mongo-host $MONGO_HOST -o ${WORKSPACE}/results/ust_rc-proposed_arale_regression.html ust_rc-proposed_arale_regression
+python3 qakit/vis/visualize.py --mongo-host $MONGO_HOST -o ${WORKSPACE}/results/ust_rc_krillin_sanity.html ust_rc_krillin_sanity
+python3 qakit/vis/visualize.py --mongo-host $MONGO_HOST -o ${WORKSPACE}/results/ust_rc_krillin_regression.html ust_rc_krillin_regression
+python3 qakit/vis/visualize.py --mongo-host $MONGO_HOST -o ${WORKSPACE}/results/ust_rc_arale_sanity.html ust_rc_arale_sanity
+python3 qakit/vis/visualize.py --mongo-host $MONGO_HOST -o ${WORKSPACE}/results/ust_rc_arale_regression.html ust_rc_arale_regression
+
+deactivate
+
+rsync -avz --delete --password-file $JENKINS_HOME/.secret/cranberry-rsync-password --ignore-times $WORKSPACE/results/* [e-mail]::jenkaas-qa-reports/vis
+
+# also do a deployment
+rsync -avz --delete --password-file $JENKINS_HOME/.secret/cranberry-rsync-password --ignore-times $WORKSPACE/qakit/vis/*.html [e-mail]::jenkaas-qa-reports/vis