Merge lp:~larry-e-works/uci-engine/write-exitcode-to-file into lp:uci-engine

[Larry E Works]

Write adt-run exitcode into a file in the results directory.

Added bits to write the exit code to the results. Relevant trello task is: https://trello.com/c/sN5Awtbr/101-0-5-testrunner-to-create-a-file-with-the-exitcode-to-be-part-of-test-results

[Paul Larson (pwlars)]

A couple of small comments

review: Needs Fixing

[Francis Ginther (fginther)]

As Paul mentioned, instead of using the explicit open/close as in:

    exitcode = open(ec_path, 'w')
    exitcode.write(ec)
    exitcode.close()

You can use the context manager style to write:

    with open(ec_path, 'w') as exitcode:
        exitcode.write(ec)

I don't know if there is a preferred name for the exit_code file. The one chosen looks good to me.

[Francis Ginther (fginther)]

looks good.

review: Approve

[Paul Larson (pwlars)]

+1

review: Approve

[Evan (ev)]

review: Needs Fixing

[Ubuntu CI Bot (uci-bot)]

There are additional revisions which have not been approved in review. Please seek review and approval of these new revisions.

[Vincent Ladeuil (vila)]

Hmm, some administrativia to follow

review: Approve

[Ubuntu CI Bot (uci-bot)]

The attempt to merge lp:~larry-e-works/uci-engine/write-exitcode-to-file into lp:uci-engine failed. Below is the output from the failed tests.

Checking juju status
Private PPAs: disabled
Preparing local branch upload...
Uploading local branch, fingerprint 30005b74130e4bea60cbc29b15908ded57f599d3
Installing keys from bzr+ssh://bazaar.launchpad.net/~ci-engineering-private/+junk/ci-airline-dev-keys/
Running juju-deployer -v -c /tmp/tmpt0kA7i/deployer/relations.yaml -c /tmp/tmpt0kA7i/deployer/services.yaml ci-airline
Checking juju status
Private PPAs: disabled
Preparing local branch upload...
Reusing local branch, fingerprint 30005b74130e4bea60cbc29b15908ded57f599d3
Installing keys from bzr+ssh://bazaar.launchpad.net/~ci-engineering-private/+junk/ci-airline-dev-keys/
Running juju-deployer -v -c /tmp/tmpcHUCUF/deployer/relations.yaml -c /tmp/tmpcHUCUF/deployer/services.yaml ci-ubuntucore
Tests running...
ci-utils.ci_utils.tests.test_amqp.TestAMQP.testConnectFailed ... OK (0.002 secs)
ci-utils.ci_utils.tests.test_amqp.TestAMQP.testProcessQueue ... OK (0.002 secs)
ci-utils.ci_utils.tests.test_amqp.TestAMQP.testRunForever ... OK (0.102 secs)
ci-utils.ci_utils.tests.test_amqp.TestAMQP.testSent ... OK (0.003 secs)
ci-utils.ci_utils.tests.test_amqp.TestProgressTrigger.testProgress ... OK (0.001 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testCancel ... OK (0.105 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testNoQueue ... OK (0.003 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testNoTicket ... OK (0.003 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testOnMessageCalledProcessError ... OK (0.005 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testOnMessageDataStoreException ... OK (0.002 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testOnMessageFail ... OK (0.002 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testOnMessageKilled ... OK (0.002 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testOnMessageSimple ... OK (0.003 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testOnMessageUnexpected ... OK (0.003 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestAMQPWorker.testSaveLastRun ... OK (0.015 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestTimer.testCBRuns ... OK (0.021 secs)
ci-utils.ci_utils.tests.test_amqp_worker.TestTimer.testCanCancel ... OK (0.001 secs)
ci-utils.ci_utils.tests.test_data_store.TestDataStoreConfig.test_invalid_auth_config ... OK (0.000 secs)
ci-utils.ci_utils.tests.test_data_store.TestDataStoreConfig.test_valid_auth_config ... OK (0.000 secs)
ci-utils.ci_utils.tests.test_data_store.TestDataStoreFileName.test_abspath ... OK (0.000 secs)
ci-utils.ci_utils.tests.test_data_store.TestDataStoreFileName.test_basename ... OK (0.000 secs)
ci-utils.ci_utils.tests.test_data_store.TestDataStoreFileName.test_relpath ... OK (0.000 secs)
ci-utils.ci_utils.tests.test_deployer.TestDeployer.test_load_empty_single_config ... OK (0.002 secs)
ci-utils.ci_utils.tests.test_deployer.TestDeployer.test_load_multiple_config ... OK (0.008 secs)
ci-utils.ci_utils.tests.test_deployer.TestDeployer.test_load_single_con...

Unmerged revisions

924. By Larry E Works on 2015-01-20

Added bits to ensure results directory exists per Evan's comment to previous MP. Used os.makedirs instead of os.mkdir as it will ensure all intermediate-level directories are created. While this is not currently needed it may be when the test runner is modified to copy all results to swift.

923. By Larry E Works on 2015-01-16

Incorporated Pauls recommendation to user context manager instead of the explicit open/close.

922. By Larry E Works on 2015-01-16

Added the bit to put the exit code in the results directory.

921. By Larry E Works on 2015-01-14

Added bits to write the test exitcode to a file.

=== modified file 'test_runner/tstrun/run_test.py'
--- test_runner/tstrun/run_test.py	2014-10-17 12:28:14 +0000
+++ test_runner/tstrun/run_test.py	2015-01-20 20:20:33 +0000
@@ -22,6 +22,16 @@
 import unittest
 
 
+def mk_results_dir(results_dir):
+    try:
+       os.makedirs(results_dir)
+    except OSError as exc:
+        if exc.errno == errno.EEXISTS and os.path.isdir(results_dir):
+            pass
+        else:
+            raise
+
+
 def run(*args, **kwargs):
     """Run a command in a subprocess.
 
@@ -188,6 +198,11 @@
                     '-H', ip, '-l', login, '-i', ssh_key_path])
         proc, _, _ = run(*cmd, check_rc=False)
         rc = proc.returncode
+        ec = str(rc)
+        mk_results_dir('results')
+        ec_path = os.path.join('results', 'exit_code')
+        with open(ec_path, 'w') as exitcode:
+            exitcode.write(ec)
         pkg_version = package_version('results')
         deps_versions = aggregate_versions('results')
         for name, status in parse_summary(summary_path):