Author: Daniel Manrique
Revision Date: 2019-04-19 01:25:24 UTC

Verify nagios checks in parallel.

This uses Python's futures module for minimal-change parallel execution of nagios checks; one parallel "juju ssh" is dispatched for each machine to check, and results are presented as they arrive. The logic and presentation stay the same otherwise.

I didn't declare futures as an explicit deb dependency (only in requirements.txt) because in the deb world, mojo depends on codetree which depends on futures, so they should always be there.

I added a couple of tests to verify the expected number of juju sshs is dispatched, and that the number of workers is properly calculated.

A possible refinement would be ability to specify a maximum number of workers; this could help if e.g. simultaneous juju ssh to a large number of units on a complex deployment causes any kind of trouble.

A couple of tweaks to the "juju ssh" command line were needed to avoid the display/pty getting borked when running several tasks in parallel, but I checked and they don't affect the visual output of things.

Reviewed-on: https://code.launchpad.net/~roadmr/mojo/parallel-nagios-check/+merge/366076
Reviewed-by: Stuart Bishop <stuart.bishop@canonical.com>

Author: Haw Loeung
Revision Date: 2019-04-17 06:48:29 UTC

charm-testing/content-cache: Updated config for updated charm rework

Reviewed-on: https://code.launchpad.net/~hloeung/mojo/mojo-specs-locations-locations/+merge/366155
Reviewed-by: Joel Sing <joel.sing@canonical.com>

Author: Tom Haddon
Revision Date: 2018-08-07 08:10:55 UTC

[mthaddon,trivial] merge trunk

Author: Chris MacNaughton
Revision Date: 2019-04-04 07:14:14 UTC

[chris.macnaughton, r=fnordahl] Add support for Disco

Author: Chris MacNaughton
Revision Date: 2019-04-04 06:22:37 UTC

Add support for Disco

Author: Thomas Cuthbert
Revision Date: 2019-02-07 23:26:51 UTC

update s-r-p URL

Author: Barry Price
Revision Date: 2019-02-01 03:50:13 UTC

Restored missed egrep flag

Author: Alexandre Gomes
Revision Date: 2018-09-27 21:42:49 UTC

Fix nrpe relation

Author: Nick Moffitt
Revision Date: 2018-08-23 13:13:24 UTC

this isn't the external agent

Author: Jacek Nykis
Revision Date: 2018-08-16 10:55:48 UTC

Test my charm

Author: Chris MacNaughton
Revision Date: 2018-07-25 12:38:29 UTC

exception output is a str already

Author: Chris MacNaughton
Revision Date: 2018-07-19 11:24:36 UTC

ensure our remote content is also stringified

Author: Laurent Sesques
Revision Date: 2018-07-18 14:44:51 UTC

Script phase: add retry and sleep options
Verify phase: remove retry and sleep (it inherits from Script)

Author: Chris MacNaughton
Revision Date: 2018-07-16 13:58:57 UTC

actually return a string, as documented

Author: Tom Haddon
Revision Date: 2018-07-16 11:54:19 UTC

charm-testing/cassandra: increase deployment timeout to allow cluster to bootstrap

Author: Chris MacNaughton
Revision Date: 2018-07-10 12:40:55 UTC

Add cosmic support

Author: Jamon Camisso
Revision Date: 2018-07-09 18:01:42 UTC

[jamon] test influxdb bionic

Author: Tom Haddon
Revision Date: 2018-06-19 14:08:07 UTC

Workers needed by collect phase

Author: <email address hidden>
Revision Date: 2018-06-15 06:33:34 UTC

Disable 1st nagios check until fix for version check lands

Author: Tom Haddon
Revision Date: 2018-06-14 11:53:11 UTC

Vault output status no longer includes semi-colon

Author: Haw Loeung
Revision Date: 2018-05-17 06:34:06 UTC

Use my copy for charm testing.

Author: Tom Haddon
Revision Date: 2018-03-21 17:40:51 UTC

Charm testing spec for squid-reverseproxy

Author: Tom Haddon
Revision Date: 2018-02-20 11:26:28 UTC

Remove specific relation with nrpe and postgresql-client

Author: Tom Haddon
Revision Date: 2018-02-19 12:55:39 UTC

Pin to PG 9.6 as Vault doesn't seem to support PG 10

Author: Tom Haddon
Revision Date: 2018-02-08 09:19:27 UTC

Use nrpe-external-master relation to ensure we generate checks

Author: Chris MacNaughton
Revision Date: 2018-02-05 16:24:24 UTC

cleanup error output

Author: Barry Price
Revision Date: 2018-02-02 04:28:06 UTC

Test branch: hard-code xenial charms for bionic testing (no upstream bionic charms yet)

Author: <email address hidden>
Revision Date: 2018-01-29 15:24:47 UTC

Convert max_wait to float to avoid 'TypeError: unorderable types: float() > str()'

Author: <email address hidden>
Revision Date: 2018-01-29 12:15:11 UTC

If universal_newlines=True then the output of Popen.communicate() is a string not a byte, so trying to decode it fails

Author: <email address hidden>
Revision Date: 2018-01-29 11:51:05 UTC

Decode subprocess.check_output if on py3

Author: Chris MacNaughton
Revision Date: 2018-01-25 14:10:04 UTC

ensure we decode command line output if needed

Author: Chris MacNaughton
Revision Date: 2018-01-18 11:04:39 UTC

Remove print((

Author: Ryan Beisner
Revision Date: 2018-01-18 10:03:30 UTC

Add tox for exercising in a pure python environment

Author: Tom Haddon
Revision Date: 2017-09-05 16:35:23 UTC

InfluxDB doesn't (yet) support the nrpe-external-master relation

Author: Tom Haddon
Revision Date: 2017-09-01 16:28:55 UTC

Rename environment and hostname to be more appropriate

Author: Chris MacNaughton
Revision Date: 2017-08-31 15:13:32 UTC

update bundle path for ceph-base

Author: Tom Haddon
Revision Date: 2017-08-28 16:40:25 UTC

Remove security groups as part of destroying the juju environment on juju 1 jenkins contrib script, due to lp#1333162

Author: Paul Collins
Revision Date: 2017-06-28 04:44:59 UTC

remove DRY-RUN prefix, monkey-patch codetree.config.Directive.__str__ for readable output

Author: Xav Paice
Revision Date: 2017-06-04 14:57:34 UTC

[xavpaice] Remove python-juju-deployer from package deps

Author: Barry Price
Revision Date: 2017-05-19 08:44:23 UTC

charm-testing/livepatch: Copy nrpe xenial options from nrpe

Author: Barry Price
Revision Date: 2017-05-11 03:55:38 UTC

Add an optional -w/--warn argument to output WARNING rather than CRITICAL for Juju status errors

Author: Paul Collins
Revision Date: 2017-05-10 05:17:12 UTC

mojo-testing: switch to a new personal branch, implement lint diffing, handle some errors

Author: Tim Kuhlman
Revision Date: 2017-05-09 22:54:32 UTC

Default to lxd for the container type on xenial and newer

Author: Tim Kuhlman
Revision Date: 2017-05-05 15:26:04 UTC

Mojo how to: Skip the ksplice check during verification.

Author: Tom Haddon
Revision Date: 2017-04-25 08:13:05 UTC

Update manifest comment to reflect the change

Author: Paul Collins
Revision Date: 2017-04-12 02:50:20 UTC

Juju2StatusTestCaseNoAutomaticallyRetryHooks: inherit from Juju2StatusTestCase so that all tests are run for both situations

Author: Tom Haddon
Revision Date: 2017-04-10 14:11:17 UTC

Add basic charm testing for cassandra

Author: Tom Haddon
Revision Date: 2017-04-05 15:21:41 UTC

We need a primary charm in the environment for any kind of useful testing, so just use the ubuntu charm

Author: James Hebden
Revision Date: 2017-03-23 08:26:56 UTC

[jhebden] Removed lost, down and blocked from error status after merge

Author: James Hebden
Revision Date: 2017-03-22 05:25:15 UTC

[jhebden] Merge lp:~pjdc/mojo/juju-2-no-fail-when-retrying-errors and lp:~pjdc/mojo/juju-wait-for-juju-2

Author: Benjamin Kaehne
Revision Date: 2017-03-03 00:50:08 UTC

[benk01,r=] - exit_code not being unpacked from command execution causing errors. Can also use the return code of the executed command to determine the ran command's output.

Author: Tom Haddon
Revision Date: 2017-01-11 14:24:11 UTC

[pjdc,r=mthaddon] support multiple local configs; update tests to suit. Addresses bug#1615974.

Author: Ryan Beisner
Revision Date: 2017-02-21 20:47:18 UTC

Add no_sudo cli flag

Author: Tim Kuhlman
Revision Date: 2016-12-06 15:48:51 UTC

Bump the required codetree version.

Author: Stuart Bishop
Revision Date: 2016-11-30 08:35:40 UTC

Don't embed juju-wait

Author: Tim Kuhlman
Revision Date: 2016-11-28 21:06:23 UTC

quick-integration tests are now working!

Author: Wes Mason
Revision Date: 2016-11-08 14:04:57 UTC

Ignore deps directory for working with build deps in repo

Author: Wes Mason
Revision Date: 2016-11-03 23:25:24 UTC

* [axino,r=mthaddon] mojo/juju/check.py: don't output to stderr, check_nrpe doesn't read it
* [barryprice,r=mthaddon] work around LXC issue 1237
* [timkuhlman,r=mthaddon] Fix return code and output file of juju-parse-status
* [barryprice,r=mthaddon] fix for polling for networking in LXC.
* [barryprice,r=mthaddon] poll for networking in LXC for up to 30 seconds.
* [timkuhlman,r=stub] Add a juju-check and juju-parse-status commands.
* [mthaddon,r=barryprice] Don't consider multiple versions of the same charm as an error, just a warning.
* [timkuhlman,r=mthaddon] A Jenkins run script for Juju2
* [fo0bar,r=mthaddon] Cherry picked patch from lp:juju-wait to speed up waits on large environments
* [timkuhlman,r=mthaddon] Update Juju2 set/get commands to match rc1
* [timkuhlman,r=mthaddon] Add support for Juju2 status and related commands
* [pjdc,r=timkuhlman] process_config_changes_from_diff: skip modified services with no config changes
* [timkuhlman,r=mthaddon] Add a script to run jenkins job for git based on one in use inside Canoncial
* [mthaddon,r=timkuhlman] Add a script to run jenkins job based on one in use inside Canonical
* [thedac,r=mthaddon] Take in environment variables named MOJO_ for deploy phase, and relax restrictions on required phases in a manifest
* [mthaddon,trivial] Fix script phase where we're hard coding variables to pass in a manifest
* [mthaddon,r=stub] If we don't have an environment variable set that we're trying to pass into a script, don't set it, but don't error out
* [mthaddon,r=timkuhlman] Expand environment variables in a script phase line in a manifest
* [mthaddon,r=stub] Add templating to codetree in mojo, so you can specify series in a collect file
* [bloodearnest, r=timkuhlman] Add bash completion, via argcomplete

Author: Chris Holcombe
Revision Date: 2016-10-07 18:00:21 UTC

Clean up lint warnings and add xenial series to testing

Author: Tim Kuhlman
Revision Date: 2016-10-06 14:59:31 UTC

[kuhlmant,r=trivial] Package update, adding juju-check and juju-parse-status commands

Author: Tim Kuhlman
Revision Date: 2016-10-03 20:36:55 UTC

Update the post-deploy script for juju2

Author: Tom Haddon
Revision Date: 2016-09-20 08:19:38 UTC

Merge trunk

Author: David Ames
Revision Date: 2016-08-16 23:22:48 UTC

Add first snapcraft.yaml

Author: Tom Haddon
Revision Date: 2016-07-28 14:53:33 UTC

Only do an upgrade test if we set UPGRADE_CHARM

Author: Brian Murray
Revision Date: 2016-03-02 21:36:05 UTC

fix typo in mojo/phase.py docs

Author: Caio Begotti
Revision Date: 2016-01-29 21:01:58 UTC

add a bit of explanation of what is and how to use repo_keys

Author: David Ames
Revision Date: 2016-01-21 15:36:04 UTC

WIP unprivileged containers

Author: Laurent Sesques
Revision Date: 2016-01-04 13:48:49 UTC

[sajoupa] missing .sh in filename, import os and refactored mojo.project import

Author: Laurent Sesques
Revision Date: 2016-01-04 10:08:51 UTC

[sajoupa] New manifest to update the site content, replaced sleep with check-juju, updated mojo_utils.py to get the needed functions

Author: Tom Haddon
Revision Date: 2015-12-21 09:52:29 UTC

Also need to remove from juju-intro

Author: Tom Haddon
Revision Date: 2015-12-02 08:51:58 UTC

Match a wider range of nrpe services

Author: Tom Haddon
Revision Date: 2015-11-18 09:02:57 UTC

Switch to only one IP on production so we can free up a floating IP for another service

Author: Tom Haddon
Revision Date: 2015-10-12 10:19:25 UTC

Add a comment when we've autodeployed so we can more easily look for this and report on it

Author: Tom Haddon
Revision Date: 2015-09-08 08:23:46 UTC

Add an e2e check for the site being up after initial install

Author: Tom Haddon
Revision Date: 2015-06-16 10:59:07 UTC

Update production IPs for deployment into new prodstack instance

Author: Liam Young
Revision Date: 2015-04-25 13:11:56 UTC

General tidy

Author: Nick Moffitt
Revision Date: 2015-04-24 13:32:24 UTC

Rename the 'manifest' file 'run', to match the filename pattern used by other mojo subcommands.
https://bugs.launchpad.net/mojo/+bug/1428533

Author: JuanJo Ciarlante
Revision Date: 2015-04-07 22:47:58 UTC

[jjo, r=] implement "retry=N" deploy option (juju-deployer -r N), and some pep8 fixes

Author: David Ames
Revision Date: 2015-04-16 23:27:19 UTC

Merge in auto repo and secrets

Author: Liam Young
Revision Date: 2015-02-27 16:49:47 UTC

Write default lxc conf and inc gid mapping

Author: Simon Davy
Revision Date: 2015-02-25 14:06:35 UTC

add delay option and docs