Merge lp:~brad-marshall/charms/trusty/keystone/add-nrpe-checks into lp:~openstack-charmers-archive/charms/trusty/keystone/trunk

[Brad Marshall]

Adds nrpe-external-master interface and adds basic nrpe checks.

[Ryan Beisner (1chb1n)]

UOSCI bot says:
charm_lint_check #1000 trusty-keystone for brad-marshall mp241492
    LINT FAIL: lint-test failed

LINT Results (max last 5 lines):
  hooks/keystone_hooks.py:377:80: E501 line too long (92 > 79 characters)
  hooks/keystone_hooks.py:398:18: E251 unexpected spaces around keyword / parameter equals
  hooks/keystone_hooks.py:398:20: E251 unexpected spaces around keyword / parameter equals
  hooks/keystone_hooks.py:403:1: E302 expected 2 blank lines, found 1
  make: *** [lint] Error 1

Full lint test output: http://paste.ubuntu.com/8955819/
Build: http://10.98.191.181:8080/job/charm_lint_check/1000/

[Ryan Beisner (1chb1n)]

UOSCI bot says:
charm_unit_test #835 trusty-keystone for brad-marshall mp241492
    UNIT FAIL: unit-test failed

UNIT Results (max last 5 lines):
  hooks/keystone_utils 387 202 48% 204, 218, 242-247, 290-299, 306-321, 328-336, 341-351, 358-384, 389-398, 403-417, 422-444, 449-466, 480-503, 512-517, 522, 529-539, 544-552, 557-562, 566-573, 581-586, 597-612, 616-624, 649-650, 729, 732, 781-794, 818-822, 826-838
  TOTAL 826 431 48%
  Ran 37 tests in 3.096s
  FAILED (errors=5)
  make: *** [unit_test] Error 1

Full unit test output: http://paste.ubuntu.com/8955821/
Build: http://10.98.191.181:8080/job/charm_unit_test/835/

[Ryan Beisner (1chb1n)]

UOSCI bot says:
charm_amulet_test #380 trusty-keystone for brad-marshall mp241492
    AMULET FAIL: amulet-test failed

AMULET Results (max last 5 lines):
  WARNING cannot delete security group "juju-osci-sv05". Used by another environment?
  WARNING cannot delete security group "juju-osci-sv05-0". Used by another environment?
  juju-test INFO : Results: 1 passed, 2 failed, 0 errored
  ERROR subprocess encountered error code 2
  make: *** [test] Error 2

Full amulet test output: http://paste.ubuntu.com/8956016/
Build: http://10.98.191.181:8080/job/charm_amulet_test/380/

[lp:~brad-marshall/charms/trusty/keystone/add-nrpe-checks]

93. By Brad Marshall on 2014-11-17

[bradm] Added sysvinit daemon monitoring, switched to using services() instead of hard coded list, pep8 fixes

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_lint_check #1090 trusty-keystone for brad-marshall mp241492
    LINT OK: passed

LINT Results (max last 5 lines):
  I: config.yaml: option ssl_ca has no default value
  I: config.yaml: option os-public-network has no default value
  I: config.yaml: option os-admin-network has no default value
  I: config.yaml: option ssl_cert has no default value
  I: config.yaml: option os-internal-network has no default value

Full lint test output: http://paste.ubuntu.com/9052175/
Build: http://10.98.191.181:8080/job/charm_lint_check/1090/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_unit_test #924 trusty-keystone for brad-marshall mp241492
    UNIT FAIL: unit-test failed

UNIT Results (max last 5 lines):
  hooks/keystone_utils 392 206 47% 204, 218, 225-228, 250-255, 298-307, 314-329, 336-344, 349-359, 366-392, 397-406, 411-425, 430-452, 457-474, 488-511, 520-525, 530, 537-547, 552-560, 565-570, 574-581, 589-594, 605-620, 624-632, 657-658, 737, 740, 789-802, 826-830, 834-846
  TOTAL 844 448 47%
  Ran 37 tests in 3.298s
  FAILED (errors=5)
  make: *** [unit_test] Error 1

Full unit test output: http://paste.ubuntu.com/9052185/
Build: http://10.98.191.181:8080/job/charm_unit_test/924/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_amulet_test #432 trusty-keystone for brad-marshall mp241492
    AMULET FAIL: amulet-test failed

AMULET Results (max last 5 lines):
  juju-test.conductor DEBUG : Calling "juju destroy-environment -y osci-sv05"
  WARNING cannot delete security group "juju-osci-sv05-0". Used by another environment?
  juju-test INFO : Results: 1 passed, 2 failed, 0 errored
  ERROR subprocess encountered error code 2
  make: *** [test] Error 2

Full amulet test output: http://paste.ubuntu.com/9052270/
Build: http://10.98.191.181:8080/job/charm_amulet_test/432/

[lp:~brad-marshall/charms/trusty/keystone/add-nrpe-checks]

94. By Brad Marshall on 2014-11-17

[bradm] Removed puppet header from nagios_plugin module

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_lint_check #1101 trusty-keystone for brad-marshall mp241492
    LINT OK: passed

LINT Results (max last 5 lines):
  I: config.yaml: option ssl_ca has no default value
  I: config.yaml: option os-public-network has no default value
  I: config.yaml: option os-admin-network has no default value
  I: config.yaml: option ssl_cert has no default value
  I: config.yaml: option os-internal-network has no default value

Full lint test output: http://paste.ubuntu.com/9053001/
Build: http://10.98.191.181:8080/job/charm_lint_check/1101/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_unit_test #935 trusty-keystone for brad-marshall mp241492
    UNIT FAIL: unit-test failed

UNIT Results (max last 5 lines):
  hooks/keystone_utils 392 206 47% 204, 218, 225-228, 250-255, 298-307, 314-329, 336-344, 349-359, 366-392, 397-406, 411-425, 430-452, 457-474, 488-511, 520-525, 530, 537-547, 552-560, 565-570, 574-581, 589-594, 605-620, 624-632, 657-658, 737, 740, 789-802, 826-830, 834-846
  TOTAL 844 448 47%
  Ran 37 tests in 3.299s
  FAILED (errors=5)
  make: *** [unit_test] Error 1

Full unit test output: http://paste.ubuntu.com/9053006/
Build: http://10.98.191.181:8080/job/charm_unit_test/935/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_amulet_test #443 trusty-keystone for brad-marshall mp241492
    AMULET FAIL: amulet-test failed

AMULET Results (max last 5 lines):
  juju-test.conductor DEBUG : Calling "juju destroy-environment -y osci-sv07"
  WARNING cannot delete security group "juju-osci-sv07-0". Used by another environment?
  juju-test INFO : Results: 1 passed, 2 failed, 0 errored
  ERROR subprocess encountered error code 2
  make: *** [test] Error 2

Full amulet test output: http://paste.ubuntu.com/9053047/
Build: http://10.98.191.181:8080/job/charm_amulet_test/443/

[lp:~brad-marshall/charms/trusty/keystone/add-nrpe-checks]

95. By Brad Marshall on 2014-11-18

[bradm] Removed nagios check files that were moved to nrpe-external-master charm

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_lint_check #1117 trusty-keystone for brad-marshall mp241492
    LINT FAIL: lint-test failed

LINT Results (max last 5 lines):
INFO:root:Searching for: ['@flake8']
INFO:root:command: make -f Makefile lint
ERROR:root:Make target returned non-zero.
  hooks/keystone_hooks.py:411:13: F841 local variable 'checkpath' is assigned to but never used
  make: *** [lint] Error 1

Full lint test output: http://paste.ubuntu.com/9063894/
Build: http://10.98.191.181:8080/job/charm_lint_check/1117/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_unit_test #951 trusty-keystone for brad-marshall mp241492
    UNIT FAIL: unit-test failed

UNIT Results (max last 5 lines):
  hooks/keystone_utils 392 206 47% 204, 218, 225-228, 250-255, 298-307, 314-329, 336-344, 349-359, 366-392, 397-406, 411-425, 430-452, 457-474, 488-511, 520-525, 530, 537-547, 552-560, 565-570, 574-581, 589-594, 605-620, 624-632, 657-658, 737, 740, 789-802, 826-830, 834-846
  TOTAL 844 448 47%
  Ran 37 tests in 3.149s
  FAILED (errors=5)
  make: *** [unit_test] Error 1

Full unit test output: http://paste.ubuntu.com/9063910/
Build: http://10.98.191.181:8080/job/charm_unit_test/951/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_amulet_test #459 trusty-keystone for brad-marshall mp241492
    AMULET FAIL: amulet-test failed

AMULET Results (max last 5 lines):
  WARNING cannot delete security group "juju-osci-sv07". Used by another environment?
  WARNING cannot delete security group "juju-osci-sv07-0". Used by another environment?
  juju-test INFO : Results: 1 passed, 2 failed, 0 errored
  ERROR subprocess encountered error code 2
  make: *** [test] Error 2

Full amulet test output: http://paste.ubuntu.com/9064014/
Build: http://10.98.191.181:8080/job/charm_amulet_test/459/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_lint_check #1251 trusty-keystone for brad-marshall mp241492
    LINT FAIL: lint-test failed

LINT Results (max last 5 lines):
INFO:root:Searching for: ['@flake8']
INFO:root:command: make -f Makefile lint
ERROR:root:Make target returned non-zero.
  hooks/keystone_hooks.py:411:13: F841 local variable 'checkpath' is assigned to but never used
  make: *** [lint] Error 1

Full lint test output: http://paste.ubuntu.com/9281306/
Build: http://10.98.191.181:8080/job/charm_lint_check/1251/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_unit_test #1085 trusty-keystone for brad-marshall mp241492
    UNIT FAIL: unit-test failed

UNIT Results (max last 5 lines):
  hooks/keystone_utils 392 206 47% 204, 218, 225-228, 250-255, 298-307, 314-329, 336-344, 349-359, 366-392, 397-406, 411-425, 430-452, 457-474, 488-511, 520-525, 530, 537-547, 552-560, 565-570, 574-581, 589-594, 605-620, 624-632, 657-658, 737, 740, 789-802, 826-830, 834-846
  TOTAL 844 448 47%
  Ran 37 tests in 3.447s
  FAILED (errors=5)
  make: *** [unit_test] Error 1

Full unit test output: http://paste.ubuntu.com/9281315/
Build: http://10.98.191.181:8080/job/charm_unit_test/1085/

[uosci-testing-bot (uosci-testing-bot)]

UOSCI bot says:
charm_amulet_test #554 trusty-keystone for brad-marshall mp241492
    AMULET FAIL: amulet-test failed

AMULET Results (max last 5 lines):
  WARNING cannot delete security group "juju-osci-sv05-0". Used by another environment?
  WARNING cannot delete security group "juju-osci-sv05". Used by another environment?
  juju-test INFO : Results: 1 passed, 2 failed, 0 errored
  ERROR subprocess encountered error code 2
  make: *** [test] Error 2

Full amulet test output: http://paste.ubuntu.com/9281431/
Build: http://10.98.191.181:8080/job/charm_amulet_test/554/

[Liam Young (gnuoy)]

Thank for the mp. The new nrpe support is very gratefully received !

I've taken this branch and centralised the common code between this and the other nrpe branches and moved it to charm-helpers. To land it I created a new branch from this one which has now been merged into the 'next' charm. The 'next' charms will overwrite the stable ones in a couple of weeks.

review: Disapprove

=== modified file 'charm-helpers-hooks.yaml'
--- charm-helpers-hooks.yaml	2014-10-02 09:12:13 +0000
+++ charm-helpers-hooks.yaml	2014-11-18 01:15:03 +0000
@@ -12,3 +12,4 @@
     - payload.execd
     - contrib.peerstorage
     - contrib.network.ip
+    - contrib.charmsupport

=== modified file 'config.yaml'
--- config.yaml	2014-10-07 12:29:11 +0000
+++ config.yaml	2014-11-18 01:15:03 +0000
@@ -218,3 +218,14 @@
       The CPU core multiplier to use when configuring worker processes for
       Keystone.  By default, the number of workers for each daemon is set to
       twice the number of CPU cores a service unit has.
+  nagios_context:
+    default: "juju"
+    type: string
+    description: |
+      Used by the nrpe-external-master subordinate charm.
+      A string that will be prepended to instance name to set the host name
+      in nagios. So for instance the hostname would be something like:
+          juju-myservice-0
+      If you're running multiple environments with the same services in them
+      this allows you to differentiate between them.
+

=== added directory 'files'
=== added directory 'hooks/charmhelpers/contrib/charmsupport'
=== added file 'hooks/charmhelpers/contrib/charmsupport/__init__.py'
=== added file 'hooks/charmhelpers/contrib/charmsupport/nrpe.py'
--- hooks/charmhelpers/contrib/charmsupport/nrpe.py	1970-01-01 00:00:00 +0000
+++ hooks/charmhelpers/contrib/charmsupport/nrpe.py	2014-11-18 01:15:03 +0000
@@ -0,0 +1,222 @@
+"""Compatibility with the nrpe-external-master charm"""
+# Copyright 2012 Canonical Ltd.
+#
+# Authors:
+#  Matthew Wedgwood <[e-mail]>
+
+import subprocess
+import pwd
+import grp
+import os
+import re
+import shlex
+import yaml
+
+from charmhelpers.core.hookenv import (
+    config,
+    local_unit,
+    log,
+    relation_ids,
+    relation_set,
+)
+
+from charmhelpers.core.host import service
+
+# This module adds compatibility with the nrpe-external-master and plain nrpe
+# subordinate charms. To use it in your charm:
+#
+# 1. Update metadata.yaml
+#
+#   provides:
+#     (...)
+#     nrpe-external-master:
+#       interface: nrpe-external-master
+#       scope: container
+#
+#   and/or
+#
+#   provides:
+#     (...)
+#     local-monitors:
+#       interface: local-monitors
+#       scope: container
+
+#
+# 2. Add the following to config.yaml
+#
+#    nagios_context:
+#      default: "juju"
+#      type: string
+#      description: |
+#        Used by the nrpe subordinate charms.
+#        A string that will be prepended to instance name to set the host name
+#        in nagios. So for instance the hostname would be something like:
+#            juju-myservice-0
+#        If you're running multiple environments with the same services in them
+#        this allows you to differentiate between them.
+#
+# 3. Add custom checks (Nagios plugins) to files/nrpe-external-master
+#
+# 4. Update your hooks.py with something like this:
+#
+#    from charmsupport.nrpe import NRPE
+#    (...)
+#    def update_nrpe_config():
+#        nrpe_compat = NRPE()
+#        nrpe_compat.add_check(
+#            shortname = "myservice",
+#            description = "Check MyService",
+#            check_cmd = "check_http -w 2 -c 10 http://localhost"
+#            )
+#        nrpe_compat.add_check(
+#            "myservice_other",
+#            "Check for widget failures",
+#            check_cmd = "/srv/myapp/scripts/widget_check"
+#            )
+#        nrpe_compat.write()
+#
+#    def config_changed():
+#        (...)
+#        update_nrpe_config()
+#
+#    def nrpe_external_master_relation_changed():
+#        update_nrpe_config()
+#
+#    def local_monitors_relation_changed():
+#        update_nrpe_config()
+#
+# 5. ln -s hooks.py nrpe-external-master-relation-changed
+#    ln -s hooks.py local-monitors-relation-changed
+
+
+class CheckException(Exception):
+    pass
+
+
+class Check(object):
+    shortname_re = '[A-Za-z0-9-_]+$'
+    service_template = ("""
+#---------------------------------------------------
+# This file is Juju managed
+#---------------------------------------------------
+define service {{
+    use                             active-service
+    host_name                       {nagios_hostname}
+    service_description             {nagios_hostname}[{shortname}] """
+                        """{description}
+    check_command                   check_nrpe!{command}
+    servicegroups                   {nagios_servicegroup}
+}}
+""")
+
+    def __init__(self, shortname, description, check_cmd):
+        super(Check, self).__init__()
+        # XXX: could be better to calculate this from the service name
+        if not re.match(self.shortname_re, shortname):
+            raise CheckException("shortname must match {}".format(
+                Check.shortname_re))
+        self.shortname = shortname
+        self.command = "check_{}".format(shortname)
+        # Note: a set of invalid characters is defined by the
+        # Nagios server config
+        # The default is: illegal_object_name_chars=`~!$%^&*"|'<>?,()=
+        self.description = description
+        self.check_cmd = self._locate_cmd(check_cmd)
+
+    def _locate_cmd(self, check_cmd):
+        search_path = (
+            '/',
+            os.path.join(os.environ['CHARM_DIR'],
+                         'files/nrpe-external-master'),
+            '/usr/lib/nagios/plugins',
+            '/usr/local/lib/nagios/plugins',
+        )
+        parts = shlex.split(check_cmd)
+        for path in search_path:
+            if os.path.exists(os.path.join(path, parts[0])):
+                command = os.path.join(path, parts[0])
+                if len(parts) > 1:
+                    command += " " + " ".join(parts[1:])
+                return command
+        log('Check command not found: {}'.format(parts[0]))
+        return ''
+
+    def write(self, nagios_context, hostname):
+        nrpe_check_file = '/etc/nagios/nrpe.d/{}.cfg'.format(
+            self.command)
+        with open(nrpe_check_file, 'w') as nrpe_check_config:
+            nrpe_check_config.write("# check {}\n".format(self.shortname))
+            nrpe_check_config.write("command[{}]={}\n".format(
+                self.command, self.check_cmd))
+
+        if not os.path.exists(NRPE.nagios_exportdir):
+            log('Not writing service config as {} is not accessible'.format(
+                NRPE.nagios_exportdir))
+        else:
+            self.write_service_config(nagios_context, hostname)
+
+    def write_service_config(self, nagios_context, hostname):
+        for f in os.listdir(NRPE.nagios_exportdir):
+            if re.search('.*{}.cfg'.format(self.command), f):
+                os.remove(os.path.join(NRPE.nagios_exportdir, f))
+
+        templ_vars = {
+            'nagios_hostname': hostname,
+            'nagios_servicegroup': nagios_context,
+            'description': self.description,
+            'shortname': self.shortname,
+            'command': self.command,
+        }
+        nrpe_service_text = Check.service_template.format(**templ_vars)
+        nrpe_service_file = '{}/service__{}_{}.cfg'.format(
+            NRPE.nagios_exportdir, hostname, self.command)
+        with open(nrpe_service_file, 'w') as nrpe_service_config:
+            nrpe_service_config.write(str(nrpe_service_text))
+
+    def run(self):
+        subprocess.call(self.check_cmd)
+
+
+class NRPE(object):
+    nagios_logdir = '/var/log/nagios'
+    nagios_exportdir = '/var/lib/nagios/export'
+    nrpe_confdir = '/etc/nagios/nrpe.d'
+
+    def __init__(self, hostname=None):
+        super(NRPE, self).__init__()
+        self.config = config()
+        self.nagios_context = self.config['nagios_context']
+        self.unit_name = local_unit().replace('/', '-')
+        if hostname:
+            self.hostname = hostname
+        else:
+            self.hostname = "{}-{}".format(self.nagios_context, self.unit_name)
+        self.checks = []
+
+    def add_check(self, *args, **kwargs):
+        self.checks.append(Check(*args, **kwargs))
+
+    def write(self):
+        try:
+            nagios_uid = pwd.getpwnam('nagios').pw_uid
+            nagios_gid = grp.getgrnam('nagios').gr_gid
+        except:
+            log("Nagios user not set up, nrpe checks not updated")
+            return
+
+        if not os.path.exists(NRPE.nagios_logdir):
+            os.mkdir(NRPE.nagios_logdir)
+            os.chown(NRPE.nagios_logdir, nagios_uid, nagios_gid)
+
+        nrpe_monitors = {}
+        monitors = {"monitors": {"remote": {"nrpe": nrpe_monitors}}}
+        for nrpecheck in self.checks:
+            nrpecheck.write(self.nagios_context, self.hostname)
+            nrpe_monitors[nrpecheck.shortname] = {
+                "command": nrpecheck.command,
+            }
+
+        service('restart', 'nagios-nrpe-server')
+
+        for rid in relation_ids("local-monitors"):
+            relation_set(relation_id=rid, monitors=yaml.dump(monitors))

=== added file 'hooks/charmhelpers/contrib/charmsupport/volumes.py'
--- hooks/charmhelpers/contrib/charmsupport/volumes.py	1970-01-01 00:00:00 +0000
+++ hooks/charmhelpers/contrib/charmsupport/volumes.py	2014-11-18 01:15:03 +0000
@@ -0,0 +1,156 @@
+'''
+Functions for managing volumes in juju units. One volume is supported per unit.
+Subordinates may have their own storage, provided it is on its own partition.
+
+Configuration stanzas:
+  volume-ephemeral:
+    type: boolean
+    default: true
+    description: >
+      If false, a volume is mounted as sepecified in "volume-map"
+      If true, ephemeral storage will be used, meaning that log data
+         will only exist as long as the machine. YOU HAVE BEEN WARNED.
+  volume-map:
+    type: string
+    default: {}
+    description: >
+      YAML map of units to device names, e.g:
+        "{ rsyslog/0: /dev/vdb, rsyslog/1: /dev/vdb }"
+      Service units will raise a configure-error if volume-ephemeral
+      is 'true' and no volume-map value is set. Use 'juju set' to set a
+      value and 'juju resolved' to complete configuration.
+
+Usage:
+    from charmsupport.volumes import configure_volume, VolumeConfigurationError
+    from charmsupport.hookenv import log, ERROR
+    def post_mount_hook():
+        stop_service('myservice')
+    def post_mount_hook():
+        start_service('myservice')
+
+    if __name__ == '__main__':
+        try:
+            configure_volume(before_change=pre_mount_hook,
+                             after_change=post_mount_hook)
+        except VolumeConfigurationError:
+            log('Storage could not be configured', ERROR)
+'''
+
+# XXX: Known limitations
+# - fstab is neither consulted nor updated
+
+import os
+from charmhelpers.core import hookenv
+from charmhelpers.core import host
+import yaml
+
+
+MOUNT_BASE = '/srv/juju/volumes'
+
+
+class VolumeConfigurationError(Exception):
+    '''Volume configuration data is missing or invalid'''
+    pass
+
+
+def get_config():
+    '''Gather and sanity-check volume configuration data'''
+    volume_config = {}
+    config = hookenv.config()
+
+    errors = False
+
+    if config.get('volume-ephemeral') in (True, 'True', 'true', 'Yes', 'yes'):
+        volume_config['ephemeral'] = True
+    else:
+        volume_config['ephemeral'] = False
+
+    try:
+        volume_map = yaml.safe_load(config.get('volume-map', '{}'))
+    except yaml.YAMLError as e:
+        hookenv.log("Error parsing YAML volume-map: {}".format(e),
+                    hookenv.ERROR)
+        errors = True
+    if volume_map is None:
+        # probably an empty string
+        volume_map = {}
+    elif not isinstance(volume_map, dict):
+        hookenv.log("Volume-map should be a dictionary, not {}".format(
+            type(volume_map)))
+        errors = True
+
+    volume_config['device'] = volume_map.get(os.environ['JUJU_UNIT_NAME'])
+    if volume_config['device'] and volume_config['ephemeral']:
+        # asked for ephemeral storage but also defined a volume ID
+        hookenv.log('A volume is defined for this unit, but ephemeral '
+                    'storage was requested', hookenv.ERROR)
+        errors = True
+    elif not volume_config['device'] and not volume_config['ephemeral']:
+        # asked for permanent storage but did not define volume ID
+        hookenv.log('Ephemeral storage was requested, but there is no volume '
+                    'defined for this unit.', hookenv.ERROR)
+        errors = True
+
+    unit_mount_name = hookenv.local_unit().replace('/', '-')
+    volume_config['mountpoint'] = os.path.join(MOUNT_BASE, unit_mount_name)
+
+    if errors:
+        return None
+    return volume_config
+
+
+def mount_volume(config):
+    if os.path.exists(config['mountpoint']):
+        if not os.path.isdir(config['mountpoint']):
+            hookenv.log('Not a directory: {}'.format(config['mountpoint']))
+            raise VolumeConfigurationError()
+    else:
+        host.mkdir(config['mountpoint'])
+    if os.path.ismount(config['mountpoint']):
+        unmount_volume(config)
+    if not host.mount(config['device'], config['mountpoint'], persist=True):
+        raise VolumeConfigurationError()
+
+
+def unmount_volume(config):
+    if os.path.ismount(config['mountpoint']):
+        if not host.umount(config['mountpoint'], persist=True):
+            raise VolumeConfigurationError()
+
+
+def managed_mounts():
+    '''List of all mounted managed volumes'''
+    return filter(lambda mount: mount[0].startswith(MOUNT_BASE), host.mounts())
+
+
+def configure_volume(before_change=lambda: None, after_change=lambda: None):
+    '''Set up storage (or don't) according to the charm's volume configuration.
+       Returns the mount point or "ephemeral". before_change and after_change
+       are optional functions to be called if the volume configuration changes.
+    '''
+
+    config = get_config()
+    if not config:
+        hookenv.log('Failed to read volume configuration', hookenv.CRITICAL)
+        raise VolumeConfigurationError()
+
+    if config['ephemeral']:
+        if os.path.ismount(config['mountpoint']):
+            before_change()
+            unmount_volume(config)
+            after_change()
+        return 'ephemeral'
+    else:
+        # persistent storage
+        if os.path.ismount(config['mountpoint']):
+            mounts = dict(managed_mounts())
+            if mounts.get(config['mountpoint']) != config['device']:
+                before_change()
+                unmount_volume(config)
+                mount_volume(config)
+                after_change()
+        else:
+            before_change()
+            mount_volume(config)
+            after_change()
+        return config['mountpoint']

=== modified file 'hooks/keystone_hooks.py'
--- hooks/keystone_hooks.py	2014-10-06 20:53:09 +0000
+++ hooks/keystone_hooks.py	2014-11-18 01:15:03 +0000
@@ -19,6 +19,7 @@
     relation_get,
     relation_ids,
     relation_set,
+    relations_of_type,
     related_units,
     unit_get,
 )
@@ -50,6 +51,7 @@
     register_configs,
     relation_list,
     restart_map,
+    services,
     CLUSTER_RES,
     KEYSTONE_CONF,
     SSH_USER,
@@ -77,6 +79,8 @@
 )
 from charmhelpers.contrib.openstack.context import ADDRESS_TYPES
 
+from charmhelpers.contrib.charmsupport.nrpe import NRPE
+
 hooks = Hooks()
 CONFIGS = register_configs()
 
@@ -109,6 +113,7 @@
 
     save_script_rc()
     configure_https()
+    update_nrpe_config()
     CONFIGS.write_all()
     if eligible_leader(CLUSTER_RES):
         migrate_database()
@@ -355,6 +360,7 @@
                                 group='keystone',
                                 peer_interface='cluster',
                                 ensure_local_user=True)
+    update_nrpe_config()
     synchronize_ca()
     if eligible_leader(CLUSTER_RES):
         log('Cluster leader - ensuring endpoint configuration'
@@ -369,6 +375,58 @@
     CONFIGS.write_all()
 
 
[e-mail]('nrpe-external-master-relation-joined',
+            'nrpe-external-master-relation-changed')
+def update_nrpe_config():
+    # Find out if nrpe set nagios_hostname
+    hostname = None
+    host_context = None
+    for rel in relations_of_type('nrpe-external-master'):
+        if 'nagios_hostname' in rel:
+            hostname = rel['nagios_hostname']
+            host_context = rel['nagios_host_context']
+            break
+    nrpe = NRPE(hostname=hostname)
+    apt_install('python-dbus')
+
+    if host_context:
+        current_unit = "%s:%s" % (host_context, local_unit())
+    else:
+        current_unit = local_unit()
+
+    services_to_monitor = services()
+
+    for service in services_to_monitor:
+        upstart_init = '/etc/init/%s.conf' % service
+        sysv_init = '/etc/init.d/%s' % service
+
+        if os.path.exists(upstart_init):
+            nrpe.add_check(
+                shortname=service,
+                description='process check {%s}' % current_unit,
+                check_cmd='check_upstart_job %s' % service,
+            )
+        elif os.path.exists(sysv_init):
+            cronpath = '/etc/cron.d/nagios-service-check-%s' % service
+            checkpath = os.path.join(os.environ['CHARM_DIR'],
+                                     'files/nrpe-external-master',
+                                     'check_exit_status.pl'),
+            cron_template = '*/5 * * * * root \
+/usr/local/lib/nagios/plugins/check_exit_status.pl -s /etc/init.d/%s \
+status > /var/lib/nagios/service-check-%s.txt\n' % (service, service)
+            f = open(cronpath, 'w')
+            f.write(cron_template)
+            f.close()
+            nrpe.add_check(
+                shortname=service,
+                description='process check {%s}' % current_unit,
+                check_cmd='check_status_file.py -f \
+/var/lib/nagios/service-check-%s.txt' % service,
+                )
+
+    nrpe.write()
+
+
 def main():
     try:
         hooks.execute(sys.argv)

=== modified file 'hooks/keystone_utils.py'
--- hooks/keystone_utils.py	2014-10-07 12:29:11 +0000
+++ hooks/keystone_utils.py	2014-11-18 01:15:03 +0000
@@ -220,6 +220,14 @@
                         if v['services']])
 
 
+def services():
+    ''' Returns a list of services associate with this charm '''
+    _services = []
+    for v in restart_map().values():
+        _services = _services + v
+    return list(set(_services))
+
+
 def determine_ports():
     '''Assemble a list of API ports for services we are managing'''
     ports = [config('admin-port'), config('service-port')]

=== added symlink 'hooks/nrpe-external-master-relation-changed'
=== target is u'keystone_hooks.py'
=== added symlink 'hooks/nrpe-external-master-relation-joined'
=== target is u'keystone_hooks.py'
=== modified file 'metadata.yaml'
--- metadata.yaml	2014-05-06 13:13:30 +0000
+++ metadata.yaml	2014-11-18 01:15:03 +0000
@@ -7,6 +7,9 @@
  implements OpenStack’s Identity API.
 categories: ["misc"]
 provides:
+  nrpe-external-master:
+    interface: nrpe-external-master
+    scope: container
   identity-service:
     interface: keystone
   identity-admin: