lp:~hopem/stsstack-bundles

Author: Edward Hope-Morley
Author Date: 2022-02-28 14:36:44 UTC

Add charmhub support

We now default to using ch: but can switch back with
--charmstore.

Author: Edward Hope-Morley
Author Date: 2020-08-26 16:29:32 UTC

Add masakari support

Min release is Ussuri
Closes-Bug: #1880116

Author: Edward Hope-Morley
Author Date: 2021-10-29 12:31:29 UTC

Fix vault + openstack-dashboard

Also fixes vault + HA overlays.

Closes-Bug: 1948822

Author: Edward Hope-Morley
Author Date: 2021-10-28 09:25:33 UTC

Fix ldap overlay

ldap-test-fixture only works up to Bionic so cap series. Also
refresh docs.

Author: Edward Hope-Morley
Author Date: 2021-10-14 09:04:53 UTC

Add Openstack xena + Impish

Also remove EOL Ubuntu versions.

Author: Edward Hope-Morley
Author Date: 2021-05-20 14:32:30 UTC

Ensure unique vips in bundles with > 1 app

A bundle or overlay can have more than one
application that has a vip config. This ensures
that each application gets a unique vip.

Closes-Bug: #1929081

Author: Edward Hope-Morley
Author Date: 2021-04-14 16:42:39 UTC

Deprecate --create-model and merge with --name

If naming a bundle you probably want a model of that name
so make the create/switch implicit instead of having to
always provide both options. Also adding a new option
--no-create-model to optionally disable creating/switching
model if needs be. Also ensures -n and --name behave the
same.

Author: Edward Hope-Morley
Author Date: 2021-03-18 13:28:26 UTC

Don't use attached data-port ports

The add-data-ports filters ports that are not DOWN
but does not check if they are already attached to
another instance. This ensures attached ports are
excluded.

Author: Edward Hope-Morley
Author Date: 2021-02-01 15:49:55 UTC

Enable neutron-gatway enable-isolated-metadata=true

Since we always set this for neutron-openvswitch it makes
sense to do so for neutron-gateway so that dhcp-agents
scheduled to either will behave in the same way.

Author: Edward Hope-Morley
Author Date: 2021-01-21 17:37:24 UTC

Add --ovn conflicts_with for incompatible overlays

Author: Edward Hope-Morley
Author Date: 2021-01-11 11:21:45 UTC

Add support for Openstack Wallaby release

Author: Edward Hope-Morley
Author Date: 2021-01-11 17:18:17 UTC

Fix mysql-innodb-cluster

Need to use a separate mysql-router subordinate for each application
with a shared-db relation (i.e. can't related directly to mysql
like with the percona-cluster charm). To achieve this we
auto-generate an overlay containing a per-application subordinate
and all the necessary relations.

Author: Edward Hope-Morley
Author Date: 2019-10-21 11:18:06 UTC

Add more k8s tools

* tool to create a pod

Author: Edward Hope-Morley
Author Date: 2020-11-03 23:26:39 UTC

Fix config-based ssl novarc

When using config based ssl (i.e. not vault) the certs
are stored under a path named with the model deployed
and as such the old path of openstack/ssl no longer
works so we remove refs to that and use a selection
method to choose the right one if more than one
exists.

Author: Edward Hope-Morley
Author Date: 2020-11-04 09:58:13 UTC

Use an rfc1918 network for octavia ipv4

The current network range is not a private
network so lets use an actual private network
to avoid potential conflicts. Also set to /24
since /29 is specifically for the case of
testing address exhaustion which is not
necessarily everyones use-case and can always
be manually adjusted.

Author: Edward Hope-Morley
Author Date: 2020-10-30 10:58:39 UTC

Use a separate ovn-chassis for octavia

This is to be inline with fce-templates so that
config can be applied to compute nodes that may
not be compatible with octavia units e.g. offload.

Author: Edward Hope-Morley
Author Date: 2020-10-28 13:54:00 UTC

Fix ovn

Switching to using vxlan by default meant configuring
default-tenant-network-type but it isn't possible to
configure geneve (it's done automatically by the charm
plugin) so we need to leave it blank when using --ovn.

Author: Edward Hope-Morley
Author Date: 2020-10-24 10:32:32 UTC

Add mysql-innodb-cluster + vault

Closes-Bug: #1892002

Author: Edward Hope-Morley
Author Date: 2020-10-21 17:29:26 UTC

Ensure certs relation with telemetry when using --vault

Closes-Bug: #1899999

Author: Edward Hope-Morley
Author Date: 2020-10-24 10:09:14 UTC

Add more unit placement overlays templates

Also make placement renderer unit conflict message more
helpful.

Author: Edward Hope-Morley
Author Date: 2020-10-20 16:57:35 UTC

Add juju placement support

If using a Juju provider that supports placement (e.g. MAAS),
a unit placement overlay will be generated so that capable units
will be deployed in lxd containers and distributed across metal
units. This is automatically enabled for MAAS providers and can
be manually enabled with the --hyperconverged flag.

Author: Edward Hope-Morley
Author Date: 2020-10-21 16:33:30 UTC

Fix has_min_series to support new default Focal

Author: Edward Hope-Morley
Author Date: 2020-10-06 10:42:47 UTC

Set default series to Focal

Author: Edward Hope-Morley
Author Date: 2020-10-06 10:29:52 UTC

Use vxlan by default for Openstack

Nobody uses gre anymore.

Author: Edward Hope-Morley
Author Date: 2020-10-02 10:48:34 UTC

Add tools to create/delete openstack projects

Author: Edward Hope-Morley
Author Date: 2020-09-30 09:48:33 UTC

Tidyup deployment messages

Some overlays will provide some post-deployment info.
This patch tidies up the presentation of these messages.

Author: Edward Hope-Morley
Author Date: 2020-09-26 11:40:38 UTC

Add Ceph EC pool support

The 20.10 release of the Openstack charms will support
Ceph erasure-coded pools. This provides a simple way to
deploy that feature with Openstack.

Author: Edward Hope-Morley
Author Date: 2020-09-24 14:47:10 UTC

Add extra ports setup to configure script

When deploying dvr or ovn you have to add extra ports
to compute nodes. This is done using the add-data-ports.sh
script and is a manual step which could be done as part
of the general configure script. This patch fixes that.

Author: Edward Hope-Morley
Author Date: 2020-09-24 16:39:11 UTC

Add Groovy/Victoria support

Also remove cosmic and disco since
they are EOL.

Author: Edward Hope-Morley
Author Date: 2020-09-23 15:49:36 UTC

Use separate neutron-openvswitch with octavia

Sharing the same neutron-openvswitch between octavia
and nova-compute causes problems (see bug). This patch
adds a new neutron-openvswitch to uses only with
octavia.

Closes-Bug: #1896793

Author: Edward Hope-Morley
Author Date: 2020-09-24 13:09:11 UTC

Ensure mysql-innodb-cluster uses min 3 units

Closes-Bug: #1896808

Author: Edward Hope-Morley
Author Date: 2020-09-18 09:11:05 UTC

Ensure deployment CA installed if necessary

If the current model is a deployment using SSL either
by config or from vault then this will ensure that
when you source credentials for that deployment, the
CA corresponding to that deployment is the one currently
installed and used.

Author: Edward Hope-Morley
Author Date: 2020-09-01 11:14:33 UTC

Disable kubernetes manage-security-groups

This option is in fact never to be used and also
currently breaks due to LP 1893512.

Author: Edward Hope-Morley
Author Date: 2020-08-27 17:35:58 UTC

Move keystone to an overlay

Since it is used by multiple modules it makes sense
to make it a re-usable overlay. It also allows
it to be used optionally if that were ever to become
necessary.

Author: Edward Hope-Morley
Author Date: 2020-08-19 11:09:36 UTC

Allow kubernetes to manage security groups directly

This is required if the network used to deploy the worker units has
port security enabled (which is expected).

Author: Edward Hope-Morley
Author Date: 2020-08-04 13:45:58 UTC

Support providing bridge name to add-data-ports

If configuring multiple external networks, need to use a
separate bridge for each.

Author: Edward Hope-Morley
Author Date: 2020-07-24 17:01:45 UTC

Support providing ppa

New config option --ppa allows for a ppa to be
configured for all charms.

Author: Edward Hope-Morley
Author Date: 2020-07-24 11:41:06 UTC

Support providing network to add-data-ports

This allows for adding ports from any network to units
of e.g. neutron-openvswitch.

Author: Edward Hope-Morley
Author Date: 2020-06-20 09:55:34 UTC

Autodetect overlay-network-type in configure script

The openstack configure script currently defaults to
gre and if using e.g. vxlan you have to specify it.
We can easily glean the net type from Juju to try
that before defaulting to gre.

Author: Edward Hope-Morley
Author Date: 2020-07-03 15:33:04 UTC

Convert --dvr-snat --l3ha to --dvr-snat-l3ha

Closes-Bug: 1886207

Author: Edward Hope-Morley
Author Date: 2020-06-15 15:27:53 UTC

Always enable-local-dhcp-and-metadata

Since almost everyone uses this in the field it makes
sense to do so here as well.

Author: Edward Hope-Morley
Author Date: 2020-06-11 12:31:04 UTC

Diskimage-retrofit needs more cpu

The principle charms we deploy diskimage-retrofit charm to
run on only have 1 vcpu which causes the image create process
to take a long time to complete. This will switch from
m1.small to m1.medium.

Author: Edward Hope-Morley
Author Date: 2020-06-08 16:32:10 UTC

Fix --ssl combined with --*-ha*

In other words when using --ssl, if any service is explicitly
requested to be HA don't override it with the single unit
HA hack that we use to get predictable SANs for ssl certs.

Closes-Bug: #1882562

Author: Edward Hope-Morley
Author Date: 2020-06-08 08:51:54 UTC

Don't always ask for ml2dns upstream dns server

If we are able to glean a dns server from the local
host, don't both asking for one as input since this
happens for almost every openstack deployment and is
quite tedious and unnecessary.

Author: Edward Hope-Morley
Author Date: 2020-05-29 09:34:35 UTC

Add mysql+focal support to ceph and swift modules

Related-Bug: 1876175

Author: Edward Hope-Morley
Author Date: 2020-05-28 18:58:07 UTC

Don't exclude namespaces charms from revision-info

Most charms release to cs:<charm> as their stable whereas
others use cs:~<team>/<charm> so we need to allow that
when using --release-info.

One remaining caveat here is that if the revision-info uses
a namespaced charm but the template does not then it will
not be matched. That will either require a manual edit to
fix (--replay) or we need to update the template in question
to use the namespaced charm.

Closes-Bug: 1881158

Author: Edward Hope-Morley
Author Date: 2020-05-28 16:23:04 UTC

Use controller model for JUJU_VERSION

Closes-Bug: 1880730

Author: Edward Hope-Morley
Author Date: 2020-05-27 15:54:00 UTC

Show when revision-info omits charms

We currently expect charm version info given to
--revision-info to be for stable charms and as
a result we silently ignore any charm that is
not cs:<charm>. This patch displays a message
showing any charms whose version is ingored
and if no versions are found, does not switch
to --use-stable-charms.

Author: Edward Hope-Morley
Author Date: 2020-05-21 13:19:14 UTC

Don't clobber ovn-chassis bridge-interface-mappings

If the charm config was set outside of generate then add
its value to the local cache to avoid clobbering when
updating existing deployment.

This is the same as was done for data-port with
neutron-openvswitch so now we move to a function to
make code cleaner.

Author: Edward Hope-Morley
Author Date: 2020-05-20 17:13:59 UTC

Don't clobber data-port when re-running

Bundles that depend on --dvr require a data-port
which results in a user input-request. If
data-port has been set and you re-run generate-bundle
it will ask for a data-port value and default to
empty. This patch allows for any existing charm value
to be re-applied so as not to clobber

Closes-Bug: 1871565

Author: Edward Hope-Morley
Author Date: 2020-05-20 14:06:48 UTC

Remove absolute paths

Commit a7945160 made paths absolute by default which
makes the output harder to read. They will now remain
relative.

Author: Edward Hope-Morley
Author Date: 2020-05-19 13:35:37 UTC

revisions+

Author: Edward Hope-Morley
Author Date: 2020-05-07 12:48:12 UTC

Update mtu settings

Remove instance-mtu and add:

  global-physnet-mtu: 5000
  path-mtu: 1550
  physical-network-mtus: physnet:1500

i.e. max possible is 5000, default overlay gets 1500

Closes-Bug: 1874672

Author: Edward Hope-Morley
Author Date: 2020-05-07 12:38:30 UTC

Fix has_min_series()

Author: Edward Hope-Morley
Author Date: 2020-05-01 14:27:32 UTC

Use m1.large for octavia deployments nova-compute

This allows for tenant vm + amphora vm to be hosted on
same compute host.

Closes-Bug: 1876314

Author: Edward Hope-Morley
Author Date: 2020-04-30 20:11:07 UTC

Default to mysql-innodb-cluster for Focal

Closes-Bug: 1876175

Author: Edward Hope-Morley
Author Date: 2020-04-15 16:46:24 UTC

Fix --pocket

Closes-Bug: 1873034

Author: Edward Hope-Morley
Author Date: 2020-04-14 15:30:24 UTC

Set manage-neutron-plugin-legacy-mode=true for legacy ovs

As of 20.05 this is necessary since the default is
changing (see 20.02 release notes).

Closes-Bug: 1872742

Author: Edward Hope-Morley
Author Date: 2020-04-05 10:30:55 UTC

Add support for Octavia + OVN

Also add more documentation on using ovn
and octavia.

Author: Edward Hope-Morley
Author Date: 2020-03-23 13:52:50 UTC

Cleanup openstack configure script

Author: Edward Hope-Morley
Author Date: 2020-03-20 13:59:56 UTC

Remove admin-token from bundles

The admin-token config option has been removed from
the keystone charm.

Closes-Bug: 1868266

Author: Edward Hope-Morley
Author Date: 2020-03-13 12:57:07 UTC

Reorganise how we manage config defaults

This is a major refactor/reorg to accomodate for having
per-module config defaults that only need be defined
once and can be imported by other modules. This avoids
duplicate definitions and allows overrides if
necessary. To enable this, defaults are now defined in
a module_defaults file that exists in each module path
and are imported as part of the generate pipeline and
module dependencies (i.e. default from other modules)
can be defined in each module's 01import-config-defaults.

Another nice side-effect is that we can simplify overlays
by only having num_units set for principle definitions
e.g. *-ha templates no longer need to set num_units for
override definitions.

Also adds a new lint tool for checking if any overlays
are missing a default definition and adds an automatic
check to generate-bundle.sh to ensure that generated
bundles/overlays don't contain any dangling/unrendered
variables.

Author: Edward Hope-Morley
Author Date: 2020-03-11 20:23:01 UTC

Switch to configuring VIPs dynamically

Allows the network from which vips are allocated to be
changed as provided by a new config option --vip-network.

Author: Edward Hope-Morley
Author Date: 2020-03-10 12:41:06 UTC

Add ssl_ca to glance-simplestreams-sync

Closes-Bug: 1866837

Author: Edward Hope-Morley
Author Date: 2020-03-10 12:35:47 UTC

Add barbican-ha support

Closes-Bug: 1866836

Author: Edward Hope-Morley
Author Date: 2020-03-02 15:36:54 UTC

missing

Author: Edward Hope-Morley
Author Date: 2020-03-02 11:17:47 UTC

Improve stack-manager client tooling

Author: Edward Hope-Morley
Author Date: 2020-02-28 10:42:06 UTC

Add placement-api certificates interface support

Author: Edward Hope-Morley
Author Date: 2020-02-21 11:26:24 UTC

Add support for using vault for all api certs

Author: Edward Hope-Morley
Author Date: 2020-02-25 18:12:44 UTC

Ensure all ceph-mon relations are using __CEPH_INTERFACE__

Also don't use yaml variable to substitute ceph-mon since
it doesnt support doing composite strings like
"*interface:client".

Author: Edward Hope-Morley
Author Date: 2020-02-18 17:30:14 UTC

overlay naming cleanup

Author: Edward Hope-Morley
Author Date: 2020-02-13 18:08:08 UTC

Auto-detect when using vault for keystone ssl

Author: Edward Hope-Morley
Author Date: 2020-02-11 18:06:53 UTC

Rework opt input processing

This is a fairly large refactor that basically ensures that
all opt processing is done at the highest level. The main
reason for this is to be able to properly support exclusive
opts and overrides. It also helps to simplify the code by
storing opts that are not specific to a module in a
global dictionary that can be updated at any point.

Also moves generate-bundle.sh into common and creates a
symlink from each module since the code is the same
everywhere.

Author: Edward Hope-Morley
Author Date: 2020-02-07 12:44:21 UTC

add-ports.sh autodetect app name

It is currently necessary to provide the application
name you want to configure ports for unless you want
neutron-openvswitch which is the default. This patch
automatically detects what you have deployed since
it can currently only be neutron-openvswitch or
ovn-chassis. An override is still supported.

Author: Edward Hope-Morley
Author Date: 2020-02-05 16:39:33 UTC

Fixup neutron-ovn config

Now that bug 1850956 has landed we can switch to
using the proper way to configure bridge
interfaces.

Author: Edward Hope-Morley
Author Date: 2020-02-06 14:07:02 UTC

Use 50G volume for nova-compute instances data

Closes-Bug: #1862172

Author: Edward Hope-Morley
Author Date: 2020-01-31 14:28:35 UTC

Fix per-module release naming

Once a bundle is generated we print the series-release
name but this openstack-centric and should take into
account the module we are building for.

Closes-Bug: #1861484

Author: Edward Hope-Morley
Author Date: 2020-01-23 17:12:54 UTC

Create doc folders and convert READMEs

Per-module doc folders linked from top-level
doc folder. Also adds some new docs.

Author: Edward Hope-Morley
Author Date: 2020-01-24 14:39:21 UTC

Add Amphora vm ssh access

See LP: #1843625

Author: Edward Hope-Morley
Author Date: 2020-01-27 16:12:35 UTC

Add extra ephemeral disk to nova-compute for encryption

This is when using nova-compute + vault

Author: Edward Hope-Morley
Author Date: 2020-01-23 16:59:58 UTC

Minor code cleanup

No need to check if overlay already added since
duplicates get squashed.

Author: Edward Hope-Morley
Author Date: 2020-01-22 16:56:42 UTC

Fix tools/upload_octavia_image.sh

Requires Openstack name.

Author: Edward Hope-Morley
Author Date: 2020-01-21 13:32:31 UTC

Add --defaults config option

If provided this will instruct the tool to use
whatever defaults it has and not ask the caller
for REQUIRED: input.

Also tidy up the help message and check for
exclusive passthrough opts mucher earlier
on so that they immediately return.

Also fixes --list so that it always lists
contents of root state dir.

Author: Edward Hope-Morley
Author Date: 2020-01-10 16:14:23 UTC

Add support for grafana and graylog snap channels

Graylog defaults to 3/stable (current latest stable)
and grafana defaults to stable.

Author: Edward Hope-Morley
Author Date: 2020-01-10 15:38:35 UTC

Fix LMA with dvr-snat or ovn

Don't add relations to neutron-gateway when it is not in
use. Improves code around making this decision.

Author: Edward Hope-Morley
Author Date: 2019-12-13 10:18:31 UTC

Update install_local_ca.sh to support Vault CA

Defaults to using stsstack-bundles generated CA but
now optionally allows fetching CA cert from deployed
Vault.

Author: Edward Hope-Morley
Author Date: 2019-10-30 13:00:22 UTC

Add OVN support

This is a preview feature for the 19.10 release
of the charms.

Author: Edward Hope-Morley
Author Date: 2019-11-25 10:20:38 UTC

Add support for Octavia LB

This provides an alternative to using kube-api-loadbalancer
when using openstack-integrator.

Using this feature requires a network called
${OS_PROJECT_NAME}_port_sec_enabled to exist that
must have port security enabled.

Author: Edward Hope-Morley
Author Date: 2019-10-24 09:52:56 UTC

Fix trust

Make sure to add --trust to deploy command if using bundle trust
and also ensure we are using Juju >= 2.7 since that is first
release supporting trust in overlay bundles.

Author: Edward Hope-Morley
Author Date: 2019-10-28 13:33:02 UTC

Add support for placement charm

Rocky and Stein can optionally add placement charm
but Train mandates it.

Author: Edward Hope-Morley
Author Date: 2019-10-24 13:07:07 UTC

Improve bin/add-ports.sh

* don't clobber existing application config
* calculate ports properly

Author: Edward Hope-Morley
Author Date: 2019-10-21 11:29:17 UTC

Add juju bundle trust support

If juju version is >= 2.6.4 then we can set "trust: true" for e.g.
openstack-integrator.

NOTE: juju version is based on client version.

Closes-Bug: #1843595

Author: Edward Hope-Morley
Author Date: 2019-10-21 10:22:45 UTC

Make overlay type configurable

Author: Edward Hope-Morley
Author Date: 2019-10-22 11:12:08 UTC

Fix swift module storage

Use juju storage like with ceph instead of
relying on ephemeral volumes.

Author: Edward Hope-Morley
Author Date: 2019-09-30 15:01:08 UTC

Automatically fetch local hosts dns server config

Falls back to using stsstack upstream dns.
Also fixes dvr-snat overlay to use generated dns server value.

Author: Edward Hope-Morley
Author Date: 2019-09-24 15:48:02 UTC

Add k8s end-to-end test charm support

Author: Edward Hope-Morley
Author Date: 2019-09-09 19:53:19 UTC

Use ml2dns by default

Also add --no-ml2dns option

Author: Edward Hope-Morley
Author Date: 2019-09-22 20:27:37 UTC

Add newline after messages confirmation

Author: Edward Hope-Morley
Author Date: 2019-09-21 10:58:38 UTC

Restructure all modules to use a pipeline

Instead of having a giant generate-bundle.sh we now have it call
a pipeline of parts each with their own specific purpose i.e.

pipeline/01setup: this is for definining variables and
                  high-level init.
pipeline/02configure: this is the bulk of decision-making
                      such as overlay-selection.
pipeline/03build: calls the main generator to put it all
                  together.

Since everything now executes in the same environmemt there is no
need to support internal opts anymore so they have been removed.

Author: Edward Hope-Morley
Author Date: 2019-09-20 10:04:06 UTC

Add k8s calico support

Also add canal.