lp:~pjdc/ubuntu-mirror-charm/+git/ubuntu-mirror-charm

Author: Paul Collins
Author Date: 2021-11-09 01:07:09 UTC

add support for hosting extras.ubuntu.com

Author: Paul Collins
Author Date: 2021-11-05 02:25:27 UTC

honour apache_logdir config setting for linuxcontainers

Author: Paul Collins
Author Date: 2021-11-05 01:50:17 UTC

fix role_list for cloud-images

This is only used when deciding which virtualhosts to delete.

Author: Paul Collins
Author Date: 2021-11-05 01:06:30 UTC

add cloud-images.ubuntu.com, images.maas.io, old-releases.ubuntu.com, streams.canonical.com, ubuntu-cloud.archive.canonical.com (all without third-party)

Author: Paul Collins
Author Date: 2021-11-04 21:11:49 UTC

add script and make target to generate testdata based on test cases

Author: Paul Collins
Author Date: 2021-11-04 21:44:19 UTC

factor out generic TemplateTestCase

We use multiple inheritance here to evade test-case discovery.

Setting `__test__` in the base class and subclasses appropriately
would also work, and although explicit is often better than implicit,
in this case it seems like something we should not have to remember.

Author: Paul Collins
Author Date: 2021-10-29 02:53:29 UTC

remove all of the apache early/late extra-config settings

These are all now unused. If we want to inject extra configs in
the future, let's design a solution around the problem at hand.

Author: Paul Collins
Author Date: 2021-10-29 02:01:03 UTC

compress application/json for streams.c.c as per cRT#130349 so we can remove apache_late_extra, perhaps

Author: Paul Collins
Author Date: 2021-10-21 21:32:41 UTC

fix TLS paths for linuxcontainers

Author: Paul Collins
Author Date: 2021-10-20 03:14:00 UTC

allow linuxcontainers VirtualHosts to read their files

Author: Paul Collins
Author Date: 2021-10-19 21:41:58 UTC

change images.linuxcontainers.org to lxd.images.canonical.com, replace GeoIP with API, remove extra "Location" stanzas

Author: Paul Collins
Author Date: 2021-03-02 00:31:27 UTC

flake8

Author: Paul Collins
Author Date: 2021-03-01 22:41:32 UTC

don't hardcode the base URL when redirecting

Author: Paul Collins
Author Date: 2021-03-01 21:05:52 UTC

add maas daily -> stable redirect, cRT#128160

Author: Paul Collins
Author Date: 2021-01-19 22:29:09 UTC

fix test_xinetd_rsync_server for logging changes

Author: Paul Collins
Author Date: 2020-11-29 20:54:54 UTC

import permission-correction from mirror-2stage.sh

rsync's behaviour in the absence of --perms is complex
enough that this seemingly enormous hammer is about right.

Author: Paul Collins
Author Date: 2020-10-11 20:22:47 UTC

maas-images syncs are not as frequent as we expect, cRT#128116

Author: Paul Collins
Author Date: 2020-10-09 03:44:12 UTC

sleep for 5 seconds before we starting mirroring to let upstream delete its lock file

Author: Paul Collins
Author Date: 2020-10-07 20:31:41 UTC

check-mirror.sh: add maas-images and ubuntu-cloud-archive support

Author: Paul Collins
Author Date: 2020-10-07 00:38:34 UTC

implement downstream triggering for mirror-1stage.sh

Author: Paul Collins
Author Date: 2020-10-05 22:06:49 UTC

add/fix copyrights

Author: Paul Collins
Author Date: 2020-10-01 00:51:01 UTC

add ubuntu-cloud-archive role

Author: Paul Collins
Author Date: 2020-09-21 02:07:06 UTC

add test_ensure_symlink

Author: Paul Collins
Author Date: 2020-09-18 03:50:51 UTC

do not recursively chown /srv/ftp.root

There seems to be no reason to do this. The charm already creates the
root of the mirror path with the correct ownership, and the sync scripts
run as that user. chownr does not even change the ownership of the path
from which it begins its recursive chown!

Author: Paul Collins
Author Date: 2020-09-17 02:48:26 UTC

stop creating extra symlinks in mirror directories

Due to a bug in charm-helpers (LP:1895914) when the charm tries to ensure
an existing www symlink exists, it ends up following www and creating an
additional bogus symlink in the mirror directory.

Author: Paul Collins
Author Date: 2020-09-16 02:01:50 UTC

now that rsync is managed via socket activation, there can be 0 processes

Author: Paul Collins
Author Date: 2020-08-18 04:35:28 UTC

old-releases updates infrequently, so relax check-updates.sh to match

Author: Paul Collins
Author Date: 2020-08-18 03:12:50 UTC

use ubuntu-archive-removed-keys.gpg when verifying old-releases, because we check warty

Author: Paul Collins
Author Date: 2020-08-17 03:02:29 UTC

generate a single global rsync check, not one per role

Author: Paul Collins
Author Date: 2020-08-17 02:11:09 UTC

bump ceiling over max client connections to account for all roles syncing simultaneously

And remove pointless int() since rsync_max_connections already handles that.

Author: Paul Collins
Author Date: 2020-08-14 04:45:23 UTC

add config settings for the rsync module name, in particular setting the ports one correctly

Author: Paul Collins
Author Date: 2020-08-14 03:57:06 UTC

ports also uses .trace

Author: Paul Collins
Author Date: 2020-08-13 03:00:50 UTC

add support for hosting old-releases.ubuntu.com

Author: Paul Collins
Author Date: 2020-08-12 02:14:31 UTC

deploy a disk check for each mount point from which we are serving

Author: Paul Collins
Author Date: 2020-08-11 04:50:59 UTC

check-updates.sh: we want a critical when the file we're checking doesn't exist

Author: Paul Collins
Author Date: 2020-08-07 01:35:13 UTC

move "max connections" and "timeout" to individual modules

Due to a shared lock file, "max connections" is effectively global,
but it and "timeout" are in fact module settings, so we can move
them to this file and avoid problems caused by e.g. cs:nrpe's habit
of overwriting /etc/rsyncd.conf.

Author: Paul Collins
Author Date: 2020-08-06 01:41:16 UTC

handle non-existent triggers

Author: Paul Collins
Author Date: 2020-08-03 20:57:51 UTC

delete pointless CallableDict methods

Since we're subclassing dict and __call__ already uses
__getitem__, we wrote a bunch of extra code for no reason.

Author: Paul Collins
Author Date: 2020-08-02 21:27:16 UTC

stop using python-apt

Replaced with charmhelpers.fetch.get_upstream_version.

This simplifies creating a unit-testing environment, since the version
of apt on PyPi seems to be very old.

Author: Paul Collins
Author Date: 2020-07-30 23:33:40 UTC

refactor, eliminating globals

Author: Paul Collins
Author Date: 2020-07-30 22:53:22 UTC

hooks.py: ignore complexity warnings

Author: Paul Collins
Author Date: 2020-04-15 02:50:58 UTC

do not deploy an rsync module, ssh trigger, or rsync client config for unsafe roles

Author: Paul Collins
Author Date: 2020-04-15 00:00:39 UTC

when generating templates, set ${role} to the base role

This fixes checks for for clouds.archive.ubuntu.com.

Author: Paul Collins
Author Date: 2020-04-14 05:15:16 UTC

add support for "ubuntu-unsafe" role, to allow setting HTTPProtocolOptions unsafe

Author: Paul Collins
Author Date: 2020-04-08 01:36:21 UTC

check-mirror.sh: add support for https, and use it

Use curl instead of wget so that we can get certificate
validation more easily.

Author: Paul Collins
Author Date: 2020-04-07 21:27:33 UTC

re-sync charm-helpers. add osplatform to keep it working. add follow_links=False to chownr to avoid "ubuntu -> ." symlink

Author: Paul Collins
Author Date: 2020-04-06 21:47:11 UTC

use new combined-port LogFormat, replacing %l with %p (the canonical port)

We also replace %D with %p, which formerly replaced %l,
since there is no known use for this information, and
this is the least-disruptive way of logging this data.

Author: Paul Collins
Author Date: 2020-04-01 01:54:15 UTC

check default v6 addresses, where present

Since we lack v6 in CI, and add v6 to production after
deploying the charm, we can't make v6 a hard requirement.

Author: Paul Collins
Author Date: 2020-04-01 01:43:12 UTC

address families are bare ints in Python 2 (ugh)

Author: Paul Collins
Author Date: 2020-04-01 00:56:09 UTC

handle None return from get_default_address

The old behaviour of falling back to checking 12.7.0.0.1
just conceals an important problem.

Author: Paul Collins
Author Date: 2020-03-26 20:03:03 UTC

disable TLS versions < 1.2

Author: Paul Collins
Author Date: 2020-03-25 22:12:56 UTC

set tls (ssl) cipher suite and protocol versions to modern values

Author: Paul Collins
Author Date: 2020-03-25 20:41:31 UTC

configure_nrpe: reload nagios

And remove unused imports.

Author: Paul Collins
Author Date: 2020-03-25 01:59:12 UTC

no need for multiple ipaddrs to be in one arg

Author: Paul Collins
Author Date: 2020-03-24 20:09:21 UTC

tune rsync connection check to not trigger in normal circumstances

Author: Paul Collins
Author Date: 2020-03-24 02:52:42 UTC

remove nagios_critical_servicegroup etc. - we now manage this completely via nagios and nagiprom

Author: Paul Collins
Author Date: 2020-03-24 02:10:41 UTC

log when no role assigned to make debugging easier

Author: Paul Collins
Author Date: 2020-03-22 21:45:35 UTC

rename copy_files to configure_scripts, call it always to ensure scripts are up to date

Author: Paul Collins
Author Date: 2020-03-22 20:13:44 UTC

configure_apache_mpm: return True when changing MPM so that Apache is restarted

Author: Paul Collins
Author Date: 2020-03-20 04:04:13 UTC

start rsync after we enable it. get rid of the pointless start and stop hooks

Author: Paul Collins
Author Date: 2020-03-20 03:04:36 UTC

check-mirror.sh: use the system keyring, which we can rely on existing

It includes the following:

pub rsa4096 2012-05-11 [SC]
      790BC7277767219C42C86F933B4FE6ACC0B21F32
uid [ unknown] Ubuntu Archive Automatic Signing Key (2012) <ftpmaster@ubuntu.com>

pub rsa4096 2012-05-11 [SC]
      843938DF228D22F7B3742BC0D94AA3F0EFE21092
uid [ unknown] Ubuntu CD Image Automatic Signing Key (2012) <cdimage@ubuntu.com>

pub rsa4096 2018-09-17 [SC]
      F6ECB3762474EDA9D21B7022871920D1991BC93C
uid [ unknown] Ubuntu Archive Automatic Signing Key (2018) <ftpmaster@ubuntu.com>

Author: Paul Collins
Author Date: 2020-03-18 19:48:20 UTC

address some review comments

Author: Paul Collins
Author Date: 2020-03-18 03:00:00 UTC

skip sysctl keys that break container deployments when in a container

Author: Paul Collins
Author Date: 2020-03-17 03:05:21 UTC

do not configure chinacache health check

Existing mirrors will be unaffected, although since
nothing else in this charm ever referred to /srv/ccotp,
it can't have been working anyway.

Author: Paul Collins
Author Date: 2020-03-17 01:31:09 UTC

make bionic the default release