fix: web: Add RuntimeDirectoryPreserve to amqp-status-collector.service
This fixes the following issue:
- When RabbitMQ is unresponsive, the amqp-status-collector script fails repeatedly
- When amqp-status-collector isn't running, the /run/amqp-status-collector/
directory is removed, due to the behaviour of RuntimeDirectory
- When that directory is removed, running.json also gets removed
- Lots of other functionality in webcontrol depends upon this file. Such as
requests, and browsing the /running or results pages
This commit fixes the issue by adding RuntimeDirectoryPreserve=yes to
amqp-status-collector.service. This flag, when set to restart or yes, causes
the runtime directory to not be removed when the systemd unit is down.
fix: cloud: only check intended ips for autopkgtest-lxd-worker metrics
This commit adds a fix to the lxd metrics - we don't have a metric right now
which checks the remotes specified in the service bundle if they aren't present
in lxc remote list on the autopkgtest-lxd-worker.
So this checks the list of intended remotes and makes note of any intended remotes
which aren't in lxc remote list.
We also currently report on remotes which aren't specified in the service bundle,
but I think that's fine to leave in the metrics as it's indicative of issues.
This commit also writes lxc-remotes.json to the ~ directory on the lxd
worker, as the metrics script now uses this information to more
accurately report the metrics.
tmp doesn't get automatically cleaned up periodically, only on boot. This is
problematic as any edge case worker errors that cause the worker script to
exit before cleaning up the logfile directory leaves the entire directory
in tmp, leading to low disk space errors.
This commit introduces a config file which removes files and directories
in /tmp that haven't been modified in the last 30 days.
It adds the tmp cleanup config to the service bundle common
options for the autopkgtest-cloud-worker application.
It also adds the config option to layer.yaml.
And it also writes the cleanup config to /etc/tmpfiles.d/tmp.conf
pull-amqp is a script that pulls all message from a queue. If the script
is passed a regex, it will only pull the messages from the queue that
match said regex. If the --empty arg is passed, it'll remove said
messages.
push-amqp is a script that simply pushes a message to a specified queue.
The two scripts can be used in conjunction to easily shift specific
queue messages from one queue to another, removing the need to craft a
retry-autopkgtest-regressions command to shift tests between queues.
push-amqp can also be used to push messages to other queues, like the
sqlite-writer queue or the download-results queue.
refactor: web&cloud: replace configparser.read with configparser.read_file or read_string
Also refactors all duplicate usage of configparser.read and shares common
functions from helpers/utils.py, and amends unit tests in line with
these changes
