Author: Colin Watson
Revision Date: 2023-09-21 22:57:21 UTC

Explain how to generate INSTALL

* README.md: Explain that you may need to run `./bootstrap` to create
`INSTALL`.

Author: Colin Watson
Revision Date: 2023-08-15 11:24:08 UTC

start

Author: Colin Watson
Revision Date: 2023-08-03 07:11:45 UTC

Improve copying of overrides.

The old ubuntu-rtm publisher job produces this error every time it runs:

  rsync: link_stat "/srv/launchpad.net/ubuntu-rtm-archive/ubuntu-rtm-overrides/override.*" failed: No such file or directory (2)
  rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.1]
  run-parts: /srv/launchpad.net/publisher-parts/ubuntu-rtm/publish-distro.d/30-copy-indices exited with return code 23

While ubuntu-rtm itself is obviously obsolete, it's easy enough to fix
the rsync invocation here so that it doesn't have this problem in the
edge case where there are no override files to copy.

Author: Colin Watson
Revision Date: 2022-08-26 19:34:31 UTC

Move /usr/share/convoy/convoy.wsgi to a new convoy-common package.

This allows it to be used in Python-3-only setups.

The fact that python-convoy/python3-convoy depend on the package
containing `/usr/share/convoy/convoy.wsgi` rather than the other way
round is a bit odd, since `convoy.wsgi` imports from the `convoy`
package. However, this is necessary for a smooth upgrade, and it also
means that we don't have to pick which Python version `convoy-common`
should depend on; this is important since that must be in sync with
whether `libapache2-mod-wsgi` or `libapache2-mod-wsgi-py3` is installed.
Since `convoy.wsgi` itself is Python-version-agnostic and has no `#!`
line, it can safely be shipped in a common package like this.

Author: Colin Watson
Revision Date: 2015-09-15 14:10:06 UTC

Also return Git-based merge proposals from IHasRequestedReviews.getRequestedReviews.

Author: Colin Watson
Revision Date: 2022-06-06 15:56:03 UTC

Fix regex escaping.

Author: Colin Watson
Revision Date: 2021-10-25 20:52:19 UTC

fastimport: Fix export of directory renames.

Passing `specific_files=[change.path[0]]` to
`tree_old.iter_entries_by_dir` yields only the entry for that path,
rather than for that path and all directory entries contained by it as
the code appeared to expect. Fix this to emit the correct rename
commands for all directory entries under the path being renamed, and fix
up subsequent delete commands to match.

This fixes the export of
https://bazaar.launchpad.net/~lazr-developers/launchpadlib/trunk/revision/36.1.1,
which renames the `launchpadlib` directory to `src/launchpadlib` as well
as making various other changes. It may be relevant to
https://bugs.launchpad.net/brz/+bug/1890216 as well, although I haven't
checked and I haven't tackled the rather larger task of writing useful
tests.

Author: Colin Watson
Revision Date: 2021-05-13 23:40:26 UTC

Fix some _ObjSummary methods for Python 3.

by_size and by_count tried to use the "itervalues" method on an ordinary
dict, which doesn't exist on Python 3.

Author: Colin Watson
Revision Date: 2019-09-27 22:27:14 UTC

Rename [slave] configuration section to [builder].

Author: Colin Watson
Revision Date: 2019-09-27 17:30:53 UTC

Remove tickcount and track traversal/publication durations instead.

tickcount can't work on Python 3, so in the long term we don't have much
choice here. We do want to be able to spot contention, but tracking thread
time should be enough here. (Unfortunately, as far as I can tell this is
only possible with Python >= 3.3.)

This does change the access log format slightly (logging durations rather
than ticks), but as far as I can tell nothing cares.

Author: Colin Watson
Revision Date: 2019-09-26 14:47:11 UTC

Fix GitRepositorySet.new, and export it on the webservice.

This was previously untested, and had been broken since r18222.

Now that namespace.createRepository can create the repository on the hosting
service, we can safely export this to create a bare repository via the API.
For example, this allows snapcraft to create a temporary repository, issue
an access token to it, and push code to it, all without needing to configure
an SSH key.

Author: Colin Watson
Revision Date: 2019-09-19 19:33:12 UTC

Port codehosting to Breezy.

Most of this is relatively mechanical: bzrlib imports become breezy imports,
some things move around a little more (mainly to breezy.bzr), bzrdir becomes
controldir in many cases, I tightened up some bytes/text handling, and there
were a couple of other minor API changes.

Due to problems with subvertpy, codeimport remains on Bazaar for now. This
entails some fiddly code to allow Bazaar and Breezy to coexist in the same
codebase.

DirectBranchCommit.commit needs a new call to
self.transform_preview.fixup_new_roots. I think this may technically have
been needed by Bazaar too, since bzrlib.transform._alter_files calls it, but
it no longer seems to be possible to get away without it.

We have to explicitly initialize Breezy in lib/lp/codehosting/__init__.py,
as otherwise it initializes itself with a terminal-oriented UI, causing some
unexpected output to appear in logs.

We have to disable some plugins that are now built into Breezy and likely to
cause trouble if invoked, although unfortunately we have no very elegant way
to do that. cvs, darcs, email, and mtn are disabled using
BRZ_DISABLE_PLUGINS. git requires more work: we can't allow Breezy to even
import this until codeimport is also ported, since it requires a newer
version of dulwich which is incompatible with bzr-git (and that isn't
particularly straightforward to fix), so I ended up stubbing it in
sys.modules so that importing it has no effect. Fortunately Breezy
currently only imports breezy.git and relies on it to register its own
formats, so this crude strategy works.

The hack in scripts/mirror-branch.py to force bzr to use urllib is no longer
required: Breezy removed pycurl support.

Author: Colin Watson
Revision Date: 2019-09-10 14:45:08 UTC

Upgrade to lazr.jobrunner 0.16, and test for lack of OOPSes on retry.

Author: Launchpad PQM Bot
Revision Date: 2019-09-10 09:51:43 UTC

[r=wgrant][bug=1842658][incr] Add DistroArchSeriesFilter table.

Author: Colin Watson
Revision Date: 2019-09-06 23:53:16 UTC

Allow livefs build metadata to override the default build pocket.

This makes it possible, for example, to distinguish the case of building a
livefs using tools from -updates but with contents from the release pocket
from the case of building a livefs using tools from -updates and contents
from -updates.

Author: Colin Watson
Revision Date: 2019-08-22 13:09:17 UTC

Fix permissions on /etc/logrotate.d/logstash-forwarder.

logrotate ignores executable configuration files.

Author: Colin Watson
Revision Date: 2019-08-14 13:52:37 UTC

Rewrite BugSummary triggers to be statement-level.

Author: Colin Watson
Revision Date: 2019-08-08 08:59:51 UTC

Chase redirects in footer.

Author: Colin Watson
Revision Date: 2019-07-31 15:47:00 UTC

Merge devel.

Author: Colin Watson
Revision Date: 2019-05-28 16:36:49 UTC

Add warning for future developers.

Author: Colin Watson
Revision Date: 2019-05-24 16:17:07 UTC

Add SnapBuild.explicitly_private column.

Author: Colin Watson
Revision Date: 2019-05-22 08:56:20 UTC

Handle AMQP channel errors (particularly NotFound) in the publisher.

amqp 2.4.0 included a change to drain events before publishing. This
means that if we try to publish an OOPS to a nonexistent exchange, then
some future publishing attempt will raise a NotFound exception, which is
a channel error rather than a connection error and so wasn't previously
handled.

To try to minimise confusion resulting from this (which can be
considerable - it took me several days to track down what was happening
in Launchpad's test suite), spend a short time waiting for a response
for the broker after publishing an OOPS. This will typically allow us
to detect channel errors immediately, which we now handle; even if we
don't manage to handle them immediately, they'll be handled the next
time we try to publish something on the same channel.

It would be possible to handle channel errors more economically by just
reopening a channel on the same connection rather than reopening the
entire connection, but reopening the connection seems to work well
enough for now.

Author: Steve Langasek
Revision Date: 2019-03-22 15:55:28 UTC

Bump ubuntukylin limits further, per willcooke / handsome_feng

Author: Colin Watson
Revision Date: 2019-03-21 16:24:06 UTC

Delete branches and Git repositories asynchronously.

Author: Colin Watson
Revision Date: 2019-03-21 16:17:11 UTC

Add a Git repository deletion job.

Author: Colin Watson
Revision Date: 2019-03-21 15:44:34 UTC

Add a branch deletion job.

Author: Colin Watson
Revision Date: 2019-01-30 14:04:49 UTC

Prune old completed BranchMergeProposalJobs.

Author: Colin Watson
Revision Date: 2018-12-17 14:08:02 UTC

Port to Python 3.

This should be safe on >= trusty, as cloud images contain python3, and
charm-helpers will bootstrap the rest as long as the hook #! line works.

I dropped unicode() from the data persistence functions, as it's
unnecessary: on Python 2 a file opened with "w" will accept str writes, and
on Python 3 json.dumps always returns str rather than bytes.

Author: Colin Watson
Revision Date: 2018-12-07 18:37:01 UTC

Add a LXD image to builds for the buildd subproject.

Author: Colin Watson
Revision Date: 2018-11-30 20:22:34 UTC

Tell rsyncd to use the proxy uid/gid when serving squid-logs.

Author: Colin Watson
Revision Date: 2018-11-28 13:12:33 UTC

Support newer versions of the nrpe charm.

This is a bit of a hack, but can be simplified once all deployments have
been upgraded.

Author: Colin Watson
Revision Date: 2018-10-01 10:12:42 UTC

Get ScopedCollection.range_factory_class from the corresponding field.

Author: Colin Watson
Revision Date: 2018-09-05 10:27:00 UTC

Add dns_v4_first configuration option.

PS4.5 doesn't have IPv6 yet, so Squid's default of preferring IPv6 addresses
fails.

Author: Colin Watson
Revision Date: 2018-05-25 22:18:52 UTC

Add interstitial pages when creating or reactivating an account.

These provide an opportunity to present the user with the terms of service
and privacy policy and require that they explicitly accept them, as well as
making it harder to reactivate an account by accident.

To support testing this locally, I extended make-lp-user to be able to
create placeholder accounts, and adjusted testopenid so that it can
authenticate as an inactive account by explicitly supplying the username.

Author: Colin Watson
Revision Date: 2018-05-18 21:07:47 UTC

Cherry-pick https://code.launchpad.net/~andrewsomething/bzr/bts794146/+merge/266499 for Launchpad.

Author: Colin Watson
Revision Date: 2018-05-04 16:19:34 UTC

Dispatch private BPBs immediately, using macaroon auth for source files.

Author: Colin Watson
Revision Date: 2018-04-21 11:10:19 UTC

Turn ArchiveFile into a history table, adding date_created and date_superseded columns. Adjust the publisher to match.

Author: Colin Watson
Revision Date: 2018-04-21 10:53:17 UTC

Add ArchiveFile.date_created and ArchiveFile.date_superseded.

Author: Colin Watson
Revision Date: 2018-03-14 14:10:58 UTC

Convert translation templates builds to the new VCS mixin, thereby adding git support.

Author: Colin Watson
Revision Date: 2017-11-19 12:31:35 UTC

Merge virtualenv-pip.

Author: Colin Watson
Revision Date: 2015-09-08 11:35:19 UTC

Drop immediate mail delivery from LaunchpadScript and LaunchpadZopelessLayer.

Author: Colin Watson
Revision Date: 2017-11-01 01:09:59 UTC

Replace most of devscripts.sourcecode with codetree.

Author: Colin Watson
Revision Date: 2017-10-07 03:01:55 UTC

Include a link to the archive in "PPA access granted" email notifications.

Author: Colin Watson
Revision Date: 2017-09-30 01:09:23 UTC

Fix indentation.

Author: Colin Watson
Revision Date: 2017-09-15 18:57:39 UTC

Only include *.py from twisted/ in the sdist.

Author: Colin Watson
Revision Date: 2017-09-15 17:08:49 UTC

Don't add a process back to the ready set if it received an error such as a timeout.

Author: Aurelien Jarno
Revision Date: 2017-06-28 08:24:49 UTC

remove haskell-debian

[Debian bug #866184]

Author: Colin Watson
Revision Date: 2017-05-23 12:29:35 UTC

Remove `bzr register-branch`, since it has not worked for a long time.

Author: Colin Watson
Revision Date: 2017-05-11 10:58:58 UTC

Enable throttled progress output from git-to-git import workers.

Author: Colin Watson
Revision Date: 2017-02-03 10:37:39 UTC

Move to snap/snapcraft.yaml.

Author: Colin Watson
Revision Date: 2017-01-28 19:40:29 UTC

Set strict-origin-when-cross-origin referrer policy on private views.

Author: Colin Watson
Revision Date: 2016-12-05 14:47:41 UTC

Split out push and push-with-packages targets, since we don't need to push (dummy) resources every time.

Author: Colin Watson
Revision Date: 2016-11-21 14:01:43 UTC

Don't dispatch SnapBuilds whose code object is empty, perhaps because an associated code import hasn't finished.

Author: Colin Watson
Revision Date: 2016-11-17 15:00:35 UTC

Make GitSubscription.paths be a JSON-encoded list instead.

Author: Colin Watson
Revision Date: 2016-11-15 17:37:04 UTC

Isolate gpgme from its terminal environment, if any.

Author: Colin Watson
Revision Date: 2016-07-11 14:23:03 UTC

Fix ANT_OPTS handling.

Author: Colin Watson
Revision Date: 2016-07-08 17:34:38 UTC

Don't output passwords to the build log.

Author: Colin Watson
Revision Date: 2016-05-26 11:55:52 UTC

Handle dists/*/*/signed the same way as dists/*/*/uefi.

Author: Colin Watson
Revision Date: 2016-04-25 15:33:42 UTC

Show human-readable descriptions of macaroon caveats when we have them.

Author: Colin Watson
Revision Date: 2016-03-03 15:40:01 UTC

Add icon.png.

Author: Colin Watson
Revision Date: 2016-03-02 13:17:02 UTC

Check caveats in accessors, mutators, and collections.

Author: Colin Watson
Revision Date: 2016-02-21 18:20:33 UTC

lpbuildd/binarypackage.py: Use "apt-get indextargets" and "apt-helper
cat-file" where they exist to read Packages files, rather than looking
in /var/lib/apt/lists/ directly.

Author: Kit Randel
Revision Date: 2016-02-11 02:51:17 UTC

Update files from array to dict for snapcraft 1.0 api.

Author: Colin Watson
Revision Date: 2016-01-12 16:59:11 UTC

Model and show SourcePackageRelease.builddependsarch and SourcePackageRelease.build_conflicts_arch.

Author: Colin Watson
Revision Date: 2016-01-12 16:03:23 UTC

Add SourcePackageRelease.builddependsarch and SourcePackageRelease.build_conflicts_arch columns.

Author: Colin Watson
Revision Date: 2015-12-02 13:49:47 UTC

Take an advisory lock on the target archive when copying packages.

Author: Colin Watson
Revision Date: 2015-11-19 01:51:49 UTC

Rotate logs even if empty.

Author: Colin Watson
Revision Date: 2015-11-18 17:04:52 UTC

Prepare Apache configurations for xz index files in archives.

Author: Colin Watson
Revision Date: 2015-11-02 11:16:25 UTC

Fix over-indentation.

Author: Colin Watson
Revision Date: 2015-11-02 11:16:12 UTC

Fix over-indentation.

Author: Colin Watson
Revision Date: 2015-10-29 11:00:36 UTC

Move PIP_SOURCE_DIR check from build-tarball to $(ENV).

Author: Colin Watson
Revision Date: 2015-10-13 15:36:10 UTC

Copy live filesystems from the previous series on initialisation.

Author: Colin Watson
Revision Date: 2015-10-01 15:19:22 UTC

Depend on python-gi, since it's needed to import from gi.repository.

Author: Colin Watson
Revision Date: 2015-09-15 11:31:46 UTC

Prepare Apache configuration for InRelease files in archives.

Author: Colin Watson
Revision Date: 2015-07-02 11:38:00 UTC

Cherry-pick https://code.launchpad.net/~cjwatson/bzr/fix-keep-dirty/+merge/263632 for Launchpad.

Author: Colin Watson
Revision Date: 2015-06-18 13:51:59 UTC

Factor out tarball name.

Author: Colin Watson
Revision Date: 2015-06-09 16:34:06 UTC

Make sure the hints branch always points to the right place, even if it's changed due to e.g. a series being released.

Author: Colin Watson
Revision Date: 2015-05-22 15:42:11 UTC

Pass through the necessary configuration options for cgit OpenID authentication support.

Author: Colin Watson
Revision Date: 2015-05-07 15:56:22 UTC

Add configuration to open rsync log access to certain hosts.

Author: Colin Watson
Revision Date: 2015-05-01 15:20:10 UTC

Remove the ##GITNAMESPACE## markers, now that we're on production.

Author: Colin Watson
Revision Date: 2015-04-24 16:18:51 UTC

Fix Nagios checks to handle haproxy 1.5.

Author: Colin Watson
Revision Date: 2015-03-26 13:58:03 UTC

Add extra_open_ports configuration setting to make it easier to hulk-smash haproxy onto the same unit as apache2.

Author: Colin Watson
Revision Date: 2015-02-20 15:30:36 UTC

Generate the britney2 configuration file dynamically, with series-appropriate architecture lists.

Author: Colin Watson
Revision Date: 2015-02-19 15:36:45 UTC

Make the lock file be per-series as well as per-distribution.

Author: Colin Watson
Revision Date: 2015-02-19 13:47:24 UTC

Include $SERIES-updates in the baseline Sources/Packages data files.

Author: Colin Watson
Revision Date: 2015-02-19 12:58:33 UTC

Return 0 from blocks function for DISTRIBUTION != ubuntu.

Author: Colin Watson
Revision Date: 2015-02-19 12:56:42 UTC

Use series prefix for update_excuses.html in a couple more places.

Author: Colin Watson
Revision Date: 2015-02-13 18:23:56 UTC

Ensure that a repository exists on disk before receiving pack data into it.

Author: Colin Watson
Revision Date: 2015-02-13 17:28:07 UTC

Use subdirectory rather than file prefix.

Author: Colin Watson
Revision Date: 2015-02-10 14:16:48 UTC

Set up hints and blocks appropriately for runs against Ubuntu stable series.

Author: Colin Watson
Revision Date: 2015-02-03 17:09:32 UTC

Return user.id as an additional dict entry from authenticateWithPassword; require user ID rather than name in translatePath.

Author: Colin Watson
Revision Date: 2014-12-30 19:37:57 UTC

Use the most recent appropriate transition for DstTzInfo._utcoffset and friends, rather than the first transition which may be very old.

Author: Colin Watson
Revision Date: 2014-10-16 10:22:55 UTC

First cut at a native D-Bus service for click. Doesn't quite work yet.

Author: Colin Watson
Revision Date: 2014-10-10 11:09:36 UTC

Add a new cdimage-custom generator.

Author: Colin Watson
Revision Date: 2014-09-19 23:28:49 UTC

releasing package germinate version 2.19

Author: Colin Watson
Revision Date: 2012-03-19 21:43:57 UTC

bin/casper-reconfigure: Unset DEBIAN_HAS_FRONTEND, DEBIAN_FRONTEND, and
DEBCONF_REDIR so that casper-reconfigure properly uses the
noninteractive frontend when invoked from a ubiquity target-config hook
(LP: #955617).

Author: Colin Watson
Revision Date: 2014-07-30 13:10:29 UTC

Add a touch-tests seed containing all the *-autopilot packages from touch, useful for RTM branching.

Author: Colin Watson
Revision Date: 2014-07-17 09:51:30 UTC

Ask the DB to sort filelists by component and architecture and then write a group at a time directly, rather than building a dict of dicts of lists first.

Author: Colin Watson
Revision Date: 2014-06-05 09:33:22 UTC

Sort the channel list.

Author: Colin Watson
Revision Date: 2014-05-30 11:57:11 UTC

Send copies to NEW if they contain binaries without overrides.