lp:~smoser/curtin/trunk.1703755-install-in-virtualenv

Branch merges

Propose for merging

No branches dependent on this one.

Merged into lp:~curtin-dev/curtin/trunk at revision 530

Server Team CI bot: Approve (continuous-integration) on 2017-10-02

Ryan Harper (community): Approve on 2017-10-02

Diff: 43 lines (+16/-2)

1 file modified

setup.py (+16/-2)

api

Related source package recipes

No recipes using this branch. (?)

Create packaging recipe

Related snap packages

Related bugs

Bug #1703755: Unable to install curtin in a virtualenv

Low

Fix Released

Link a bug report

Related blueprints

530. By Scott Moser on 2017-10-02

setup.py: fix to allow installation into a virtualenv

This just makes '/usr' not be a full path. It does not fix usage
of things that are are expected to be in /usr/ (the helpers).

The 'in_virtualenv' is the same method we employ for this function
in cloud-init.

529. By Scott Moser on 2017-10-02

doc: update documentation on curtin-hooks and non-ubuntu installation.

Add the section 'curthooks' to the documentation.
Generalize the environment variables in overview.

528. By Michael Hudson-Doyle on 2017-10-02

reporter: Add journald reporter to send events to journald

Allow monitoring of a curtin install via watching journal events.
The journald reporter is only available on systems with systemd
present; for Ubuntu this is releases Xenial and newer.

Add vmtest to exercise and validate journald reporter output.

527. By Ryan Harper on 2017-09-28

vmtests: add option to tar disk images after test run

vmtests may create a number of disk image files for use, these
are all sparse disks which report a size larger than the actual
space they occupy. In some cases someone copying files may
not be aware of the sparseness and expand the images instead.
Setting CURTIN_VMTEST_TAR_DISKS=1 will trigger vmtest to tar
sparsely the files and write out a .tar file in the same path.

This flag is disabled by default.

526. By Ryan Harper on 2017-09-12

install: ensure iscsi service is running to handle shutdown properly

In some cases it is problematic to shutdown the iscsi targets (like raid
over iscsi). Instead of introducing extra work to stop multi-layer
storage devices during the install of curtin, this patch addresses the
core issue around iscsi termination; ensuring the iscsi service is active
prior to shutting down. In Artful, the open-iscsi service does not
automatically start if iscsi configuration is not present during boot;
curtin will restart/start the service if the storage configuration
contains iscsi disks.

This approach successfully passes all of the iscsi configurations
(plain, lvm over iscsi, and raid over iscsi).

525. By Ryan Harper on 2017-09-07

mdadm: handle write failures to sysfs entries when stopping mdadm

mdadm_stop command tries a number of methods to stop an existing
array. Writes to sysfs fail differently, this patch catches both
IOErrors and OSErrors when writing to sysfs entries, logs and continues
with the stop operation.

Updating the LVM over RAID vmtest to run in dirty_disk mode reproduces
a failure reported and is resolved with this branch.

LP: #1708052

524. By Joshua Powers on 2017-09-01

vmtest: catch exceptions in curtin-log-print

Wraps the calling of curtin-log-print to catch any exceptions
that result. Was causing large image files to be left behind as
an exception generated by the curtin-log-print prevented proper
cleanup.

LP: #1714592

523. By Ryan Harper on 2017-09-01

iscsi: use curtin storage config to disconnect iscsi targets

When curtin disconnects from iscsi targets after an install, it does so
after unmounting the targets, however it passed the target dir into the
iscsi disconnect code which then silently failed to find any
session configurations.

We've been lucky as the existing shutdown iscsi service has been
logging out of sessions defined on the host; however on recent
Artful systems, the open-iscsi service is not restarted after
populating /etc/iscsi/nodes directory and since it is not running
in the ephemeral environment the service will not automatically
stop the iscsi devices, causing a hang on shutdown.

To resolve this parse the curtin storage config for iscsi disks,
construct IscsiDisk objects and then call their disconnect() method.
In addition to this logic fix, this branch contains:

- adds a missing Artful LVM Iscsi vmtest class
- Updated logging messages in iscsi paths, including
  a message when iscsi_disconnect doesn't find the
  /etc/iscsi/nodes directory.
- Updated IscsiDisk disconnect with similar logging

522. By Ryan Harper on 2017-08-22

vmtests: bump skip_by_date values out to give cloud-init SRU more time

521. By Scott Moser on 2017-08-15

vmtest: get info about collected symlinks and then delete them.

Some of the 'collect' scripts collect files with 'cp -a' or other
means that would collect a symbolic link. Since none of our
scripts yet handle properly resolving absolute symlinks we just
remove all symlinks and write a file 'symlinks.txt' with info about them.

At a later date we might need to also clean out sockets or other content.

The primary motivation for this is to
a.) make sure tests don't inadvertantly read the target of the symlink
    and thus "verify" files on the host
b.) jenkins can produce a zip file of the artifacts, and we suspect that
    it is bothered by the symbolic links.