Author: Scott Moser
Revision Date: 2017-08-15 14:59:11 UTC

vmtest: get info about collected symlinks and then delete them.

Some of the 'collect' scripts collect files with 'cp -a' or other
means that would collect a symbolic link. Since none of our
scripts yet handle properly resolving absolute symlinks we just
remove all symlinks and write a file 'symlinks.txt' with info about them.

At a later date we might need to also clean out sockets or other content.

The primary motivation for this is to
a.) make sure tests don't inadvertantly read the target of the symlink
    and thus "verify" files on the host
b.) jenkins can produce a zip file of the artifacts, and we suspect that
    it is bothered by the symbolic links.

Author: Ryan Harper
Revision Date: 2017-08-15 19:45:27 UTC

merge from trunk

Author: Chad Smith
Revision Date: 2017-08-03 19:43:46 UTC

s/CiTestCase/CurtinTestCase/

Author: Scott Moser
Revision Date: 2017-06-12 20:52:38 UTC

Add SRU to changelog

Author: Scott Moser
Revision Date: 2017-06-12 20:46:39 UTC

Add SRU to changelog

Author: Scott Moser
Revision Date: 2017-06-12 20:48:50 UTC

Add SRU to changelog

Author: Scott Moser
Revision Date: 2017-06-12 19:45:37 UTC

releasing package curtin version 0.1.0~bzr505-0ubuntu1

Author: Joseph Borg
Revision Date: 2017-05-16 10:30:53 UTC

Remvoing setup steps that require raised privileges

Author: Ryan Harper
Revision Date: 2017-05-02 14:02:49 UTC

vmtests: add test for huge disks 8TB in lvm and raid

Author: Nish Aravamudan
Revision Date: 2017-04-24 23:23:00 UTC

Merge with lp:curtin.

Author: Nish Aravamudan
Revision Date: 2017-04-04 23:48:30 UTC

vmtests: iSCSI targets can contain ':'

So we cannot use ':' as the separator for iscsi disk specifications to
tools/launch, because it becomes ambiguous and makes the code more
complicated. Instead, use '|' and special-case the `awk` delimiter if
'iscsi' is found in the disk specification to launch.

Author: Artur Molchanov
Revision Date: 2017-03-02 16:02:15 UTC

Remove unused 'pprint' module

Author: Nish Aravamudan
Revision Date: 2017-02-24 00:04:57 UTC

Store temporary YAML in logs/.

Author: Ryan Harper
Revision Date: 2017-02-23 22:42:47 UTC

net: allow bridges with just ports

Author: Scott Moser
Revision Date: 2017-02-22 16:29:33 UTC

debian/rules: record debian package version in installed package.
(LP: #1666986)

Author: Scott Moser
Revision Date: 2017-02-22 16:27:44 UTC

debian/rules: record debian package version in installed package.
(LP: #1666986)

Author: Paul Larson
Revision Date: 2017-02-16 17:15:20 UTC

pass cwd to subp() instead of using cd

Author: Joshua Powers
Revision Date: 2017-02-07 17:14:32 UTC

pycodestyle cleanup of ambigious name

Author: Scott Moser
Revision Date: 2017-01-20 19:15:34 UTC

vmtest: add 'webserv' helper

Rather than running python -m SimpleHTTPServer for the web server
add a program 'webserv' in tools/ dir and use that.

The benefits of this approach are:
 a.) no longer need python2 (we were invoking with 'python')
 b.) webserv listens on both ipv4 and ipv6 addresses.

Author: Ryan Harper
Revision Date: 2017-01-12 19:46:38 UTC

Disable update-grub call for multipath; it's not needed and cause random failures due to double mounts of the target partition with undefined behavior when reading from the filesystem

Author: Mathieu Trudel-Lapierre
Revision Date: 2016-12-23 03:53:37 UTC

Don't fallback to linux-generic: linux-generic and linux-image-generic 404 in curtin on zesty.

Author: Joshua Powers
Revision Date: 2016-12-15 20:07:14 UTC

First update to download v3 MAAS images including squashfs

Author: Ruslan Lutsenko
Revision Date: 2016-11-14 16:10:47 UTC

raid devices also use name /dev/md0p1

Author: Wesley Wiedenmeier
Revision Date: 2016-10-06 22:37:06 UTC

Allow custom pack commands to be used in tools/launch

Author: Scott Moser
Revision Date: 2016-09-22 20:48:25 UTC

adding code i was playing with.

The intent of this would be for curtin to do something like the main
here. Instead of invoking the shell reboot function, it would
search for a parent that it liked (such as one named cloud-init).
If there was no good looking parent, then it would use itself.

So basically:
 - select a process P to wait until it is gone.
 - fork
 - exit from main process
 - second process polls for process P to have left the building
 - second process (conditionally) invokes the reboot.

Author: Wesley Wiedenmeier
Revision Date: 2016-09-15 18:05:06 UTC

Merge from trunk to pull optionally ignoring errors in mdadm.mdadm_assemble

Author: Joshua Powers
Revision Date: 2016-09-01 21:14:18 UTC

Adding no test flag to __init__.py to prevent empty tests.

Author: Wesley Wiedenmeier
Revision Date: 2016-08-30 19:29:36 UTC

Fix missing dicstring in bloc.sysfs_partition_data

Author: Wesley Wiedenmeier
Revision Date: 2016-08-23 00:01:50 UTC

Merge from trunk

Author: Wesley Wiedenmeier
Revision Date: 2016-08-22 05:06:58 UTC

Added unittests for curtin.workingdir

Author: Wesley Wiedenmeier
Revision Date: 2016-08-20 21:53:19 UTC

Merge from trunk

Author: Wesley Wiedenmeier
Revision Date: 2016-08-17 00:14:53 UTC

Use util.workingdir paths in commands

Author: Ryan Harper
Revision Date: 2016-08-15 16:43:26 UTC

fix formatting

Author: Scott Moser
Revision Date: 2016-08-08 12:52:18 UTC

Fix the unittests for test_apt_source.

The tests were written to use 'assert_called', which is only available
in mock versions 2.0. Because of this, the failure would only occur
in releases less than yakkety and not in 'tox'.

Author: Wesley Wiedenmeier
Revision Date: 2016-08-07 02:58:50 UTC

Add vmtest for dos extended/logical partitioning

Author: Wesley Wiedenmeier
Revision Date: 2016-08-03 21:08:39 UTC

Merge from trunk to bring in unittest fix

Author: Wesley Wiedenmeier
Revision Date: 2016-07-30 23:16:43 UTC

Merge from trunk

Author: Wesley Wiedenmeier
Revision Date: 2016-07-28 20:05:28 UTC

Add vmtests with a configurable amount of delay in posting webhook reporting
events to replicate (LP: 1606999)

Author: Wesley Wiedenmeier
Revision Date: 2016-07-22 18:46:14 UTC

Moved logic for stalling until enough memory available for test is available to
here from storagetests

Author: Ryan Harper
Revision Date: 2016-07-19 14:46:27 UTC

more fixups from run on power hardware

Author: Wesley Wiedenmeier
Revision Date: 2016-07-05 22:35:15 UTC

Fix naming error

Author: Wesley Wiedenmeier
Revision Date: 2016-06-14 21:00:37 UTC

In unittests.test_enum, skip the enum test class if tests running in an
environment that does not have the builtin enum module available. Since the
tests validate both the builtin and bakcup enum module it is okay to skip these
tests when the builtin enum is not available, as they will still fully cover
the enum module

In block_meta, make a few style fixes to get tox passing for the trusty version
of pep8, which seems to have different opinions about hanging indents than the
xenial version of pep8

Author: Wesley Wiedenmeier
Revision Date: 2016-06-07 16:39:56 UTC

Use a name set defined in block.__init__ near wipe_volume for wipe modes

Author: Wesley Wiedenmeier
Revision Date: 2016-06-06 17:35:07 UTC

Reverted get_volume_uuid function and test

Author: Wesley Wiedenmeier
Revision Date: 2016-06-03 01:35:19 UTC

Fixed python2 compat issue

Author: Wesley Wiedenmeier
Revision Date: 2016-05-30 19:56:23 UTC

Merge from blkid

Author: Wesley Wiedenmeier
Revision Date: 2016-05-07 02:36:36 UTC

Reverted local revision 383 which was a fix for reporter timestamps not being
set correctly, as a different implementation of the same fix already went into
trunk

Author: Paolo de Rosa
Revision Date: 2016-04-26 12:45:03 UTC

fix indenteation

Author: Wesley Wiedenmeier
Revision Date: 2016-04-10 21:47:28 UTC

Merged from trunk

Author: Wesley Wiedenmeier
Revision Date: 2016-04-06 20:06:55 UTC

Merged from trunk

Author: Wesley Wiedenmeier
Revision Date: 2016-04-04 09:28:27 UTC

During error message output use '' in output text if stdout or stderr is empty
to show it is empty

Author: Wesley Wiedenmeier
Revision Date: 2016-03-10 23:45:04 UTC

Updated vmtests to use the new launch format for special disks

Author: Diogo Matsubara
Revision Date: 2016-03-04 21:04:17 UTC

merge from trunk

Author: Dimitri John Ledkov
Revision Date: 2016-03-04 13:37:28 UTC

Use UUID, if available, for full-disk*, partition or dm-crypt volumes.

Previously, if a full-disk was formatted with a filesystem
(e.g. btrfs) instead of mounting by UUID, it was mounted by path
(/dev/vdd). However, a uuid can be used instead.

Author: Scott Moser
Revision Date: 2016-03-02 16:56:17 UTC

hackily fix writing of multipath bindings file

this is just a hack/quick fix, but one that does work for me.

I also have another that uses dpkg --compare-versions
to compare the versions.

Author: ChristianEhrhardt
Revision Date: 2016-02-23 08:21:05 UTC

Fixup PsuedoImageStore regarding HWE Tests

Author: Wesley Wiedenmeier
Revision Date: 2016-02-23 03:35:00 UTC

message language fix

Author: Wesley Wiedenmeier
Revision Date: 2016-01-31 19:28:10 UTC

Updated config, now installs with efi properly, still does not boot with ovmf
though

Author: Wesley Wiedenmeier
Revision Date: 2016-01-28 03:23:52 UTC

Merge from lp:~smoser/curtin/trunk.install-kernel-fix

Author: Wesley Wiedenmeier
Revision Date: 2016-01-14 02:40:54 UTC

Added tools/apply-storage-config for easy way to use commands.block_meta in
standalone mode

Author: Wesley Wiedenmeier
Revision Date: 2016-01-04 16:31:15 UTC

Added partitioning code for GPTTale

Author: Wesley Wiedenmeier
Revision Date: 2016-01-01 22:25:18 UTC

Ensure that byte input to ProcessExecutionError is converted to str

Author: Wesley Wiedenmeier
Revision Date: 2015-12-22 16:25:09 UTC

Check partition flag to ensure that it is valid

Author: Scott Moser
Revision Date: 2015-12-18 20:53:06 UTC

fix logic error in kernel installation

If a kernel package was available but not installed
the code would use the fallback path, rather than installing it.

This fixes the logic error and uses 'has_pkg_available'.

Author: Jon Grimm
Revision Date: 2015-12-10 21:51:04 UTC

Enable coverage test for unit tests

Enabling for vmtest will take a bit more thought, as well as,
combining results all test runs. HTML reports later too. Additionally,
teach bzr to ignore .coverage directory where runtime coverage data gets
written to.

To run:
   make unittest COVERAGE=1
or
   make coverage

The 'coverage' target will grow to support coverage testing all tests.
The default options for nose coverage opts can be overridden via
the 'coverageopts' environment variable.

Author: Scott Moser
Revision Date: 2015-12-09 18:02:23 UTC

remove copied / bad code

Author: Diogo Matsubara
Revision Date: 2015-11-17 15:11:17 UTC

increase timeout

Author: ChristianEhrhardt
Revision Date: 2015-11-16 12:19:19 UTC

Avoid false positive errors as logger might not be defined when
calling remove_tmpdir

Author: Ricardo Bánffy
Revision Date: 2015-11-12 14:44:51 UTC

Adding autopkgtest placeholders

Author: Diogo Matsubara
Revision Date: 2015-11-10 19:57:28 UTC

Incorporate Scott's changes to simplestreams branch
 - add a new get_env_var_bool() function that does the right things with env vars
 - add qemu as a dependency for tools/vmtest-system-setup
 - make IMAGE_SRC_URL settable from a env var
 - add progress output if sstream-mirror supports it
 - fix filters to be a list rather than string

Author: ChristianEhrhardt
Revision Date: 2015-11-10 07:34:36 UTC

fix fallback for non hwe cases now that we are specifying subarch instead of
krel

Author: ChristianEhrhardt
Revision Date: 2015-11-10 07:34:36 UTC

fix fallback for non hwe cases now that we are specifying subarch instead of
krel

Author: Diogo Matsubara
Revision Date: 2015-10-27 11:26:56 UTC

merge from trunk, solved 2 conflicts

Author: ChristianEhrhardt
Revision Date: 2015-10-13 19:11:37 UTC

Install certain dependencies to support more filesystem types

Author: Diogo Matsubara
Revision Date: 2015-09-21 20:02:55 UTC

fix output disk usage of tar to extract the files when the work is done not when the files don't exist

Author: Wesley Wiedenmeier
Revision Date: 2015-08-16 15:59:50 UTC

Added documentation on running vmtests

Author: Oleg Strikov
Revision Date: 2015-06-17 13:13:56 UTC

multipath: Bugfix and additional comments.

Function get_scsi_wwid() may return None in case of errors or an empty
string in case of a buggy disk. Ignore these values.

Add more comments to describe all corner cases we've met while working
on multipath implementation.

Author: Oleg Strikov
Revision Date: 2015-06-10 13:13:57 UTC

block_meta: Notify user if curtin can't find any disk to install os on.

Right now curtin crashes with 'list index out of range' error message
while trying to access the first element of an empty list of disks.
This can be confusing (see LP:1451490). This commit adds meaningful
error message to let user know what went wrong.

Author: Oleg Strikov
Revision Date: 2015-06-03 15:05:56 UTC

Detect and handle multipath devices.

Detect multipath by looking for multiple devices with the same
scsi id (serial number). Install multipath-tools package if such
devices exist.

Author: Scott Moser
Revision Date: 2014-08-18 18:07:48 UTC

install_kernel: run apt-get update and code cleanups

before searching in the target, we need to run apt-get update.

Also, clean up some of the code.
Move outside the in_chroot block things that don't need to be there.

Improve comments.

Author: Scott Moser
Revision Date: 2014-08-13 14:41:08 UTC

late commands, not final commands