lp:~raharper/curtin

Author: Ryan Harper
Author Date: 2019-12-06 17:15:05 UTC

Missed an unset of OUTPUT_FSTAB, set it to the tmp path

Author: Ryan Harper
Author Date: 2019-12-16 19:25:01 UTC

Use common method for enumerating tools used, add docstrings.

Author: Ryan Harper
Author Date: 2019-12-10 15:11:33 UTC

Fix typo in clear-holders plan shutdown comment

Author: Ryan Harper
Author Date: 2019-12-04 20:50:11 UTC

Don't modify xkvm nographic

Author: Ryan Harper
Author Date: 2019-11-20 03:12:30 UTC

Add unittest for probing raid1 partitions

Author: Ryan Harper
Author Date: 2019-11-13 15:40:06 UTC

Drop debug prints

Author: Ryan Harper
Author Date: 2019-11-05 15:21:54 UTC

Release 19.3

Bump the version in curtin/__init__.py to be 19.3.

LP: #1851390

Author: Ryan Harper
Author Date: 2019-11-04 19:18:50 UTC

Update HACKING.rst with Josh Powers contact info.

Author: Ryan Harper
Author Date: 2019-10-24 20:38:35 UTC

use assertIsNotNone, expand _d2k

Author: Ryan Harper
Author Date: 2019-10-24 19:03:08 UTC

vmtest: skip ipv6-mtu testing, still broken

Author: Ryan Harper
Author Date: 2019-10-24 15:42:21 UTC

Replace use of 'unsupported' with schemas._ptable_unsupported

Author: Ryan Harper
Author Date: 2019-10-23 21:40:07 UTC

Drop inner try/except and continue on Exception

Author: Ryan Harper
Author Date: 2019-10-23 16:57:18 UTC

vmtest: update skip_if_arch message

Currently the skip message reads like this:

SKIP: skip due to ppc64el=ppc64el

With this change we'll see:

SKIP: skip due to current arch=ppc64el

Author: Ryan Harper
Author Date: 2019-10-23 16:18:07 UTC

tools/xkvm: add -nographic to speed up devopt query

On systems which include qemu graphical components the time
needed to invoke qemu for querying if an string is a device
option can take many seconds, especially over remote connections.
Adding the '-nographic' parameter prevents qemu from loading
and launching additional resources that are not needed to determine
the devopt query answer.

Author: Ryan Harper
Author Date: 2019-10-18 14:37:24 UTC

Add bug reference to SkipTest message

Author: Ryan Harper
Author Date: 2019-10-17 21:25:28 UTC

Add skip_by_date to eoan ipv6 vlan test

Author: Ryan Harper
Author Date: 2019-10-10 22:26:53 UTC

vmtest: Add skip_by_date for test_ip_output on eoan + vlans

Author: Ryan Harper
Author Date: 2019-10-07 21:13:35 UTC

block-schema: update raid schema for preserve and metadata

Curtin can now accept type: raid storage config which sets the
preserve key booloean to keep a raid configuration and separately
set the 'wipe' key to clear the data on the raid device.

We also accept a 'metadata' version hint in the schema as curtin
passes this value along as info to users of block-discover.

Author: Ryan Harper
Author Date: 2019-10-07 21:08:37 UTC

dasd: update partition table value to 'vtoc'

DASD devices use a 'vtoc' partition table type. It is similar to DOS
but it is not in MS-DOS format. Adjust this value to 'vtoc' in docs,
block schema and the example config for vmtest.

LP: #1847073

Author: Ryan Harper
Author Date: 2019-09-18 10:22:03 UTC

Update vmtest verification for simple

Author: Ryan Harper
Author Date: 2019-09-18 12:45:40 UTC

Handle zfsroot in type:format and add unittests

Author: Ryan Harper
Author Date: 2019-09-27 14:20:01 UTC

block-schema: allow 'mac' as partition table type

On PPC64, the partition table on the live iso is 'mac'.
Add this value to the partition type schema.

LP: #1845611

Author: Ryan Harper
Author Date: 2019-09-26 00:01:35 UTC

udev: use --export to get shell sourceable values

Author: Ryan Harper
Author Date: 2019-09-17 14:34:34 UTC

ChrootableTarget: mount /run as well, resolve lvm/mdadm issues which require /run

Author: Ryan Harper
Author Date: 2019-09-12 00:41:11 UTC

vmtests: bionic instances are now OOM'ing due to memory footprint increase from snapd/lxd/updates

Author: Ryan Harper
Author Date: 2019-09-12 00:31:43 UTC

Don't try to install it hangs on boot

Author: Ryan Harper
Author Date: 2019-09-09 16:58:06 UTC

util: add support for 'tbz', 'txz' tar format types to sanitize_source

Curtin already supports tar.bz[2] and tar.xz via the helpers/smtar
tool but is missing the short-hand used in santize_sources to convert
a source URI into a source dictionary. This branch adds the two types
and adds unittest.

LP: #1843266

Author: Ryan Harper
Author Date: 2019-09-06 19:15:14 UTC

Remove whitespace damage

Author: Ryan Harper
Author Date: 2019-08-02 12:35:08 UTC

Update comment around exception handling for partial raid shutdown

Author: Ryan Harper
Author Date: 2019-08-28 16:40:53 UTC

releasing curtin version 19.2-9-g38ce22b0-0ubuntu1

Author: Ryan Harper
Author Date: 2019-08-26 22:42:47 UTC

Even more compact version.

Author: Ryan Harper
Author Date: 2019-08-08 15:59:53 UTC

Also update the runtime package name

Author: Ryan Harper
Author Date: 2019-08-02 12:36:23 UTC

Skip test_ip_output as well

Author: Ryan Harper
Author Date: 2019-08-01 14:45:27 UTC

Fix typo on EoanBcacheBasic

Author: Ryan Harper
Author Date: 2019-07-29 16:26:53 UTC

Make sure we deal in strings

Author: Ryan Harper
Author Date: 2019-07-29 15:23:14 UTC

Bump fixby date out some more

Author: Ryan Harper
Author Date: 2019-07-29 12:17:25 UTC

vmtest: drop Cosmic

Author: Ryan Harper
Author Date: 2019-07-23 18:08:42 UTC

unittests: mock subp in ChrootableTarget _exit_ test cases

Author: Ryan Harper
Author Date: 2019-07-17 19:49:14 UTC

Release 19.2

Bump the version in curtin/__init__.py to be 19.2.

LP: #1836951

Author: Ryan Harper
Author Date: 2019-07-05 15:05:48 UTC

ChrootableTarget: restore resolv.conf after rename if copy fails

If the copy of resolv.conf after a rename of an in-target resolv.conf
fails we will end up removing the in-target resolv.conf. Fix this by
checking if we renamed and if so restore the file before we remove
the temporary directory that was holding the original resolv.conf.

Author: Ryan Harper
Author Date: 2019-06-21 19:40:43 UTC

Reword logged error when strict=False to not trip up vmtest error detection.

Author: Ryan Harper
Author Date: 2019-06-12 21:03:08 UTC

update changelog

Author: Ryan Harper
Author Date: 2019-06-12 20:55:08 UTC

update changelog

Author: Ryan Harper
Author Date: 2019-06-12 20:21:47 UTC

update changelog

Author: Ryan Harper
Author Date: 2019-06-12 19:25:34 UTC

update changelog

Author: Ryan Harper
Author Date: 2019-06-06 20:35:08 UTC

Make flake8 happy, drop unused import

Author: Ryan Harper
Author Date: 2019-06-05 13:58:32 UTC

clarify btrfs-debug-tree comment

Author: Ryan Harper
Author Date: 2019-06-04 23:34:27 UTC

vmtests: determine block name via dname when verifying volume groups

The LVM tests verify `pvs` output to check that a VG is composed of
the specified devices from the storage config. The current test
expected /dev/sda, /dev/sdb for certain VGs, however, sda/sdb kernel
names are not stable and sometimes we would fail to verify when the
order was swapped. Instead we now look up the dname, which is stable
to determine the kname of the specific disk at runtime and use that
to verify the VG is composed of the correct devices.

Author: Ryan Harper
Author Date: 2019-06-04 14:56:43 UTC

Add more random data to seed

Author: Ryan Harper
Author Date: 2019-06-03 19:47:20 UTC

storage_config: compact vertical space on dos parts, add unittests.

Author: Ryan Harper
Author Date: 2019-05-29 21:31:27 UTC

Add comments explaining parsing changes for networking tests.

Author: Ryan Harper
Author Date: 2019-05-16 15:17:38 UTC

vmtest: add missing skip_by_date on Eoan test_network_mtu

Author: Ryan Harper
Author Date: 2019-05-16 15:10:55 UTC

vmtest: remove skip_by_date on Disco Allindata test

This test now passes so remove the skip_by_date decorator.

Author: Ryan Harper
Author Date: 2019-05-10 15:43:28 UTC

partition_kname: clarify comment, remove 'dm' from dev_type

Author: Ryan Harper
Author Date: 2019-05-07 21:30:14 UTC

Chad spell check

Author: Ryan Harper
Author Date: 2019-05-07 18:59:36 UTC

vmtest: network mtu bump; need to verify commited fix and then revisit

Author: Ryan Harper
Author Date: 2019-05-07 18:32:25 UTC

Update decorator, skip test_basic Scsi version as well

Author: Ryan Harper
Author Date: 2019-05-06 20:55:36 UTC

Fix up yaml.load warnings

Replace most calls with curtin.config.load_config. For a few
cases which parse strings, use yaml.safe_load.

Author: Ryan Harper
Author Date: 2019-05-02 14:30:21 UTC

vmtest: disable trusty, it's dead jim

Author: Ryan Harper
Author Date: 2019-04-18 15:43:19 UTC

vmtest: re-enable UEFI 4k tests, which got dropped when fixing subclassing.

Author: Ryan Harper
Author Date: 2019-04-17 15:23:10 UTC

vmtests: Add test_kernel_img_conf stub for PsuedoVMBaseClass

Author: Ryan Harper
Author Date: 2019-04-16 21:48:44 UTC

curthooks: chzdev_import must encode data if provided

subprocess's stdin requires a bytes-like object so callers
must encode string values to bytes before submitting them.

LP: #1825007

Author: Ryan Harper
Author Date: 2019-04-16 14:59:35 UTC

vmtest: test for kernel-img conf on ubuntu only

Author: Ryan Harper
Author Date: 2019-04-02 15:57:22 UTC

Fix tox and unittests after rebase to master

Author: Ryan Harper
Author Date: 2019-03-28 19:23:17 UTC

drop debug print statement

Author: Ryan Harper
Author Date: 2019-03-29 15:00:27 UTC

vmtest: fix _serial_to_kname for scsi disks

Author: Ryan Harper
Author Date: 2019-03-29 20:44:17 UTC

schema-validate: rework cli to store file in config parameter, use --storage as boolean to indicate which validator to use.

Author: Ryan Harper
Author Date: 2019-03-29 15:40:59 UTC

vmtest: skip DiscoTestAllindata dm_crypt test while initrd lacks crypto modules

Author: Ryan Harper
Author Date: 2019-03-20 21:21:20 UTC

migrate code from tools/block-discover to storage_config

Move the existing parse/extract/merge code from the tools
program into curtin.storage_config and expose a new API
storage_config.extract_storage_config() which takes the
probert storage data and performs the extract and merge.

Implement the rest of zfs_asdict and fix up an ordering
issue on type: zfs.

Author: Ryan Harper
Author Date: 2019-03-04 23:17:50 UTC

dmcrypt: add missing kernel modules in disco

Author: Ryan Harper
Author Date: 2019-02-27 16:13:37 UTC

vmtest: consolidate vm mem configuration, defaults via release, env override

Author: Ryan Harper
Author Date: 2019-02-19 15:34:07 UTC

zfs: configure zpool cachefile on create

Author: Ryan Harper
Author Date: 2019-02-14 14:34:33 UTC

Tighten up assignment of default mounts to allow no mounts

Author: Ryan Harper
Author Date: 2019-02-05 19:26:24 UTC

Add unittests for additional udevinfo values used when creating dname byid for disks

Author: Ryan Harper
Author Date: 2019-01-24 16:48:32 UTC

clear-holders: don't identify bcache partitions as bcache devices

Author: Ryan Harper
Author Date: 2019-01-25 21:27:43 UTC

vmtest: bump skip_by_date out a year for trusty bcache bug

Author: Ryan Harper
Author Date: 2019-01-24 16:19:34 UTC

vmtest: flake8: use ==/!= to compare str, btes, and int literals

Author: Ryan Harper
Author Date: 2019-01-16 01:31:06 UTC

vmtests: add expected_failure decorator for known broken Xenial test.

Author: Ryan Harper
Author Date: 2019-01-07 15:16:53 UTC

vmtests: network mtu fix-by bump to post 19.04 release

Author: Ryan Harper
Author Date: 2018-12-06 18:11:37 UTC

releasing curtin version 18.2-0ubuntu1

Author: Ryan Harper
Author Date: 2018-12-06 15:44:49 UTC

Release 18.2

Author: Ryan Harper
Author Date: 2018-11-28 22:16:24 UTC

unittest: add test_udev tests

Author: Ryan Harper
Author Date: 2018-11-16 20:26:01 UTC

vmtests: add docstrings to test_simple classes

Author: Ryan Harper
Author Date: 2018-11-13 16:46:21 UTC

vmtests: detect OOM during install and fail vmtest

Author: Ryan Harper
Author Date: 2018-11-06 19:43:51 UTC

test_basic: use udevadm info to extract ID_PART_ENTRY_TYPE value from partition

Author: Ryan Harper
Author Date: 2018-10-17 19:49:47 UTC

Also capture status, included journal output is easier to access for debug

Author: Ryan Harper
Author Date: 2018-10-17 17:57:26 UTC

vmtest: handle collect disk unpack failure

If unpacking a collect disk fails, we don't chmod the collect
disk output which can leave un-removable files for non-root users.
Fix this by catching the CalledProcessException and adding a
finally clause to run the recursive chmod.

Author: Ryan Harper
Author Date: 2018-10-16 14:35:46 UTC

Fix missing colon

Author: Ryan Harper
Author Date: 2018-10-11 23:28:25 UTC

vmtests: disable snapd/seeding to avoid boot hang

In Cosmic some snaps are now seeded in the image and will
automatically install/mount at runtime. Overlayroot has
exposed a bug in snapd but prevents images from booting
completely. Workaround this issue (bug #1797218)
snapd and snapd.seeded services. A nice side-effect is that
those images with seeded snaps boot faster and use less
memory.

Author: Ryan Harper
Author Date: 2018-10-10 19:25:15 UTC

jenkins-runner: fix when using --filter only

The elsif clause when checking for tests via positional or filter
parameters never took the path where we invoked vmtest-filter.
Fix this by only pre-populating tests with 'tests/vmtests' if
there are no positional parameters and no filter parameters.

Also re-indent filter block to match program style.

Author: Ryan Harper
Author Date: 2018-10-10 16:22:55 UTC

releasing curtin version 18.1-59-g0f993084-0ubuntu1

Author: Ryan Harper
Author Date: 2018-10-10 15:49:55 UTC

Remove some debugging and add comments on why using reset_mock()

Author: Ryan Harper
Author Date: 2018-10-09 19:13:11 UTC

Fix review comments

Author: Ryan Harper
Author Date: 2018-09-24 15:22:53 UTC

vmtests: prevent tests from modifying cls.collect_scripts

vmtests now has a set of collect scripts which are shared in all
subclassed tests and should not be modifed by the subclass. Fix
test_lvm_raid.py which modified cls.collect_scripts to use
extra_collect_scripts and update the base class to raise a RuntimeError
if a subclass presents a modified cls.collect_scripts.

Author: Ryan Harper
Author Date: 2018-09-05 17:41:18 UTC

Allow user config to override passno value

Author: Ryan Harper
Author Date: 2018-09-21 08:05:31 UTC

releasing curtin version 18.1-52-g5f0082d1-0ubuntu1

Author: Ryan Harper
Author Date: 2018-09-21 06:23:22 UTC

Drop debug and fix empty check to size of array

Author: Ryan Harper
Author Date: 2018-08-21 14:06:14 UTC

Error out if we've already copied journal once.

Author: Ryan Harper
Author Date: 2018-08-18 01:41:14 UTC

Don't allow reads of /proc and modprobe zfs through

New zfs_supported check reads /proc/filesystems to see if
zfs is already available and attempts to modprobe. These things
fail under launchpad sbuilds. Make sure to mock out the calls to
these functions and provide positive values for the failing unittest.

Author: Ryan Harper
Author Date: 2018-08-17 14:25:38 UTC

Swap order of is_zfs_member and zfs_supported in wipe_superblock