~chad.smith/curtin:cleanup/1847138-time-drift-unittest-fix

Last commit made on 2019-10-07
Get this branch:
git clone -b cleanup/1847138-time-drift-unittest-fix https://git.launchpad.net/~chad.smith/curtin
Only Chad Smith can upload to this branch. If you are Chad Smith please log in for upload directions.

Branch merges

Branch information

Name:
cleanup/1847138-time-drift-unittest-fix
Repository:
lp:~chad.smith/curtin

Recent commits

d7ca0ed... by Chad Smith

tests: fix time drift unit issue on timestamped log

LP: #1847138

7a22938... by Ryan Harper

Handle partial raid on partitions

Consider disks and partitions when checking for holders that
need removal before they can be used. Additionally when shutting
down a raid, if it is inactive or broken, writes to the /dev/mdX
device will fail which is expected, don't exit instead, log a
non-fatal error and continue with shutting down the raid.

With these fixes TestReuseRAIDMemberPartition vmtests now pass.

LP: #1835091

489c014... by Ryan Harper

install: export zpools if present in the storage-config

Curtin needs to run zpool export on the any pool it created
before booting as zfs-initramfs 0.8 now requires a pool to
be exported before being imported.

LP: #1838278

86ede8a... by Ryan Harper

block-schema: allow 'mac' as partition table type

On PPC64, the partition table on the live iso is 'mac'.
Add this value to the partition type schema.

LP: #1845611

390efbb... by Paride Legovini

jenkins-runner: disable the lockfile timeout by default

When CURTIN_VMTEST_IMAGE_LOCK_TIMEOUT is set to a negative integer
disable the lockfile timeout. By default set it to -1 (no timeout).

Rationale: while it is useful to have a timeout, there is no
sensible default. In a run like (parameters omitted):

  $ jenkins-runner &
  $ vmtest-sync-images &
  $ jenkins-runner

the second jenkins-runner will have to wait for the first one to
finish, as it's locked by vmtest-sync-images. A full vmtest run
can take several hours. I easily spotted successful runs that
took more than 16 hours on our Jenkins log. Setting the default
timeout to something like 20 hours should be safe, but I still
don't think it's a good default, as it is too high for all the
cases where only a subset of the tests is being run. The timeout
is too dependent on the hardware, on how busy the server is,
and on the set of tests which is run. No size fits all.

Other minor changes:
 - Force CURTIN_VMTEST_IMAGE_LOCK_TIMEOUT to be an integer
 - Remove unnecessary quotes around fixed strings

6c0ca57... by Dan Watkins

curthooks: use correct grub-efi package name on i386

i.e. grub-efi-ia32 instead of grub-efi-i386.

LP: #1845914

4cdb7fd... by Paride Legovini

vmtest-sync-images: remove unused imports

2d059d1... by Paride Legovini

vmtests: use file locking on the images

This change implements a file locking mechanism in the
jenkins-runner and vmtest-sync-images scripts.

The vmtest-sync-images script requires two exclusive locks
to start updating the images: a lock on IMAGE_DIR and a
lock on a lockfile. The script will wait to get both locks
locks before actually updating the images.

The jenkins-runner script does the following:

 (1) set a shared lock on IMAGE_DIR
 (2) set a shared lock on the lockfile
 (3) release the lock on IMAGE_DIR
 (4) run the vmtests
 (5) exit (releasing the lock on the lockfile)

The jenkins-runner does not hold a lock on IMAGE_DIR while
running, allowing vmtest-sync-images to set a lock there,
prevending further jenkins-runners from running the vmtests
while the images are being updated. In other words
vmtest-sync-images can "book" the images for the next
available slot.

Steps (1) and (3) can be skipped by passing the
--skip-images-dirlock option to jenkins-runner. In this way
jenkins-runner has precedence over vmtest-sync-images. This
is useful when it should run ASAP, for example in CI runs.

6f8ed52... by Paride Legovini

vmtest: enable arm64

 * Call qemu with the correct -machine/-cpu options
 * Default to UEFI boot
 * Boot the Ubuntu "ga" arm64 kernel
 * Disable the unsupported configurations (e.g. CentOS tests)

vmtest: bump the VM memory for Cosmic to 2GB

112b024... by Paride Legovini

Make the vmtests/test_basic test suite run on ppc64el

Changes:
 - On ppc64el inject a PReP partition to the storage configuration
 - Expect a GPT partition table and not a DOS one on ppc64el
 - Skip XenialGAi386TestBasic if target_arch != amd64
 - Skip XenialGAi386TestZfsRoot if target_arch != amd64
 - Skip XenialGAi386TestZfsRootFsType if target_arch != amd64
 - Skip test_partition_is_zero on ppc64el (LP: #1843288)
 - Skip all the CentOS tests if target_arch = ppc64el