UPDATE#2 07/31/2018:
2nd SRU regresssion found by FrancisGinther testing Oracle. Expected OpenStack datasource not detected across dirty reboot after upgrade.
Cherry-picked fix for LP: #1784685 into Xenial and Bionic for this SRU.
UPDATE:
SRU regression found during 18.3.0 -proposed validation. fix is queued present in 18.3.9 for bug https://bugs.launchpad.net/cloud-init/+bug/1780481.
Updated description of changes for minor SRU-update to 18.3 targets Xenial, Artful and Bionic.
18.2.4 -> 18.3 changeset contains
- OpenStack now runs at local time frame network config can be rendered from network_data.json if configured "apply_network_config: true".
- Fix utf-8 content in user-data (LP: #1768600)
- many SmartOS improvements
== Begin SRU Template ==
[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these
improvements. The notable ones are:
- Explicitly prevent `sudo` access for user module [Jacob Bednarz]
- lxd: Delete default network and detach device if lxd-init created them.
- openstack: avoid unneeded metadata probe on non-openstack platforms
- stages: fix tracebacks if a module stage is undefined or empty
[Robert Schweikert]
- Be more safe on string/bytes when writing multipart user-data to disk.
- Fix get_proc_env for pids that have non-utf8 content in environment.
- netplan: fix mtu if provided by network config for all rendered types
- subp: support combine_capture argument.
- util: add get_linux_distro function to replace platform.dist
- Enable SmartOS network metadata to work with netplan via per-subnet
routes [Dan McDonald]
- openstack: Allow discovery in init-local using dhclient in a sandbox.
- yaml_load/schema: Add invalid line and column nums to error message
- Azure: Ignore NTFS mount errors when checking ephemeral drive
[Paul Meyer]
- Update version.version_string to contain packaged version.
- cc_mounts: Do not add devices to fstab that are already present.
[Lars Kellogg-Stedman]
- ds-identify: ensure that we have certain tokens in PATH.
- read_file_or_url: move to url_helper, fix bug in its FileResponse.
- ds-identify: recognize container-other as a container, test SmartOS.
- cloud-config.service: run After snap.seeded.service.
- SmartOS: fix get_interfaces for nics that do not have addr_assign_type.
- azure: Add reported ready marker file. [Joshua Chan]
- FreeBSD: Invoke growfs on ufs filesystems such that it does not prompt.
- netinfo: fix netdev_pformat when a nic does not have an address assigned.
- collect-logs: add -v flag, write to stderr, limit journal to single boot.
- IBMCloud: Disable config-drive and nocloud only if IBMCloud is enabled.
- Add reporting events and log_time around early source of blocking time
--- Addtional changelog delta for Xenial, Artful ----
- net: detect unstable network names and trigger a settle if needed
- DataSourceSmartOS: add locking of serial device. [Mike Gerdts]
- DataSourceSmartOS: sdc:hostname is ignored [Mike Gerdts]
- DataSourceSmartOS: list() should always return a list [Mike Gerdts]
- schema: in validation, raise ImportError if strict but no jsonschema.
- set_passwords: Add newline to end of sshd config, only restart if
updated.
- Schema: do not warn on duplicate items in commands.
- net: Depend on iproute2's ip instead of net-tools ifconfig or route
- DataSourceSmartOS: fix hang when metadata service is down [Mike Gerdts]
- DataSourceSmartOS: change default fs on ephemeral disk from ext3 to
ext4. [Mike Gerdts]
- Implement bash completion script for cloud-init command line
- renderer: support unicode in render_from_file.
- Implement ntp client spec with auto support for distro selection
- Apport: add Brightbox, IBM, LXD, and OpenTelekomCloud to list of clouds.
[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CloudinitUpdates
The cloud-init team will be in charge of attaching the artifacts and
console output of the appropriate run to the bug. cloud-init team
members will not mark ‘verification-done’ until this has happened.
* Automated Test Results
- xenial ec2, lxd, nocloud-kvm: attached xenial-integration-console.log xenial-integration-artifacts.tar.xz
- artful ec2, lxd, nocloud-kvm: attached artful-integration-console.log artful-integration-artifacts.tar.xz
- bionic ec2, lxd, nocloud-kvm: attached bionic-integration-console.log bionic-integration-artifacts.tar.xz
DONE: attach Solutions Testing team test results for each LTS
sru-artifact-solutions-qa-xenial
DONE: attach MAAS Team test results for each LTS
sru-artifact-maas-xenial
* Manual Test Results
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on ec2 datasource
sru-artifact-manual-ec2
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on gce datasource
sru-artifact-manual-gce
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on azure datasource
sru-artifact-manual-azure
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on openstack datasource
sru-artifact-manual-openstack
DONE: attach manual cloud-init-proposed test artifacts from tests for each release on softlayer datasource
sru-artifact-manual-softlayer
[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.
[Discussion]
Manual verification artifacts will also be hosted in the folllowing repository:
https://github.com/cloud-init/ubuntu-sru/tree/master/20180620
== End SRU Template ==
== Changelog ==
- Detect OpenStack datasource on Oracle Cloud (LP: #1777912)
- 18.3-9-g2e62cb8a-0ubuntu1
- docs: note in rtd about avoiding /tmp when writing files
- ubuntu,centos,debian: get_linux_distro to align with platform.dist
- Fix boothook docs on environment variable name (INSTANCE_I ->
INSTANCE_ID) [Marc Tamsky]
- update_metadata: a datasource can support network re-config every boot
- tests: drop salt-minion integration test
- Retry on failed import of gpg receive keys.
- tools: Fix run-container when neither source or binary package requested.
- docs: Fix a small spelling error. [Oz N Tiram]
- tox: use simplestreams from git repository rather than bzr.
- 18.3-0ubuntu1
- release 18.3
- docs: represent sudo:false in docs for user_groups config module
- Explicitly prevent `sudo` access for user module [Jacob Bednarz]
- lxd: Delete default network and detach device if lxd-init created them.
- openstack: avoid unneeded metadata probe on non-openstack platforms
- stages: fix tracebacks if a module stage is undefined or empty
[Robert Schweikert]
- Be more safe on string/bytes when writing multipart user-data to disk.
- Fix get_proc_env for pids that have non-utf8 content in environment.
- tests: fix salt_minion integration test on bionic and later
- tests: provide human-readable integration test summary when --verbose
- tests: skip chrony integration tests on lxd running artful or older
- test: add optional --preserve-instance arg to integraiton tests
- netplan: fix mtu if provided by network config for all rendered types
- tests: remove pip install workarounds for pylxd, take upstream fix.
- subp: support combine_capture argument.
- tests: ordered tox dependencies for pylxd install
- util: add get_linux_distro function to replace platform.dist
[Robert Schweikert]
- pyflakes: fix unused variable references identified by pyflakes 2.0.0.
- - Do not use the systemd_prefix macro, not available in this environment
[Robert Schweikert]
- doc: Add config info to ec2, openstack and cloudstack datasource docs
- Enable SmartOS network metadata to work with netplan via per-subnet
routes [Dan McDonald]
- openstack: Allow discovery in init-local using dhclient in a sandbox.
- tests: Avoid using https in httpretty, improve HttPretty test case.
- yaml_load/schema: Add invalid line and column nums to error message
- Azure: Ignore NTFS mount errors when checking ephemeral drive
[Paul Meyer]
- packages/brpm: Get proper dependencies for cmdline distro.
- packages: Make rpm spec files patch in package version like in debs.
- tools/run-container: replace tools/run-centos with more generic.
- Update version.version_string to contain packaged version.
- cc_mounts: Do not add devices to fstab that are already present.
[Lars Kellogg-Stedman]
- ds-identify: ensure that we have certain tokens in PATH.
- tests: enable Ubuntu Cosmic in integration tests [Joshua Powers]
- read_file_or_url: move to url_helper, fix bug in its FileResponse.
- cloud_tests: help pylint
- flake8: fix flake8 errors in previous commit.
- typos: Fix spelling mistakes in cc_mounts.py log messages [Stephen Ford]
- tests: restructure SSH and initial connections [Joshua Powers]
- ds-identify: recognize container-other as a container, test SmartOS.
- cloud-config.service: run After snap.seeded.service.
- tests: do not rely on host /proc/cmdline in test_net.py
[Lars Kellogg-Stedman]
- ds-identify: Remove dupe call to is_ds_enabled, improve debug message.
- SmartOS: fix get_interfaces for nics that do not have addr_assign_type.
- tests: fix package and ca_cert cloud_tests on bionic
- ds-identify: make shellcheck 0.4.6 happy with ds-identify.
- pycodestyle: Fix deprecated string literals, move away from flake8.
- azure: Add reported ready marker file. [Joshua Chan]
- tools: Support adding a release suffix through packages/bddeb.
- FreeBSD: Invoke growfs on ufs filesystems such that it does not prompt.
[Harm Weites]
- tools: Re-use the orig tarball in packages/bddeb if it is around.
- netinfo: fix netdev_pformat when a nic does not have an address assigned.
- collect-logs: add -v flag, write to stderr, limit journal to single boot.
- IBMCloud: Disable config-drive and nocloud only if IBMCloud is enabled.
- Add reporting events and log_time around early source of blocking time
--- Addtional changelog delta for Xenial, Artful ----
- IBMCloud: recognize provisioning environment during debug boots.
- net: detect unstable network names and trigger a settle if needed
- IBMCloud: improve documentation in datasource.
- sysconfig: dhcp6 subnet type should not imply dhcpv4 [Vitaly Kuznetsov]
- packages/debian/control.in: add missing dependency on iproute2.
- DataSourceSmartOS: add locking of serial device. [Mike Gerdts]
- DataSourceSmartOS: sdc:hostname is ignored [Mike Gerdts]
- DataSourceSmartOS: list() should always return a list [Mike Gerdts]
- schema: in validation, raise ImportError if strict but no jsonschema.
- set_passwords: Add newline to end of sshd config, only restart if
updated.
- pylint: pay attention to unused variable warnings.
- doc: Add documentation for AliYun datasource. [Junjie Wang]
- Schema: do not warn on duplicate items in commands.
- net: Depend on iproute2's ip instead of net-tools ifconfig or route
- DataSourceSmartOS: fix hang when metadata service is down [Mike Gerdts]
- DataSourceSmartOS: change default fs on ephemeral disk from ext3 to
ext4. [Mike Gerdts]
- pycodestyle: Fix invalid escape sequences in string literals.
- Implement bash completion script for cloud-init command line
- tools: Fix make-tarball cli tool usage for development
- renderer: support unicode in render_from_file.
- Implement ntp client spec with auto support for distro selection
- Apport: add Brightbox, IBM, LXD, and OpenTelekomCloud to list of clouds.
- tests: fix ec2 integration network metadata validation
Hello Chad, or anyone else affected,
Accepted cloud-init into bionic-proposed. The package will build now and be available at https:/
Please help us by testing this new package. See https:/
If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-
Further information regarding the verification process can be found at https:/