Git repositories for cloud-init

Author: Chad Smith
Author Date: 2018-04-11 22:01:56 UTC

tools: Fix make-tarball cli tool usage for development

This tool is used to assist during the creation of ubuntu packages for
release testing. Address the following on the command-line:
 * --help option now print usage
 * Add --orig-tarball which creates named output file
   cloud-init_<release-version>.orig.tar.gz
 * drop unused --verbose option

Author: Chad Smith
Author Date: 2018-04-07 18:50:22 UTC

tests: fix ec2 integration metadata validation

Author: Chad Smith
Author Date: 2018-04-03 22:39:03 UTC

tests: fix integration tests to support lxd 3.0 release

Integration tests previously had a logic path that was unexercised on
jenkins because we were on an older version of lxc. With an upgrade to lxd
version 3.0 we need to bump pylxd dependency pin and fix a typo in
integration tests which checked the lxd version.

Author: Chad Smith
Author Date: 2018-03-27 18:49:38 UTC

release 18.2

Bump the version in cloudinit/version.py to be 18.2 and update ChangeLog.

LP: #1759318

Author: Chad Smith
Author Date: 2018-03-26 22:24:51 UTC

add comment about moving to RawConfigParser.read_file when we drop py 2.7 support

Author: Scott Moser
Author Date: 2018-03-24 01:19:58 UTC

Enable IBMCloud datasource in settings.py.

This just got missed in the IBMCloud datasource addition.
Add it to the builtin list of datasources.

Author: Scott Moser
Author Date: 2018-03-22 18:02:24 UTC

use /proc/xen rather than /sys/hypervisor to determine is xen

Author: Chad Smith
Author Date: 2018-03-22 20:59:14 UTC

add test_subp.py module

Author: Chad Smith
Author Date: 2018-03-20 20:38:54 UTC

typo: actually use the right inspect function. lints

Author: Chad Smith
Author Date: 2018-03-16 19:13:54 UTC

sort keys in assertions to avoid intermittent failures on dict key ordering

Author: Chad Smith
Author Date: 2018-03-15 17:36:09 UTC

use smoser's suggestion to handle string types first when processing byte_args

Author: Chad Smith
Author Date: 2018-03-14 19:55:59 UTC

flakes

Author: Chad Smith
Author Date: 2018-02-26 20:09:26 UTC

doc fix for chef example installing from packages

Author: Chad Smith
Author Date: 2018-02-09 21:58:25 UTC

correct indent

Author: Chad Smith
Author Date: 2018-02-07 21:33:25 UTC

cli: fix cloud-init status to report running when before result.json

Fix various corner cases for cloud-init status subcommand. Report
'runnning' under the following conditions:
 - No /run/cloud-init/result.json file exists
 - Any stage in status.json is unfinished
 - status.json reports a non-null stage it is in progress on

Author: Chad Smith
Author Date: 2018-01-29 17:51:19 UTC

fix docs dropping local code path from --help output

Author: Chad Smith
Author Date: 2018-01-26 18:32:52 UTC

Address scott's review comments:

- Use set declaration to coalesce get_ipv4|ipv6 devices in freebsd
- whitespace docstring unit test fix
- drop trailing ] from log message
- non-zero value for execmd in cc_power_state_change

Author: Chad Smith
Author Date: 2018-01-10 23:39:39 UTC

cii: Use git hash pip dependency format for pylxd.

We want this git hash from master as it pylxd pip packages are not
as frequently published by this project. Master for pylxd is under
active development, so we do want to 'pin' which hash we pull.

Author: Chad Smith
Author Date: 2018-01-03 17:51:48 UTC

cli: cloud-init clean handles symlinks

Fix cloud-init clean subcommand to unlink symlinks instead of calling
del_dir.

Author: Chad Smith
Author Date: 2017-12-20 22:25:30 UTC

properly mock util.which for non-ifupdown test platforms

Author: Chad Smith
Author Date: 2017-12-16 07:06:18 UTC

wip

Author: Chad Smith
Author Date: 2017-12-15 19:45:47 UTC

be explicit for formatted args since we are using .format

Author: Chad Smith
Author Date: 2017-12-14 23:24:19 UTC

address review comments, use populate_dir where possible

Author: Scott Moser
Author Date: 2017-12-14 17:33:52 UTC

release 17.2

Bump the version in cloudinit/version.py to be 17.2 and update ChangeLog.

Author: chad smith
Author Date: 2017-12-07 00:26:52 UTC

initial unit tests around ovf datasource detection. Include smoser's ds-identify patch

Author: Chad Smith
Author Date: 2017-12-05 22:57:26 UTC

use error function per review comments

Author: Chad Smith
Author Date: 2017-12-05 16:22:30 UTC

flakes

Author: Chad Smith
Author Date: 2017-12-01 17:02:33 UTC

releasing package cloud-init version 17.1-46-g7acc9e68-0ubuntu1~17.04.1

Author: Chad Smith
Author Date: 2017-11-30 22:10:16 UTC

debug instead of info message

Author: Chad Smith
Author Date: 2017-11-25 05:51:33 UTC

refactor handler classes to include mandatory prefixes attribute. Refactor JinjaParthandler to accept sub_handlers list on init.

Author: Chad Smith
Author Date: 2017-11-18 02:30:11 UTC

add upgrade test with missing network key on ec2

Author: Chad Smith
Author Date: 2017-11-17 03:14:39 UTC

add comment explaining that we append the url in error on older versions on requests

Author: Chad Smith
Author Date: 2017-10-31 15:30:42 UTC

address review comments. Call maybe_perform_dhcp_discovery with the fallback_nic, drop accidentaly whitespace

Author: Chad Smith
Author Date: 2017-10-23 15:43:07 UTC

add comment about using FilesystemMocking instead of os.stat mocks

Author: Chad Smith
Author Date: 2017-10-20 04:59:58 UTC

ntp cloud-config provided can be as short as 'ntp:'

Author: Chad Smith
Author Date: 2017-10-10 16:32:02 UTC

flakes

Author: Chad Smith
Author Date: 2017-10-05 20:20:27 UTC

handle bridge_stp not None and update unit tests to pass 0 instead of 'off' for testing.

Author: Joshua Powers
Author Date: 2017-09-29 12:53:05 UTC

debian/copyright: dep5 updates, reorganize, add Apache 2.0 license.

The copyright was updated to be lintian clean and reorganized to list the
licenses at the bottom after declaring the metadata and file information.

Add the MIT license to the file.

LP: #1718681

Author: Chad Smith
Author Date: 2017-09-21 05:41:22 UTC

docs: fix sphinx module schema documentation

Create a copy of each modules schema attribute when generating sphinx docs
to avoid altering the actual module dict in memory. This avoids illegible
rendering of module examples and distros where each character of a list
was represented on a separate line by itself.

Fixes ntp, resizefs, runcmd and bootcmd docs.

Author: Chad Smith
Author Date: 2017-09-20 20:35:49 UTC

tests: Add cloudinit package to all test targets

The package cloudinit was sparsely added to only the makefile's unittest
target and tox's py3 target. This branch adds cloudinit package to
'make unittest3' and all tox environments. It tweaks one cloudinit unit
test to use mocked_object.call_count instead of
mocked_object.assert_called_once which is not defined in some python
unittest versions.

Author: Chad Smith
Author Date: 2017-09-18 22:42:29 UTC

unittests need to handle global _TMPDIR

Author: Chad Smith
Author Date: 2017-09-18 21:30:20 UTC

another needs_exe for blob_from_tempfile after rebase

Author: Chad Smith
Author Date: 2017-09-15 19:25:21 UTC

address review comments on license, dpkg-query structuring, docstrings. And dropped the optional newline append to cmd output

Author: Chad Smith
Author Date: 2017-09-15 18:35:49 UTC

log a message on overlayroot devpath and return False. Add unit test

Author: Chad Smith
Author Date: 2017-09-14 04:02:32 UTC

lint param name is now omnibus_version

Author: Chad Smith
Author Date: 2017-09-14 02:51:55 UTC

need to check that the module actually defines distros before deciding to skip

Author: Chad Smith
Author Date: 2017-09-08 19:55:23 UTC

pull in smoser's patch for non-yaml.dumps in documentation creation. Update unit tests, fix cc_runcmd, cc_bootcmd, cc_resizefs and cc_ntp modules to set __doc__ = get_schema_doc() for python's builtin help

Author: Chad Smith
Author Date: 2017-09-06 05:02:19 UTC

fix unmocked openstack metadata url openstack/latest/network_data.json

Author: Chad Smith
Author Date: 2017-09-01 15:28:15 UTC

rebase https://code.launchpad.net/~larsks/cloud-init/+git/cloud-init/+merge/329661 against tip and fix outstanding unit tests

Author: Chad Smith
Author Date: 2017-08-31 20:00:37 UTC

flakes

Author: Chad Smith
Author Date: 2017-08-30 03:24:57 UTC

flakes

Author: Chad Smith
Author Date: 2017-08-26 03:47:55 UTC

flakes

Author: Chad Smith
Author Date: 2017-08-24 21:39:30 UTC

use public-ipv4s and ipv6s instead of vpc-ipv(4|6)-cidr-blocks

Author: Chad Smith
Author Date: 2017-08-24 03:52:31 UTC

add crawl_metadata to the base DataSource class and alter DataSourceEc2 to use the constuct

Author: Chad Smith
Author Date: 2017-08-24 00:54:01 UTC

cloud-init cli: Fix command line parsing of coniditionally loaded subcommands

In an effort to save file load cost during system boot, certain
subcommands, analyze and devel, do not get loaded unless the subcommand is
specified on the commandline. Because setup.py entrypoint for cloud-init
script doesn't specify sysv_args parameter when calling the CLI's main()
we need main to read sys.argv into sysv_args so our subparser loading
continues to work.

LP: #1712676

Author: Chad Smith
Author Date: 2017-08-22 23:18:42 UTC

now really fix the py26 str(ctxt_mgr.exception)

Author: Chad Smith
Author Date: 2017-08-22 21:37:57 UTC

flakes8

Author: Chad Smith
Author Date: 2017-08-21 19:46:23 UTC

tools: Add tooling for basic cloud-init performance analysis.

This branch adds cloudinit-analyze into cloud-init proper. It adds an
"analyze" subcommand to the cloud-init command line utility for quick
performance assessment of cloud-init stages and events.

On a cloud-init configured instance, running "cloud-init analyze blame"
will now report which cloud-init events cost the most wall time. This
allows for quick assessment of the most costly stages of cloud-init.

This functionality is pulled from Ryan Harper's analyze work.

The cloudinit-analyze main script itself has been refactored a bit for
inclusion as a subcommand of cloud-init CLI. There will be a followup
branch at some point which will optionally instrument detailed strace
profiling, but that approach needs a bit more discussion first.

This branch also adds:
 * additional debugging topic to the sphinx-generated docs describing
   cloud-init analyze, dump and show as well as cloud-init single usage.
 * Updates the Makefile unittests target to include cloudinit directory
   because we now have unittests within that package.

LP: #1709761

Author: Chad Smith
Author Date: 2017-08-07 18:35:19 UTC

use util.log_time instead of making direct calls to time.time for crawl_metadata

Author: Chad Smith
Author Date: 2017-07-28 20:15:33 UTC

docstring fixup

Author: Chad Smith
Author Date: 2017-07-19 18:33:54 UTC

typoe on InvalidDHCPLeaseFileError class

Author: Chad Smith
Author Date: 2017-07-12 16:35:54 UTC

fix invalid mock setup of platform_reports_gce to return False

Author: Chad Smith
Author Date: 2017-07-03 22:05:37 UTC

Do not retry on optional cloud data types such as user_data, network_data and vendor_data files. Userdata may be absent if not provided and vendor data will not exist prior to Havana, network_data will not exist prior to Liberty

Author: Chad Smith
Author Date: 2017-06-14 22:25:38 UTC

add other continuous integraion deps one which ci depends

Author: Chad Smith
Author Date: 2017-06-13 17:33:19 UTC

update python34 renames for centos/redhat

Author: Chad Smith
Author Date: 2017-06-12 16:39:20 UTC

automatically generate module docs from json schema if the module contains a schema attribute

Author: Chad Smith
Author Date: 2017-06-08 00:13:09 UTC

makefile: fix python 2/3 detection in the Makefile

Fixes CentOs make detection of python in a non-python3 environment

Author: Chad Smith
Author Date: 2017-06-02 20:42:26 UTC

Fix jsonschema unittests for Centos and add skips when missing jsonschema python dependency

Author: Chad Smith
Author Date: 2017-06-01 16:01:26 UTC

    smoser fixups

     - fix up comment spelling
     - drop unused change.
     - capital letters are for global vars

Author: Chad Smith
Author Date: 2017-05-31 20:23:15 UTC

unittest byte string

Author: Chad Smith
Author Date: 2017-05-24 03:46:08 UTC

calculate root_dir path for templates directory from util import as sys.path will be different on test environments

Author: Chad Smith
Author Date: 2017-05-23 04:58:08 UTC

comment why we are not setting config

Author: Chad Smith
Author Date: 2017-05-10 02:29:30 UTC

two unit tests for ipv4 and ipv6 default gateway duplication

Author: Chad Smith
Author Date: 2017-05-08 17:27:50 UTC

drop stray pdb from unit tests

Author: Chad Smith
Author Date: 2017-05-08 17:12:23 UTC

rework brpm to accept optional --builddir directory instead of tempdir

Author: Chad Smith
Author Date: 2017-04-24 20:49:41 UTC

move cloud-util deps calculation inside write_debian_folder where it belongs