lp:~ltrager/maas

Author: Lee Trager
Author Date: 2020-09-28 02:55:15 UTC

Send Script parameter defaults during enlistment.

Author: Lee Trager
Author Date: 2020-09-24 01:05:39 UTC

Adds three new parameter types to scripts, string, password, and choice.

string - Allows input of any string. Optional fields, default, min, max,
           required, argument_format.
password - Like string except the value will never be exposed over the API
           or websocket.
choice - Allow input from a list of predefined fields. Fields may be a list
           of strings or a Django choice field. choices is a required filed,
    optional fields are default, required, and argument_format.

Author: Lee Trager
Author Date: 2020-09-25 23:20:09 UTC

Send script result.yaml during enlistment.

Author: Lee Trager
Author Date: 2020-09-24 02:50:41 UTC

Bjorn fixes

Author: Lee Trager
Author Date: 2020-09-22 16:57:45 UTC

Fix description

Author: Lee Trager
Author Date: 2020-09-18 19:30:20 UTC

Fix comment

Author: Lee Trager
Author Date: 2020-09-18 18:16:51 UTC

Merge branch 'master' into bmc_config_facebook_wedge

Author: Lee Trager
Author Date: 2020-09-17 21:33:29 UTC

Merge branch 'master' into bmc_config_script

Author: Lee Trager
Author Date: 2020-09-10 23:29:36 UTC

Fix lint

Author: Lee Trager
Author Date: 2020-09-10 21:47:00 UTC

Add the maas_auto_ipmi_user_privilege_level config option.

Author: Lee Trager
Author Date: 2020-09-08 19:47:30 UTC

Add support to release-prepare to handle Debian epochs and validate version string

Author: Lee Trager
Author Date: 2020-09-04 23:02:26 UTC

Fix intermittent test failure

Author: Lee Trager
Author Date: 2020-09-02 23:29:55 UTC

Accept ScriptResult status updates by name and accept runtime from client.

During enlistment the client receives commissioning Scripts before the Node
or ScriptResult exists. As such the client doesn't have a way to pass
ScriptResult.id once the Node is created. MAAS already accepted ScriptResults
by name, this allows status changes to be passed by name as well.

Some Scripts will finish running on the client before the ScriptResult or Node
objects are created. In this case MAAS will miss the signal that the Script
has started. When the result is uploaded the client may include a runtime, MAAS
will calculate ScriptResult.started to be ScriptResult.ended - runtime so the
runtime is preserved.

Author: Lee Trager
Author Date: 2020-09-01 20:44:31 UTC

Check duplicate UUIDs atomically

Author: Lee Trager
Author Date: 2020-08-21 23:10:14 UTC

Remove fstrings from the 20-maas-02-dhcp-unconfigured-ifaces

Commissioning and testing can run on Ubuntu Xenial+. Xenial's version of
Python doesn't support fstrings.

Author: Lee Trager
Author Date: 2020-08-21 22:16:22 UTC

Fix lint

Author: Lee Trager
Author Date: 2020-08-19 17:54:20 UTC

Load all scripts into the database before creating the region in the database.

When a new MAAS is added one of the first things that happens is the new region
is added to the database as a node. Creating a controller node object also
creates a ScriptSet and related ScriptResults to store commissioning scripts
from the region which are run later in startup. fe5acf1 moved all commissioning
scripts into the database. Because load_builtin_scripts() was being called
after the region was created the region was never able to be created in the
database causing startup to fail.

Author: Lee Trager
Author Date: 2020-08-14 21:17:38 UTC

Reorder commissioning scripts and move them into the database.

Reorder commissioning scripts to allow user scripts to easily run before
MAAS scripts run. This is neccessary to migrate BMC detection code to a
commissioning script. MAAS commissioning scripts which have no dependencies
are now run in parallel. This will speed up commissioning by a couple of
seconds.

All commissioning scripts are now stored in the database like testing scripts.
This allows MAAS to model which commissioning script version was used during
commissioning. MAAS commissioning scripts can now be easily downloaded by users
via the API or UI.

Author: Lee Trager
Author Date: 2020-08-14 18:49:31 UTC

LP: #1881133 - Always include rack controller IPs for DNS servers.

MAAS was only including the configured URL for controllers which did not
always include all rack controllers the VLAN is configured to use. This
would also sometimes include the region controller's IP even when the
machine is unable to directly access the rack controller.

Backport of a44d3a8

Author: Lee Trager
Author Date: 2020-08-13 03:41:37 UTC

adam-collard fixes

Author: Lee Trager
Author Date: 2020-08-12 01:58:47 UTC

LP: #1891027 - Escape NodeMetadata information before constructing the regex.

Author: Lee Trager
Author Date: 2020-08-07 23:57:53 UTC

LP: #1890859 - Bump epoch of Debian packages to not conflict with transitional package

Author: Lee Trager
Author Date: 2020-08-05 08:20:13 UTC

LP: #1888021 - Read storage MODEL and MODEL_ENC from udev

Storage devices may have two model names. One is encoded to allow spaces
and other special characters, the other is not. lsblk in Xenial and Bionic
give the encoded model name while in Focal it gives the non-encode model
name. LXD gives the encoded model name in LXD 4.3+. Read and store both
from udev to ensure matching works.

Author: Lee Trager
Author Date: 2020-08-03 23:39:00 UTC

LP: #1889788 - Always communicate with IPMI BMC's at OPERATOR level.

While the ipmipower command defaults to using OPERATOR the
ipmi-chassis-config and ipmitool commands both default to ADMIN.
Specify that OPERATOR should be used for all IPMI commands.

Backport of c348e0c

Author: Lee Trager
Author Date: 2020-08-03 23:39:00 UTC

LP: #1889788 - Always communicate with IPMI BMC's at OPERATOR level.

While the ipmipower command defaults to using OPERATOR the
ipmi-chassis-config and ipmitool commands both default to ADMIN.
Specify that OPERATOR should be used for all IPMI commands.

Backport of c348e0c

Author: Lee Trager
Author Date: 2020-07-28 18:09:49 UTC

Change the default commissioning OS to 20.04 LTS, Focal, on new installations.

Author: Lee Trager
Author Date: 2020-07-31 19:35:43 UTC

LP: #1889788 - Always communicate with IPMI BMC's at OPERATOR level.

While the ipmipower command defaults to using OPERATOR the ipmi-chassis-config
and ipmitool commands both default to ADMIN. Specify that OPERATOR should be
used for all IPMI commands.

Author: Guilherme G. Piccoli
Author Date: 2020-07-14 00:27:56 UTC

This is the NVMe secure erase implementation (+ one more patch, to fix/improve quick erase).
I tried to explain/detail everything in the commit messages; also, code/tests were validated against Flake8 to prevent style issues.

Backport of 9633810

Author: Guilherme G. Piccoli
Author Date: 2020-07-14 00:27:56 UTC

This is the NVMe secure erase implementation (+ one more patch, to fix/improve quick erase).
I tried to explain/detail everything in the commit messages; also, code/tests were validated against Flake8 to prevent style issues.

Backport of 9633810

Author: Guilherme G. Piccoli
Author Date: 2020-07-14 00:27:56 UTC

This is the NVMe secure erase implementation (+ one more patch, to fix/improve quick erase).
I tried to explain/detail everything in the commit messages; also, code/tests were validated against Flake8 to prevent style issues.

Backport of 9633810

Author: Lee Trager
Author Date: 2020-07-20 17:00:30 UTC

Revert "LP: #1869116 - Read storage model data from udev ID_MODEL_ENC. (gh:lxc/lxd:7665)"

This reverts commit 511d6314eb90c804d484c48afbd1bdcc23e91efe.

Author: Lee Trager
Author Date: 2020-07-17 17:09:55 UTC

LP: #1869116 - Read storage model data from udev ID_MODEL_ENC. (gh:lxc/lxd:7665)

Author: Lee Trager
Author Date: 2020-07-17 17:07:50 UTC

LP: #1869116 - Read storage model data from udev ID_MODEL_ENC. (gh:lxc/lxd:7665)

Author: Lee Trager
Author Date: 2020-07-17 17:04:08 UTC

LP: #1869116 - Read storage model data from udev ID_MODEL_ENC. (gh:lxc/lxd:7665)

Author: Lee Trager
Author Date: 2020-06-23 18:08:20 UTC

Backport of 30f4fb7 LP: #1883333 - Allow any field from LXD system information to be used in for_hardware.

Author: Lee Trager
Author Date: 2020-06-23 18:08:20 UTC

Backport of 30f4fb7 LP: #1883333 - Allow any field from LXD system information to be used in for_hardware.

Author: Lee Trager
Author Date: 2020-06-23 02:11:38 UTC

Add tests

Author: Lee Trager
Author Date: 2020-06-17 23:37:02 UTC

LP: #1881919 - Allow user to disable running a user uploaded commissioning script.

Currently when no commissioning scripts are selected by the user all user
uploaded commissioning scripts are automatically selected. This branch adds two ways to disable that.

1. Any commissioning script tagged with "noauto" won't be automatically selected by MAAS.
2. When using the API if commissioning_scripts=none no user uploaded commissioning script will be selected.

Author: Lee Trager
Author Date: 2020-06-17 23:37:02 UTC

LP: #1881919 - Allow user to disable running a user uploaded commissioning script.

Currently when no commissioning scripts are selected by the user all user
uploaded commissioning scripts are automatically selected. This branch adds two ways to disable that.

1. Any commissioning script tagged with "noauto" won't be automatically selected by MAAS.
2. When using the API if commissioning_scripts=none no user uploaded commissioning script will be selected.

Author: Lee Trager
Author Date: 2020-06-11 23:40:51 UTC

Fix lint

Author: Lee Trager
Author Date: 2020-06-10 23:53:56 UTC

Backport of b7b7167 LP: #1881821 - Allow link speed to exceed interface speed.

Author: Lee Trager
Author Date: 2020-06-10 23:53:56 UTC

Backport of b7b7167 LP: #1881821 - Allow link speed to exceed interface speed.

Author: Lee Trager
Author Date: 2020-06-10 23:30:01 UTC

Fix spelling

Author: Lee Trager
Author Date: 2020-06-09 17:35:57 UTC

LP: #1882806 - Fix failing certificate test due to bad cache during testing.

Author: Lee Trager
Author Date: 2020-06-09 02:13:57 UTC

LP: #1877585 - Make Ubuntu selections with release and arch on websocket.

Author: Lee Trager
Author Date: 2020-06-05 00:05:20 UTC

LP: #1881361 - Treat Scripts run against different interfaces as unique tests.

Author: Lee Trager
Author Date: 2020-05-29 23:29:07 UTC

LP: #1881361 - Treat Scripts run against different interfaces as unique tests.

Author: Lee Trager
Author Date: 2020-05-29 22:17:03 UTC

LP: #1877158 - Allow multihomed static routes

Author: Lee Trager
Author Date: 2020-05-29 19:51:22 UTC

LP: #1848170 - Update URL parameter description on internet-connectivity test.

Author: Lee Trager
Author Date: 2020-05-28 22:20:00 UTC

LP: #1881116 - Handle empty system information objects from LXD.

Author: Lee Trager
Author Date: 2020-05-27 22:29:47 UTC

Fix race conditions

Author: Lee Trager
Author Date: 2020-05-21 20:05:17 UTC

make format

Author: Lee Trager
Author Date: 2020-05-21 01:23:53 UTC

LP: #1879827 - Add unsupported_arches to the BootResources websocket.

Author: Lee Trager
Author Date: 2020-05-20 16:24:49 UTC

Backport of 894a324 - LP: #1878923, #1878685 - Fix incorrect memory detection.

LXD was only detecting the amount of available memory in user space.
Memory reserved by the kernel was not shown as available. This caused MAAS
to show slightly less RAM then the system actually had.

MAAS was assuming that a NUMA node always had memory assigned to it. When
0 memory was assigned to a node commissioning would raise an exception and
fail.

Author: Lee Trager
Author Date: 2020-05-20 00:12:42 UTC

Backport of 84f687c LP: #1879416 - Mark commissioning scripts as failed if processing errored

Author: Lee Trager
Author Date: 2020-05-19 23:48:55 UTC

Fix failing test

Author: Lee Trager
Author Date: 2020-05-19 19:18:45 UTC

LP: #1878923, #1878685 - Fix incorrect memory detection.

LXD was only detecting the amount of available memory in user space. Memory
reserved by the kernel was not shown as available. This caused MAAS to show
slightly less RAM then the system actually had.

MAAS was assuming that a NUMA node always had memory assigned to it. When
0 memory was assigned to a node commissioning would raise an exception and
fail.

Author: Lee Trager
Author Date: 2020-05-15 23:49:52 UTC

Backport of 9424d23 LP: #1869958 - Run fio using the native block size of the disk.

Author: Lee Trager
Author Date: 2020-05-15 23:33:47 UTC

Fix test failure

Author: Lee Trager
Author Date: 2020-05-12 18:48:21 UTC

Backport of 9424d23 LP: #1869958 - Run fio using the native block size of the disk.

Author: Lee Trager
Author Date: 2020-05-12 18:48:21 UTC

Backport of 9424d23 LP: #1869958 - Run fio using the native block size of the disk.

Author: Lee Trager
Author Date: 2020-05-13 23:20:38 UTC

Add storage

Author: Lee Trager
Author Date: 2020-05-12 22:48:10 UTC

Add docstring

Author: Lee Trager
Author Date: 2020-05-11 19:37:59 UTC

LP: #1869958 - Run fio using the native block size of the disk.

Author: Lee Trager
Author Date: 2020-05-07 20:49:55 UTC

LP: #1877220 - Update LXD to fix probing NVME multipath devices(GH:7313)

Author: Lee Trager
Author Date: 2020-05-06 20:06:09 UTC

ack fix

Author: Lee Trager
Author Date: 2020-04-29 23:46:22 UTC

Remove no longer needed DisableSignal

Author: Lee Trager
Author Date: 2020-04-27 22:43:42 UTC

Fix architectures supported by LXD Pod.

Author: Lee Trager
Author Date: 2020-04-27 16:51:53 UTC

Fix showing system_id for assoicated machine.

Author: Lee Trager
Author Date: 2020-04-23 00:30:00 UTC

LP: #1873729 - Store and process host information from LXD.

When running commissioning, controller refresh, or getting information from an
LXD Pod include the host information in addition to the host resources. This
allows architecture and operating system information to be collected in a
consistent way across machines, controllers, and Pods.

50-maas-01-commissioning now mimics the LXD API by providing host information
in the root of the JSON object while resources is a subobject.

Author: Lee Trager
Author Date: 2020-04-17 21:49:52 UTC

Backport of c25d426 LP: #1870171 - Remove token associations when transferring ownership of a Node.

Author: Lee Trager
Author Date: 2020-04-17 20:53:26 UTC

Backport of c25d426 LP: #1870171 - Remove token associations when transferring ownership of a Node.

Author: Lee Trager
Author Date: 2020-04-17 19:30:12 UTC

LP: #1870171 - Remove token associations when transferring ownership of a Node.

Author: Lee Trager
Author Date: 2020-04-17 19:07:20 UTC

Add comment

Author: Lee Trager
Author Date: 2020-04-17 01:29:40 UTC

Fix failing tests

Author: Lee Trager
Author Date: 2020-04-16 18:46:56 UTC

Allow adding an LXD Pod from a machine MAAS already knows about.

Author: Lee Trager
Author Date: 2020-04-15 22:54:44 UTC

Gather network hardware information even if ip addr is missing.

Author: Lee Trager
Author Date: 2020-04-11 09:09:41 UTC

Backport of d0653c9 LP: #1870171 - Remove the token column from the Node table.

The token column is only used by the API when allocating and machine and
listing allocated machines. When a User Token is deleted this association
causes the Node to be deleted as well. Allocated machines are already
filtered by owner and status so the token column isn't needed.

In the backport Node.token is no longer used but the column remains to
avoid creating a migration.

Author: Lee Trager
Author Date: 2020-04-11 02:42:04 UTC

Backport of d0653c9 LP: #1870171 - Remove the token column from the Node table.

The token column is only used by the API when allocating and machine and
listing allocated machines. When a User Token is deleted this association
causes the Node to be deleted as well. Allocated machines are already
filtered by owner and status so the token column isn't needed.

In the backport Node.token is no longer used but the column remains to
avoid creating a migration.

Author: Lee Trager
Author Date: 2020-04-10 23:48:36 UTC

Backport of d0653c9 LP: #1870171 - Remove the token column from the Node table.

The token column is only used by the API when allocating and machine and
listing allocated machines. When a User Token is deleted this association
causes the Node to be deleted as well. Allocated machines are already
filtered by owner and status so the token column isn't needed.

In the backport Node.token is no longer used but the column remains to
avoid creating a migration.

Author: Lee Trager
Author Date: 2020-04-10 23:47:10 UTC

Merge branch 'master' into request_pod_commissioning_results

Author: Lee Trager
Author Date: 2020-04-10 23:22:35 UTC

Backport of d0653c9 LP: #1870171 - Remove the token column from the Node table.

The token column is only used by the API when allocating and machine and
listing allocated machines. When a User Token is deleted this association
causes the Node to be deleted as well. Allocated machines are already
filtered by owner and status so the token column isn't needed.

In the backport Node.token is no longer used but the column remains to
avoid creating a migration.

Author: Lee Trager
Author Date: 2020-04-08 08:03:40 UTC

LP: #1870171 - Remove the token column from the Node table.

The token column is only used by the API when allocating and machine and
listing allocated machines. When a User Token is deleted this assoication
causes the Node to be deleted as well. Allocated machines are already
filtered by owner and status so the token column isn't needed.

Author: Lee Trager
Author Date: 2020-04-02 04:08:43 UTC

Associate an existing Node or create a new Node when adding an LXD pod.

Author: Lee Trager
Author Date: 2020-04-01 20:38:20 UTC

Revert "Allow the CreateNode RPC call to assoicate a Pod with a Node."

This reverts commit bc900a6b449b5e4d654f1fb4926c8d986f9d219b.

Author: Lee Trager
Author Date: 2020-04-01 18:27:30 UTC

Fix failing test

Author: Lee Trager
Author Date: 2020-03-20 23:37:30 UTC

Remove uneeded edit

Author: Lee Trager
Author Date: 2020-03-20 08:26:31 UTC

make format

Author: Lee Trager
Author Date: 2020-02-27 01:28:26 UTC

Fix test failure

Author: Lee Trager
Author Date: 2019-12-12 01:01:19 UTC

Fix failing tests

Author: Lee Trager
Author Date: 2019-12-05 20:23:33 UTC

ack fixes

Author: Lee Trager
Author Date: 2019-12-04 00:49:41 UTC

LP: #1855022 - Cleanup orphaned ScriptResults after commissioning failure.

Scripts which have parameters may become orphaned when created before
commissioning has run when an error occurs during commissioning. ScriptResults
on an uncommissioned machine use the 'all' place holder which is mapped to
devices after commissioning has run. If commissioning fails this mapping never
occurs. When a subsequent commissioning passes the mapping works and the
unmapped ScriptResult are never cleaned up as they appear unique. This leaves
failed tests associated with the node.

Author: Lee Trager
Author Date: 2019-11-30 00:46:17 UTC

Remove unneeded distinct

Author: Lee Trager
Author Date: 2019-11-25 18:43:33 UTC

LP: #1853890 - Search /boot/efi/EFI/redhat for bootloaders during local boot.

Author: Lee Trager
Author Date: 2019-11-19 19:31:17 UTC

LP: #1852627 - Document osystem parameter on the deployment API.

Author: Lee Trager
Author Date: 2019-11-14 02:09:07 UTC

Fix broken tests

Author: Lee Trager
Author Date: 2019-11-07 09:01:35 UTC

make format

Author: Lee Trager
Author Date: 2019-11-04 18:13:13 UTC

Backport of ad87cfa LP: #1847537 - Respect the allow_dns field when generating V1 network config.

Author: Lee Trager
Author Date: 2019-11-04 19:21:32 UTC

Fix failing tests

Author: Lee Trager
Author Date: 2019-11-01 23:47:14 UTC

make format