[SRU][FFe] Update to netplan.io 0.102

Bug #1919453 reported by Lukas Märdian
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
netplan.io (Ubuntu)
Fix Released
Medium
Unassigned
Focal
Fix Released
Medium
Unassigned
Groovy
Fix Released
Medium
Unassigned
Hirsute
Fix Released
Medium
Unassigned

Bug Description

[Impact]
This release contains both bug-fixes and new features and we would like to make sure all of our supported customers have access to those improvements.

The most notable changes (besides usual bug-fixes) incoming in 0.102:
- New API for NetworkManager YAML backend
- Improved netplan set CLI to override existing files
- Documentation improvements
- Allow running more tests in a container
- Added congestion-window & advertised-receive-window options for routes
- Added ttl option for tunnels (LP: #1846783)
- systemd v247 compatibility (for changing MAC address)
- Prevent duplicate ARPIPTargets in NetDev files (LP: #1915837)
- Enable pristine-tar in gbp

See the changelog entry below for a full list of changes and bugs.

[Test Plan]
The following development and SRU process was followed:
https://wiki.ubuntu.com/NetplanUpdates

Netplan contains an extensive integration test suite that is ran using
the SRU package for each release. This test suite's results are available here:
http://autopkgtest.ubuntu.com/packages/n/netplan.io

A successful run is required before the proposed netplan.io package
can be let into -updates.

The netplan team will be in charge of attaching the artifacts and console
output of the appropriate run to the bug. Netplan team members will not
mark ‘verification-done’ until this has happened.

[Where problems could occur]
Netplan being a core package it could impact the whole networking stack of the operating system up to the point where servers would not be reachable anymore after a reboot, due to broken network config being generated by netplan at bootup. In order to mitigate the regression potential, the results of the aforementioned integration tests are attached to this bug:

Groovy:
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/groovy_amd64.log
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/groovy_arm64.log
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/groovy_armhf.log
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/groovy_ppc64el.log
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/groovy_s390x.log

Focal:
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/focal_amd64.log
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/focal_arm64.log
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/focal_armhf.log
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/focal_ppc64el.log
https://git.launchpad.net/~slyon/+git/files/tree/LP1922898/focal_s390x.log

[Other Info]
The integration test logs are attached to this bug, once the package has been accepted into -proposed and the tests have been executed on the real infrastructure.

[Changelog]
abad253 tests:bonds: fix flaky resend_igmp test
6270143 tests:base: avoid long waits
b98a160 tests:base: improve daemon-reload check
3f19eeb tests:base: improve reliabilty by using higher timeout
a049983 tests:base: improve management interface handling
8cb8621 test:utils: cleanup formatting
e05731c cli:set: write to existing YAML file, if available (#197)
2263a13 libnetplan: provide API for NetworkManager YAML backend (#193)
d34df50 test:tunnels: improve stability of wireguard test
15a3380 Prevent duplicate ARPIPTargets in NetDev files (LP: #1915837) (#199)
2ccddbe tests:integration: cleanup OVS/WPA files (#198)
9767b63 Improve integration tests (#196)
f086808 Enable CodeQL code scanning (#195)
6c8ed65 Added TTL option for tunnels (LP: #1846783) (#194)
1e0f223 Added per route congestion-window/advertised-receive-window options (#177)
ac2a1b9 Update Github URL (#192)
165e908 cli:utils: handle emtpy netifaces.ifaddresess call (#188)
51a6032 Stop using deprecated systemd-resolve tool
d9d35c6 cli:apply: Add comment about snapd/DBus compatibility
bdc2b1d Clarified `dhcp-identifier` option (#186)
1413f0e tests:integration: adopt for racy systemd MAC assignment
222c104 github: run action on any pull request
03746b4 tests:dbus: improve test stability of timeouts
465c530 tests:tunnels: improve test reliability
944b1e3 tests: adopt to wording changes as of OVS 2.15
86bd330 doc: Add a caveat to wake on LAN which is systemd.link related (LP: #1909114) (#180)
41bfbd6 parse: fix 'networkmanager:' backend options for modem connections (#179)
85ff2f5 Fix changing of macaddress with systemd v247 (#178)
47ad3cc Cleanup unused code, as noted by clang
72e11a6 parse:doc:test: fix typos (thanks lintian)

== Original description ==

[Freeze Exception Rationale]
We would like to request a Feature Freeze exception for the new netplan 0.102 as this release will be carrying important roadmap features targeted for 21.04. Things got delayed, but the features we want to deliver are still considered important. We are aware that we are late in this cycle, but releasing the new netplan version will also unblock some of the other teams. Notably the addition of NetworkManager YAML backend integration support will unblock other projects such as the NetworkManager-netplan integration.

[Additional details]
Changelog of upstream netplan 0.102:
https://git.launchpad.net/~slyon/+git/files/tree/LP1919453/change.log

Build log (incl. unit test run):
https://git.launchpad.net/~slyon/+git/files/tree/LP1919453/sbuild.log

Install log:
https://git.launchpad.net/~slyon/+git/files/tree/LP1919453/install.log

I've executed the full set of unit- & integration tests for all architectures. Results can be found here:
https://bileto.ubuntu.com/excuses/4315/hirsute.html

amd64:
https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-hirsute-ci-train-ppa-service-4315/hirsute/amd64/n/netplan.io/20210322_144258_b78fa@/log.gz
arm64:
https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-hirsute-ci-train-ppa-service-4315/hirsute/arm64/n/netplan.io/20210322_171737_41be8@/log.gz
armhf:
https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-hirsute-ci-train-ppa-service-4315/hirsute/armhf/n/netplan.io/20210322_140733_8b350@/log.gz
ppc64el:
https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-hirsute-ci-train-ppa-service-4315/hirsute/ppc64el/n/netplan.io/20210322_173008_15f29@/log.gz
s390x:
https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac/autopkgtest-hirsute-ci-train-ppa-service-4315/hirsute/s390x/n/netplan.io/20210322_193059_aa17d@/log.gz

Lukas Märdian (slyon)
description: updated
Lukas Märdian (slyon)
description: updated
Lukas Märdian (slyon)
description: updated
Lukas Märdian (slyon)
description: updated
Lukas Märdian (slyon)
description: updated
Revision history for this message
Lukas Märdian (slyon) wrote :

I've adopted the package, to not execute all tests in containers, as suggested by @laney. This now makes armhf show up as green as well, skipping some tests, but also executing (and passing) more tests than it did before. So overall this is a coverage improvement and we do not need any hints.

description: updated
Lukas Märdian (slyon)
description: updated
Lukas Märdian (slyon)
description: updated
Revision history for this message
Iain Lane (laney) wrote :

Thanks Lukas. Ack for this, but please make sure you watch out for any bugs emerging and fix them as necessary.

Changed in netplan.io (Ubuntu Hirsute):
status: New → Triaged
importance: Undecided → Medium
Revision history for this message
Lukas Märdian (slyon) wrote :

Thank you Laney, I will absolutely monitor the bugs and act accordingly.

Lukas Märdian (slyon)
description: updated
summary: - [FFe] Update to netplan.io 0.102
+ [SRU][FFe] Update to netplan.io 0.102
Changed in netplan.io (Ubuntu Hirsute):
status: Triaged → Fix Committed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package netplan.io - 0.102-0ubuntu1

---------------
netplan.io (0.102-0ubuntu1) hirsute; urgency=medium

  * New upstream release: 0.102 (LP: #1919453)
    - New API for NetworkManager YAML backend
    - Added congestion-window & advertised-receive-window options for routes
    - Added ttl option for tunnels (LP: #1846783)
    - Improved netplan set CLI to override existing files
    - Moved upstream repository to https://github.com/canonical/netplan/
    - Documentation improvements
    - Improved Github Actions CI and CodeQL integration
    - Minor cleanup/typos/test improvements
    Bug fixes:
    - systemd v247 compatibility (for changing MAC address)
    - OVS 2.15 compatibility (wording changes)
    - Allow networkmanager: backend options for modem devices
    - Prevent duplicate ARPIPTargets in NetDev files (LP: #1915837)
  * Drop all distro patches, which have been integrated upstream
  * Update symbols file
  * Enable pristine-tar in gbp
  * Allow running more tests in a container

 -- Lukas Märdian <email address hidden> Wed, 24 Mar 2021 08:54:23 +0100

Changed in netplan.io (Ubuntu Hirsute):
status: Fix Committed → Fix Released
Revision history for this message
Brian Murray (brian-murray) wrote : Please test proposed package

Hello Lukas, or anyone else affected,

Accepted netplan.io into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/netplan.io/0.102-0ubuntu1~20.10.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-groovy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in netplan.io (Ubuntu Groovy):
status: New → Fix Committed
tags: added: verification-needed verification-needed-groovy
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Lukas, or anyone else affected,

Accepted netplan.io into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/netplan.io/0.102-0ubuntu1~20.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in netplan.io (Ubuntu Focal):
status: New → Fix Committed
tags: added: verification-needed-focal
Revision history for this message
Ubuntu SRU Bot (ubuntu-sru-bot) wrote : Autopkgtest regression report (netplan.io/0.102-0ubuntu1~20.10.1)

All autopkgtests for the newly accepted netplan.io (0.102-0ubuntu1~20.10.1) for groovy have finished running.
The following regressions have been reported in tests triggered by the package:

netplan.io/0.102-0ubuntu1~20.10.1 (armhf, amd64, ppc64el, arm64)

Please visit the excuses page listed below and investigate the failures, proceeding afterwards as per the StableReleaseUpdates policy regarding autopkgtest regressions [1].

https://people.canonical.com/~ubuntu-archive/proposed-migration/groovy/update_excuses.html#netplan.io

[1] https://wiki.ubuntu.com/StableReleaseUpdates#Autopkgtest_Regressions

Thank you!

Lukas Märdian (slyon)
description: updated
Revision history for this message
Lukas Märdian (slyon) wrote :

I verified the Focal SRU (0.102-0ubuntu1~20.04.1) and attached the corresponding test logs to the bug description.

Still investigating the Groovy autopkgtest failures.

tags: added: verification-done-focal
removed: verification-needed-focal
Revision history for this message
Lukas Märdian (slyon) wrote :

Most test are now passing for Groovy as well, after retry as 'big_package'. Unfortunately, one of the newly enabled container tests still fails on Groovy/armhf. This is not a regression, as this test was skipped previously. I've prepared a new upload (in UNAPPROVED), which skip this test again on armhf and will finally allow for migration, once accepted by the SRU team.

Revision history for this message
Brian Murray (brian-murray) wrote : Please test proposed package

Hello Lukas, or anyone else affected,

Accepted netplan.io into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/netplan.io/0.102-0ubuntu1~20.10.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-groovy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Revision history for this message
Lukas Märdian (slyon) wrote :

I verified the Groovy SRU (0.102-0ubuntu1~20.10.2) and attached the corresponding test logs to the bug description.

description: updated
tags: added: verification-done-groovy
removed: verification-needed-groovy
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package netplan.io - 0.102-0ubuntu1~20.10.2

---------------
netplan.io (0.102-0ubuntu1~20.10.2) groovy; urgency=medium

  * Backport netplan.io 0.102-0ubuntu1 to 20.10 (LP: #1919453)
    - Includes NetworkManager YAML backend API
    - Includes 'congestion-window', 'advertised-receive-window' & 'ttl' keys
    - Includes 'netplan set' improvements
  * Skip 'regressions' test on Groovy/armhf

 -- Lukas Märdian <email address hidden> Tue, 30 Mar 2021 15:48:39 +0200

Changed in netplan.io (Ubuntu Groovy):
status: Fix Committed → Fix Released
Revision history for this message
Brian Murray (brian-murray) wrote : Update Released

The verification of the Stable Release Update for netplan.io has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package netplan.io - 0.102-0ubuntu1~20.04.1

---------------
netplan.io (0.102-0ubuntu1~20.04.1) focal; urgency=medium

  * Backport netplan.io 0.102-0ubuntu1 to 20.04 (LP: #1919453)
    - Includes NetworkManager YAML backend API
    - Includes 'congestion-window', 'advertised-receive-window' & 'ttl' keys
    - Includes 'netplan set' improvements
  * Keep riscv64 build-time tests disabled
  * Add d/p/0002-tests-tunnels-improve-flaky-wireguard-test-with-wait.patch

 -- Lukas Märdian <email address hidden> Fri, 26 Mar 2021 13:35:37 +0100

Changed in netplan.io (Ubuntu Focal):
status: Fix Committed → Fix Released
Revision history for this message
Łukasz Zemczak (sil2100) wrote :

Due to LP: #1922898 being reported, I have temporarily reverted the 0.102 release from -updates to -proposed. Changing back the tags and such!

Changed in netplan.io (Ubuntu Groovy):
status: Fix Released → Fix Committed
Changed in netplan.io (Ubuntu Focal):
status: Fix Released → Fix Committed
tags: added: verification-needed-focal verification-needed-groovy
removed: verification-done-focal verification-done-groovy
Revision history for this message
Brian Murray (brian-murray) wrote : Please test proposed package

Hello Lukas, or anyone else affected,

Accepted netplan.io into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/netplan.io/0.102-0ubuntu1~20.04.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Lukas Märdian (slyon)
description: updated
Revision history for this message
Lukas Märdian (slyon) wrote :

I re-verified the Focal SRU (0.102-0ubuntu1~20.04.2) and updated the corresponding test logs for Focal in the bug description. The logs are the same as in LP: #1922898 (same package, version & tests).

All tests passed on first run.

tags: added: verification-done-focal
removed: verification-needed-focal
Mathew Hodson (mhodson)
tags: added: upgrade-software-version
removed: verification-needed
Changed in netplan.io (Ubuntu Focal):
importance: Undecided → Medium
Changed in netplan.io (Ubuntu Groovy):
importance: Undecided → Medium
Revision history for this message
Brian Murray (brian-murray) wrote :

Hello Lukas, or anyone else affected,

Accepted netplan.io into groovy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/netplan.io/0.102-0ubuntu1~20.10.3 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-groovy to verification-done-groovy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-groovy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

tags: added: verification-needed
Revision history for this message
Lukas Märdian (slyon) wrote :

I re-verified the Groovy SRU (0.102-0ubuntu1~20.10.3) and updated the corresponding test logs for Groovy in the bug description. The logs are the same as in LP: #1922898 (same package, version & tests).

All tests passed on first run.

description: updated
tags: added: verification-done-groovy
removed: verification-needed-groovy
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package netplan.io - 0.102-0ubuntu1~20.04.2

---------------
netplan.io (0.102-0ubuntu1~20.04.2) focal; urgency=medium

  * Backport netplan.io 0.102-0ubuntu1 to 20.04 (LP: #1919453)
    - Includes NetworkManager YAML backend API
    - Includes 'congestion-window' & 'advertised-receive-window' keys
    - Includes 'netplan set' improvements
  * Keep riscv64 build-time tests disabled
  * Add d/p/0002-tests-tunnels-improve-flaky-wireguard-test-with-wait.patch
  * Fix regression (LP: #1922898), by avoiding to break the ABI
    This reverts the "Added ttl option for tunnels" feature

 -- Lukas Märdian <email address hidden> Mon, 19 Apr 2021 15:08:37 +0200

Changed in netplan.io (Ubuntu Focal):
status: Fix Committed → Fix Released
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package netplan.io - 0.102-0ubuntu1~20.10.3

---------------
netplan.io (0.102-0ubuntu1~20.10.3) groovy; urgency=medium

  * Backport netplan.io 0.102-0ubuntu1 to 20.10 (LP: #1919453)
    - Includes NetworkManager YAML backend API
    - Includes 'congestion-window' & 'advertised-receive-window' keys
    - Includes 'netplan set' improvements
  * Fix regression (LP: #1922898), by avoiding to break the ABI
    This reverts the "Added ttl option for tunnels" feature
  * Improve flaky autopkgtests:
    + Skip flaky 'regressions' test on armhf/LXD
    + Add d/p/0002-tests-tunnels-improve-flaky-wireguard-test-with-wait.patch
    + Add d/p/fix-autopkgtest-waiting-logic.patch + prepare.patch

 -- Lukas Märdian <email address hidden> Fri, 07 May 2021 14:03:19 +0200

Changed in netplan.io (Ubuntu Groovy):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.