Merge ~ogayot/britney:netplan.io-noble into ~ubuntu-release/britney/+git/hints-ubuntu:devel

[Olivier Gayot]

Mark netplan.io 0.107-5ubuntu2 as badtest on s390x

In LP: #2048388, netplan.io autopkgtest fails with the following error
(which looks like a race condition) when run with trigger=wpa/... on
s390x:

  AssertionError: systemd units changed without reload

This is blocking the migration of wpa 2:2.10-21 although there seems to
be no obvious regression in src:wpa. It looks like the trigger affects
the order of events when the tests are run, and consequently increases
the likelihood of the issue to occur.

Signed-off-by: Olivier Gayot <email address hidden>

The netplan.io autopkgtest results [1] on s390x are not looking good.

There seems to be a race condition which occurs consistently on s390x when the trigger=wpa/2:2.10-21 is passed. A regression in src:wpa causing the error we're seeing seems very unlikely based on the changeset [2] between 2:2.10-20 and 2:2.10-21.

The issue is tracked in
https://bugs.launchpad.net/ubuntu/+source/netplan.io/+bug/2048388

I discussed with netplan upstream and we agreed that while more tests are needed to determine the root cause, disabling the test on s390x would be a good workaround in the meantime.

[1]https://autopkgtest.ubuntu.com/packages/netplan.io/noble/s390x
[2]https://git.launchpad.net/ubuntu/+source/wpa/commit/?h=applied/ubuntu/noble-proposed&id=2e25663fa712c511808465dc424742e5d1535759

[Steve Langasek (vorlon)]

My understanding is that the only evidence is of the autopkgtest being flaky *with the new version of wpa*.

So this would remain a regression in autopkgtest coverage of a core component of our stack. I am not ok signing off on this. Please work with the netplan maintainers as necessary to get the tests into a state that they are NOT flaky.

review: Disapprove

Unmerged commits

18c2e66... by Olivier Gayot on 2024-01-17

Mark netplan.io 0.107-5ubuntu2 as badtest on s390x

In LP: #2048388, netplan.io autopkgtest fails with the following error
(which looks like a race condition) when run with trigger=wpa/... on
s390x:

  AssertionError: systemd units changed without reload

This is blocking the migration of wpa 2:2.10-21 although there seems to
be no obvious regression in src:wpa. It looks like the trigger affects
the order of events when the tests are run, and consequently increases
the likelihood of the issue to occur.

Signed-off-by: Olivier Gayot <email address hidden>

diff --git a/ubuntu-release b/ubuntu-release
index d534e04..8dfc536 100644
--- a/ubuntu-release
+++ b/ubuntu-release
@@ -46,6 +46,9 @@ force-badtest tp-smapi/unknown/arm64
 # subtests show no-regression relative the release pocket
 force-skiptest linux-meta-lowlatency/6.5.0.9.9.9
 
+# flaky on s390x, see LP: #2048388
+force-badtest netplan.io/0.107-5ubuntu2/s390x
+
 # 23.10 unblocks
 unblock linux-firmware/20230919.git3672ccab-0ubuntu2.1
 unblock shim-signed/1.56