NetworkManager 1.36.6 no longer prefers DHCPv6 addresses over SLAAC

Comparing the output of `ip -6 a`, you can see that the dynamic addresses are no longer at the top of the list, where they should be.

Before (network-manager 1.36.4):

2: eno0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 state UP qlen 1000
    inet6 2a10:3781:xxxx::bd0/128 scope global dynamic noprefixroute
       valid_lft 43193sec preferred_lft 43194sec
    inet6 fd10:3781:xxxx::bd0/128 scope global dynamic noprefixroute
       valid_lft 43193sec preferred_lft 43194sec
    inet6 fd10:3781:xxxx:0:9875:4dec:b9f9:e768/64 scope global noprefixroute
       valid_lft forever preferred_lft forever
    inet6 2a10:3781:xxxx:0:f802:2428:9af1:dcb3/64 scope global noprefixroute
       valid_lft forever preferred_lft forever
    inet6 fe80::36e2:ec4c:fddb:3c89/64 scope link noprefixroute
       valid_lft forever preferred_lft forever

After (network-manager 1.36.6):

2: eno0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 state UP qlen 1000
    inet6 fd10:3781:xxxx:0:9875:4dec:b9f9:e768/64 scope global noprefixroute
       valid_lft forever preferred_lft forever
    inet6 2a10:3781:xxxx:0:f802:2428:9af1:dcb3/64 scope global noprefixroute
       valid_lft forever preferred_lft forever
    inet6 2a10:3781:xxxx::bd0/128 scope global dynamic noprefixroute
       valid_lft 43194sec preferred_lft 43194sec
    inet6 fd10:3781:xxxx::bd0/128 scope global dynamic noprefixroute
       valid_lft 43194sec preferred_lft 43194sec
    inet6 fe80::36e2:ec4c:fddb:3c89/64 scope link noprefixroute
       valid_lft forever preferred_lft forever

On another machine with Debian sid and network-manager 1.38.0, it looks the way it should be again (dynamic addresses at the top of the list, preferred to autoconfigured / temporary addresses):

2: wlan0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 state UP qlen 1000
    inet6 fd10:3781:xxxx::5bf/128 scope global dynamic noprefixroute
       valid_lft 43193sec preferred_lft 43193sec
    inet6 2a10:3781:xxxx::5bf/128 scope global dynamic noprefixroute
       valid_lft 43193sec preferred_lft 43193sec
    inet6 2a10:3781:xxxx:0:42cd:4f1b:89b8:77fd/64 scope global noprefixroute
       valid_lft forever preferred_lft forever
    inet6 fd10:3781:xxxx:0:8a59:df52:9ea1:e7c8/64 scope global noprefixroute
       valid_lft forever preferred_lft forever
    inet6 fe80::a738:71dc:f10e:924e/64 scope link noprefixroute
       valid_lft forever preferred_lft forever

So this bug was not present in NetworkManager 1.36.4, introduced in 1.36.6, and then fixed in 1.38.0.

The correct order for IPv6 addresses should be:

1. Static addresses (if present)
2. DHCPv6 addresses (shown as 'dynamic' with ip -6 a)
3. Temporary SLAAC addresses (in case IPv6 Privacy Extensions are enabled, otherwise not present)
4. Global SLAAC addresses (the long ones with :0: after the network part ending with /64)

With NetworkManager 1.36.6 the order is now 3 > 4 > 1 > 2.

I guess these commits are relevant:

https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/commit/c631aa48f034ade2b5cb97ccc4462d56d80174e7

https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/commit/257221d1986b56cbb2e329fcc74a2daca145b7aa

Bottom line: addresses are now...

Status changed to 'Confirmed' because the bug affects multiple users.

Thanks for the detail, you might want consider to report the issue directly upstream next time which is the right place to fix a regression due to a version update,, I've forwarded it now to https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/issues/1021

@seb128 What is the plan for the network-manager package in Ubuntu jammy-updates? Is it to be left broken until upstream fixes this bug?

Because I think that the problem this last version introduces is a lot bigger than the problem(s) it solves. Therefore I would say that it can be defended to upload a new version that restores 1.36.4-2ubuntu1 for the time being, and then re-sync with upstream when (or if) this bug is fixed.

As far as I'm aware, the update from 1.36.4 to 1.36.6 did not close any outstanding Launchpad bugs, so it didn't fix anything from Ubuntu's perspective. It just introduced this regression.

@Kevin. Thanks, it's a bit of an annoying situation. The current update is not only in proposed but was moving to updates before you reported the regression, which means we can't simply delete it from proposed, we need a fix or revert. I was hoping upstream would figure out a fix quickly enough that we could do another bugfix upload. If that doesn't play out this way we need to figure out what to do.

The initial reason for SRUing the update, out of keeping up with upstream fixes, was that it fixes some hotspot issues which is a topic we are getting complain about (https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/commit/6a82dd18)

We could revert back the version, including other fixes. Or revert the change that created the regression you reported. Note that while it seems an annoying issue to you that's the only report we got so far which suggest it's not a common configuration for our users, which is also a reason why I decided to wait a bit to see if upstream was reacting before reverting.

Unfortunately I was not tracking jammy-proposed, so I only found out about this bug when it entered jammy-updates.

I don't think my configuration is that exotic to be honest. Many companies use DHCPv6 servers giving out static leases, and many companies use firewalls to restrict incoming (SSH) connections to their servers. And not many network administrators disable SLAAC as that would break IPv6 for all Android users. So corporate and home networks with DHCPv6 and SLAAC enabled are quite common.

How viable would it be to create something like 1.36.7~really1.36.4 or something like that, which would be the previous version with only commit 6a82dd18 cherry picked to fix the hotspot issue and not introduce the source address selection bug?

I suppose upstream would at some point release 1.36.9, which will hopefully have this bug fixed, and also have commit 6a82dd18 included, so Ubuntu can go back to the upstream version then.

@seb128 I am also affected by this bug and privacy-wise every other Ubuntu 22.04 user as well, but I didn´t respond, trusting the process that this bug would be fixed. So I am supporting your efforts getting an upstream fix shortly or alternatively reverting the change that created the regression.

Upstream provided me a patch to try which I uploaded to a ppa now,
https://launchpad.net/~ubuntu-desktop/+archive/ubuntu/ppa/+build/23833629

Could you install it and see if that fixes the issue?

This seems to restore previous behaviour yes.

Thank you, this solution fixes the bug for me as well.

Thanks for the testing and for following up on the issue. I've uploaded that patch to the SRU queue now

Hello Kevin, or anyone else affected,

Accepted network-manager into jammy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/network-manager/1.36.6-0ubuntu2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-jammy to verification-done-jammy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-jammy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

kevin@arcadia:~$ apt info network-manager
Package: network-manager
Version: 1.36.6-0ubuntu2

kevin@arcadia:~$ apt info libnm0
Package: libnm0
Version: 1.36.6-0ubuntu2

I have installed network-manager and libnm0 version 1.36.6-0ubuntu2 from jammy-proposed. After connecting to a network with both SLAAC and DHCPv6 enabled, the DHCPv6 address was selected as the source address again, like it was in version 1.36.4, prior to the update introducing this bug.

This restores the original and desired behaviour.

It's fixed upstream as well now: https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/commit/6920b6ceb1c2e7856ad76e118ee5b4dd36130735

Any updates regarding the release to jammy-updates?

This bug was fixed in the package network-manager - 1.36.6-0ubuntu2

---------------
network-manager (1.36.6-0ubuntu2) jammy; urgency=medium

  * debian/patches/fix_addresses_order.patch:
    - platform: workaround for preserving IPv6 address order
      (lp: #1977619)

 -- Sebastien Bacher <email address hidden> Thu, 09 Jun 2022 11:27:56 +0200

The verification of the Stable Release Update for network-manager has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.