Hi Dan,

I will test the patch today and report back to you

Thanks,
J

On Wed, 3 Mar 2021, 5:51 am Dan Streetman, <email address hidden>
wrote:

> @marcin-kasperski, @buehmann, @jim-photojim, @jkeir, can any of you
> please test with the build from the ppa from comment 8?
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1906331
>
> Title:
>   systemd-resolve crashes fairly often (and reports various assertions)
>
> Status in systemd package in Ubuntu:
>   In Progress
> Status in systemd source package in Focal:
>   In Progress
> Status in systemd source package in Groovy:
>   In Progress
> Status in systemd source package in Hirsute:
>   In Progress
>
> Bug description:
>   [impact]
>
>   systemd-resolved crashes
>
>   [test case]
>
>   see original description; I can't reproduce so I'm relying on the
>   reporter(s) to test/verify.
>
>   [regression potential]
>
>   any regression would likely occur while processing sd_event objects,
>   which are used throughout systemd code; this could result in crashes
>   in almost any part of systemd code. However a more likely regression
>   would be leaks of sd_event objects due to failure to release the final
>   ref for an object.
>
>   [scope]
>
>   This is needed for f/g/h
>
>   This might be fixed by upstream commit
>   f814c871e65df8552a055dd887bc94b074037833; if so, that commit isn't
>   included in any systemd release yet, and so is needed in h and
>   earlier.
>
>   [other info]
>
>   I believe this is caused by a freed sd_event object that is then
>   processed and calls the on_query_timeout callback with invalid state,
>   leading to failed assertion, which causes resolved to crash; that's
>   what analysis of the crash dump appears to indicate. This may be fixed
>   by the upstream commit referenced in [scope], which takes additional
>   refs during function calls. However I haven't reproduced this myself,
>   so I'm only guessing as to the cause and solution at this point.
>
>   I'm unsure why this would not occur in bionic, but per comment 5 it
>   seems it doesn't happen in that release.
>
>   [original description]
>
>   (Tested on regularly updated Ubuntu 20.04, currently i use systemd
>   245.4-4ubuntu3.2)
>
>   I observe fairly lot of segfaults of systemd-resolve. Frequency vary
>   but … see below.
>
>   I have no clue what is the reason. Specific feature of my machine is
>   that apart from normal cable connection (to OpenWRT router) I use
>   OpenVPN for business network (and this submits specific nameserver for
>   myorg.local domain).
>
>   ~~~~~
>   $ LC_ALL=C dmesg -T --level=info | grep systemd-resolve
>   [Sun Nov 29 11:47:37 2020] systemd-resolve[1629307]: segfault at
> 190eed7bdc6 ip 00007fd98f771dc9 sp 00007ffc2352a100 error 4 in
> libsystemd-shared-245.so[7fd98f74c000+16e000]
>   [Sun Nov 29 11:57:27 2020] systemd-resolve[1629787]: segfault at 1f ip
> 000055ab7b0cb686 sp 00007fff78ce4bd0 error 4 in
> systemd-resolved[55ab7b0a4000+3e000]
>   [Sun Nov 29 12:07:37 2020] systemd-resolve[1630481]: segfault at 191 ip
> 000055ca69fed91c sp 00007ffc4d757dc0 error 6 in
> systemd-resolved[55ca69fc2000+3e000]
>   [Sun Nov 29 13:12:26 2020] systemd-resolve[1638829]: segfault at
> 19224162371 ip 00007fc1bc9b9dc9 sp 00007ffc21378170 error 4 in
> libsystemd-shared-245.so[7fc1bc994000+16e000]
>   [Sun Nov 29 13:32:57 2020] systemd-resolve[1639886]: segfault at
> 1926d8126d3 ip 00007f7ed17e9dc9 sp 00007ffda2cea0b0 error 4 in
> libsystemd-shared-245.so[7f7ed17c4000+16e000]
>   [Sun Nov 29 13:42:37 2020] systemd-resolve[1640246]: segfault at 61 ip
> 0000558d992e2686 sp 00007fff08906af0 error 4 in
> systemd-resolved[558d992bb000+3e000]
>   [Sun Nov 29 15:42:26 2020] systemd-resolve[1645397]: segfault at
> 1943c92afc7 ip 00007fd4c1721dc9 sp 00007fff25259ce0 error 4 in
> libsystemd-shared-245.so[7fd4c16fc000+16e000]
>   [Sun Nov 29 16:02:36 2020] systemd-resolve[1646052]: segfault at
> 1947ecb3726 ip 00007f1008549dc9 sp 00007fff44a6db70 error 4 in
> libsystemd-shared-245.so[7f1008524000+16e000]
>   [Sun Nov 29 17:42:35 2020] systemd-resolve[1649403]: segfault at 71 ip
> 000055a37fe5a686 sp 00007ffd9a160440 error 4 in
> systemd-resolved[55a37fe33000+3e000]
>   [Sun Nov 29 17:52:35 2020] systemd-resolve[1649759]: segfault at
> 558d292947d0 ip 0000558d292947d0 sp 00007ffec7ab3bf8 error 15
>   [Sun Nov 29 19:17:55 2020] systemd-resolve[1652349]: segfault at
> 558995b77cf0 ip 0000558995b77cf0 sp 00007ffe545ae4a8 error 15
>   [Sun Nov 29 19:32:35 2020] systemd-resolve[1652640]: segfault at
> 19773c20194 ip 00007f66bb529dc9 sp 00007fffd7066fc0 error 4 in
> libsystemd-shared-245.so[7f66bb504000+16e000]
>   [Sun Nov 29 20:03:54 2020] systemd-resolve[1653715]: segfault at
> 197e3aee918 ip 00007fdc40b51dc9 sp 00007ffde484fbf0 error 4 in
> libsystemd-shared-245.so[7fdc40b2c000+16e000]
>   [Sun Nov 29 20:22:24 2020] systemd-resolve[1654540]: segfault at
> 19820a05297 ip 00007f6a92839dc9 sp 00007ffe4ba00440 error 4 in
> libsystemd-shared-245.so[7f6a92814000+16e000]
>   [Sun Nov 29 21:13:10 2020] systemd-resolve[1660272]: segfault at
> 555f9a5915e0 ip 0000555f9a5915e0 sp 00007fff053e5e68 error 15
>   [Sun Nov 29 21:32:34 2020] systemd-resolve[1661026]: segfault at
> 1991af73f2e ip 00007ff194021dc9 sp 00007fffa6d61680 error 4 in
> libsystemd-shared-245.so[7ff193ffc000+16e000]
>   [Sun Nov 29 22:03:20 2020] systemd-resolve[1661941]: segfault at
> 5625966828e0 ip 00005625966828e0 sp 00007ffdf5a8bb48 error 15
>   [Sun Nov 29 22:32:44 2020] systemd-resolve[1662604]: segfault at
> 199f18ae01d ip 00007f457c9d1dc9 sp 00007ffc62b80ef0 error 4 in
> libsystemd-shared-245.so[7f457c9ac000+16e000]
>   [Sun Nov 29 23:12:23 2020] systemd-resolve[1664072]: segfault at 73b8 ip
> 0000562619f8c93a sp 00007ffd527b7ef0 error 6 in
> systemd-resolved[562619f61000+3e000]
>   [Sun Nov 29 23:22:34 2020] systemd-resolve[1664423]: segfault at
> 19aaa4d4c00 ip 00007f2621539dc9 sp 00007ffc73102280 error 4 in
> libsystemd-shared-245.so[7f2621514000+16e000]
>   [Mon Nov 30 00:12:23 2020] systemd-resolve[1666158]: segfault at
> 19b5c72000a ip 00007f530b5c1dc9 sp 00007ffc6007ccf0 error 4 in
> libsystemd-shared-245.so[7f530b59c000+16e000]
>   [Mon Nov 30 00:47:54 2020] systemd-resolve[1667280]: segfault at
> 100000036 ip 00007f0736b8bbe8 sp 00007fffed4d3cb0 error 4 in
> libsystemd-shared-245.so[7f0736acc000+16e000]
>   [Mon Nov 30 01:57:53 2020] systemd-resolve[1669463]: segfault at
> 558d6b61c0c0 ip 0000558d6b61c0c0 sp 00007ffc68df7198 error 15
>   [Mon Nov 30 02:58:08 2020] traps: systemd-resolve[1672553] general
> protection fault ip:55b967d86760 sp:7fffaecf4468 error:0 in
> systemd-resolved[55b967d5f000+3e000]
>   [Mon Nov 30 03:38:08 2020] systemd-resolve[1673682]: segfault at
> 19e3c4d5050 ip 00007fdf0ba29dc9 sp 00007ffe4d561430 error 4 in
> libsystemd-shared-245.so[7fdf0ba04000+16e000]
>   [Mon Nov 30 05:07:22 2020] systemd-resolve[1681387]: segfault at
> 7f7e31c39c10 ip 00007f7e31c39c10 sp 00007ffe5ad31f58 error 15 in
> libc-2.31.so[7f7e31c39000+3000]
>   [Mon Nov 30 05:47:43 2020] systemd-resolve[1682761]: segfault at
> 1a00b86dff0 ip 00007f69066c9dc9 sp 00007fff079c4fd0 error 4 in
> libsystemd-shared-245.so[7f69066a4000+16e000]
>   [Mon Nov 30 06:17:42 2020] systemd-resolve[1684158]: segfault at
> 1a070831ad3 ip 00007f308aa19dc9 sp 00007fffa7de12e0 error 4 in
> libsystemd-shared-245.so[7f308a9f4000+16e000]
>   [Mon Nov 30 06:27:21 2020] systemd-resolve[1684457]: segfault at
> 1a094465eb1 ip 00007f751c9b9dc9 sp 00007ffee6452930 error 4 in
> libsystemd-shared-245.so[7f751c994000+16e000]
>   [Mon Nov 30 07:12:21 2020] systemd-resolve[1685888]: segfault at
> 1a13a2db693 ip 00007f7dfb029dc9 sp 00007ffeb5f30600 error 4 in
> libsystemd-shared-245.so[7f7dfb004000+16e000]
>   [Mon Nov 30 08:17:21 2020] traps: systemd-resolve[1688510] general
> protection fault ip:559181bc2760 sp:7fff2ea2f1d8 error:0 in
> systemd-resolved[559181b9b000+3e000]
>   [Mon Nov 30 08:27:31 2020] systemd-resolve[1691391]: segfault at
> 1a2475be1c2 ip 00007fd38b271dc9 sp 00007ffdc116dad0 error 4 in
> libsystemd-shared-245.so[7fd38b24c000+16e000]
>   [Mon Nov 30 08:58:25 2020] systemd-resolve[1692357]: segfault at
> 1a2af5e7f63 ip 00007fbae5c81dc9 sp 00007ffdc36e31a0 error 4 in
> libsystemd-shared-245.so[7fbae5c5c000+16e000]
>   [Mon Nov 30 10:02:20 2020] systemd-resolve[1697183]: segfault at 208 ip
> 000055f232f3793a sp 00007ffc9fad5230 error 6 in
> systemd-resolved[55f232f0c000+3e000]
>   [Mon Nov 30 10:12:20 2020] systemd-resolve[1697500]: segfault at
> 1a3be1bb4b4 ip 00007fbd22749dc9 sp 00007ffec3404b30 error 4 in
> libsystemd-shared-245.so[7fbd22724000+16e000]
>   [Mon Nov 30 11:17:30 2020] systemd-resolve[1701684]: segfault at
> 1a4a6e7be98 ip 00007f8a6c801dc9 sp 00007ffea4117850 error 4 in
> libsystemd-shared-245.so[7f8a6c7dc000+16e000]
>   [Mon Nov 30 12:58:18 2020] systemd-resolve[1707203]: segfault at
> ffffffff00000020 ip 000055bdf867d686 sp 00007ffe2d636bb0 error 5 in
> systemd-resolved[55bdf8656000+3e000]
>   [Mon Nov 30 14:25:41 2020] systemd-resolve[1710420]: segfault at
> 1a7426fba1a ip 00007f2a1e869dc9 sp 00007ffec5869d40 error 4 in
> libsystemd-shared-245.so[7f2a1e844000+16e000]
>   [Mon Nov 30 14:52:39 2020] systemd-resolve[1712923]: segfault at
> 55f7d8f636e8 ip 000055f7d8f636e8 sp 00007ffce3c1f528 error 15
>   [Mon Nov 30 15:02:29 2020] systemd-resolve[1713448]: segfault at
> 1a7c60ef1a0 ip 00007f173d8f1dc9 sp 00007ffc715163d0 error 4 in
> libsystemd-shared-245.so[7f173d8cc000+16e000]
>   [Mon Nov 30 15:14:18 2020] systemd-resolve[1714394]: segfault at 54 ip
> 00007f3806f89dc9 sp 00007ffea68d70e0 error 4 in
> libsystemd-shared-245.so[7f3806f64000+16e000]
>   [Mon Nov 30 15:42:18 2020] systemd-resolve[1715906]: segfault at
> 100000003 ip 00007fe65ee59dc9 sp 00007ffe0f486460 error 4 in
> libsystemd-shared-245.so[7fe65ee34000+16e000]
>   [Mon Nov 30 16:02:39 2020] systemd-resolve[1717460]: segfault at 7 ip
> 00007f5a4de19dc9 sp 00007ffd1fa46490 error 4 in
> libsystemd-shared-245.so[7f5a4ddf4000+16e000]
>   [Mon Nov 30 16:22:28 2020] systemd-resolve[1719182]: segfault at
> 1a8e42924e4 ip 00007faa5c251dc9 sp 00007ffedcf4c120 error 4 in
> libsystemd-shared-245.so[7faa5c22c000+16e000]
>   [Mon Nov 30 16:37:18 2020] systemd-resolve[1719462]: segfault at 1f ip
> 0000557e68947686 sp 00007ffd6ec75570 error 4 in
> systemd-resolved[557e68920000+3e000]
>   [Mon Nov 30 17:43:02 2020] traps: systemd-resolve[1722859] general
> protection fault ip:5575fa1388d4 sp:7ffd0835bce0 error:0 in
> systemd-resolved[5575fa10d000+3e000]
>   [Mon Nov 30 18:12:48 2020] systemd-resolve[1725814]: segfault at
> 55b69de577c8 ip 000055b69de577c8 sp 00007ffee9d70f18 error 15
>   [Mon Nov 30 18:37:38 2020] systemd-resolve[1727788]: segfault at
> 74756f666d ip 00005563cd41091c sp 00007ffd51addc90 error 6 in
> systemd-resolved[5563cd3e5000+3e000]
>   [Mon Nov 30 18:48:02 2020] systemd-resolve[1728444]: segfault at 308 ip
> 000055b57aa0b93a sp 00007ffeefd7f400 error 6 in
> systemd-resolved[55b57a9e0000+3e000]
>   [Mon Nov 30 19:32:28 2020] systemd-resolve[1730898]: segfault at
> 5648012b4770 ip 00005648012b4770 sp 00007ffea0bd9e18 error 15
>   [Mon Nov 30 19:53:01 2020] systemd-resolve[1732347]: segfault at
> ffffffff00000020 ip 000055b0ace66686 sp 00007ffc73f3c9d0 error 5 in
> systemd-resolved[55b0ace3f000+3e000]
>   [Mon Nov 30 19:59:17 2020] systemd-resolve[1733001]: segfault at
> 52dd6b26 ip 00007fafebdf9dc9 sp 00007ffd591cd2a0 error 4 in
> libsystemd-shared-245.so[7fafebdd4000+16e000]
>   [Mon Nov 30 20:27:17 2020] systemd-resolve[1735033]: segfault at
> 1ac55647a0b ip 00007fb26ea49dc9 sp 00007ffdd481ff30 error 4 in
> libsystemd-shared-245.so[7fb26ea24000+16e000]
>   [Mon Nov 30 22:42:37 2020] systemd-resolve[1746028]: segfault at
> 1ae39b02ae4 ip 00007f82f18d9dc9 sp 00007ffc088615b0 error 4 in
> libsystemd-shared-245.so[7f82f18b4000+16e000]
>   [Mon Nov 30 22:57:36 2020] systemd-resolve[1746999]: segfault at
> 1ae6963116c ip 00007f85cc831dc9 sp 00007ffce6f3f5f0 error 4 in
> libsystemd-shared-245.so[7f85cc80c000+16e000]
>   [Tue Dec  1 00:22:16 2020] traps: systemd-resolve[1862379] general
> protection fault ip:55fb9c6b3760 sp:7fff017519a8 error:0 in
> systemd-resolved[55fb9c68c000+3e000]
>   [Tue Dec  1 00:57:16 2020] systemd-resolve[1905008]: segfault at
> 1b015f1c2e7 ip 00007f47185b1dc9 sp 00007ffd899bd1a0 error 4 in
> libsystemd-shared-245.so[7f471858c000+16e000]
>   ~~~~~
>
>   I also noted various interesting assertions in journal, in next
>   comment…
>
> To manage notifications about this bug go to:
>
> https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1906331/+subscriptions
>