Bug #1567540 “ntpd crashed with SIGABRT (was: ntp crashes everyt...” : Bugs : ntp package : Ubuntu

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-07: .etc.apparmor.d.usr.sbin.ntpd.txt

#1

.etc.apparmor.d.usr.sbin.ntpd.txt Edit (2.1 KiB, text/plain)

apport information

tags:	added: apport-collected xenial
description:	updated

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-07: Dependencies.txt

#2

Dependencies.txt Edit (1.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-07: JournalErrors.txt

#3

JournalErrors.txt Edit (126.6 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-07: KernLog.txt

#4

KernLog.txt Edit (2.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-07: ProcEnviron.txt

#5

ProcEnviron.txt Edit (247 bytes, text/plain)

apport information

Revision history for this message

Nish Aravamudan (nacc) wrote on 2016-04-08: Re: ntp crashes everytime the network goes up or down.

#6

Thank you for filing this bug report! None of the logs provide any of the crashing output, would it be possible to provide a bit more detail as to the crash?

Changed in ntp (Ubuntu):
status:	New → Incomplete

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-09:

#7

See if it has the trace. Edit (307.4 KiB, text/plain)

Pavlushka (pavelsayekat) on 2016-04-11

Changed in ntp (Ubuntu):
status:	Incomplete → New

Revision history for this message

In bugs.ntp.org/ #2831, Stenn (stenn) wrote on 2016-04-12:

#63

Comment on attachment 1325
Do mlockall before threads

Pearly, thoughts?

Revision history for this message

In bugs.ntp.org/ #2831, Stenn (stenn) wrote on 2016-04-12:

#64

Comment on attachment 1399
protect dnsworker_contexts with a mutex

Pearly, thoughts?

Revision history for this message

In bugs.ntp.org/ #2831, Stenn (stenn) wrote on 2016-04-12:

#65

Mike,

Thanks for the patch - I hope we can get it reviewed soon.

Revision history for this message

In bugs.ntp.org/ #2831, H-murray (h-murray) wrote on 2016-04-12:

#66

Mike: Thanks for tracking this down. I think this explains all the problems.

I don't think the patch is good enough.

You also need a lock on read references to dnsworker_contexts. The only
other reference is a few lines below and in a subroutine called from there.
I suggest moving the lock to the top of get_worker_context and the
unlock to the bottom. (and adding a assumes-lock comment to the top of
alloc_dnsworker_context)

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-12: .etc.apparmor.d.usr.sbin.ntpd.txt

#8

.etc.apparmor.d.usr.sbin.ntpd.txt Edit (2.2 KiB, text/plain)

apport information

description:

updated

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-12: Dependencies.txt

#9

Dependencies.txt Edit (1.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-12: JournalErrors.txt

#10

JournalErrors.txt Edit (254.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-12: KernLog.txt

#11

KernLog.txt Edit (13.9 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-12: ProcEnviron.txt

#12

ProcEnviron.txt Edit (247 bytes, text/plain)

apport information

Revision history for this message

In bugs.ntp.org/ #2831, Smallm (smallm) wrote on 2016-04-12:

#67

Ack, that was careless of me. Started fixing it the way you suggested, but I'm wondering if something more major is needed. Even if I spread out the locks within get_worker_context() to top and bottom, it would still be giving out a pointer into the array that realloc can relocate. Return a copy of the struct? Does anyone else have ideas for this module (I thought I saw a comment in another CR to that effect)? I'm really very bad at multi-threaded coding.

Also, I guess a real patch needs to consider Windows.

Revision history for this message

In bugs.ntp.org/ #2831, H-murray (h-murray) wrote on 2016-04-13:

#68

There is probably another copy of this problem in the other direction.

There are two places where info gets queued up and passed from thread
to thread. One is when the main thread tells the worker thread(s) what
to do. The other is when a worker thread is telling the main thread
an answer.

Looks like the other one is reserve_dnschild_ctx

I suggest folding alloc_dnsworker_context into get_worker_context
It's only called from one place and it will be easier to make
sure the locks are right without that extra layer. It's only a few
lines of code. The abstraction layer isn't helping anything.

It might be cleaner to move the definition of dnsworker_contexts
and dnsworker_contexts_alloc into get_worker_context. The idea
is to make sure the lock covers all uses.
static xxx
I think all c compilers support that.

> Even if I spread out the locks within get_worker_context()
> to top and bottom, it would still be giving out a pointer
> into the array that realloc can relocate.

The thing that is getting realloc-ed is the array holding pointers
to blocks. The individual block never gets realloc-ed. The lock
only needs to protect the array. It's only referenced within
that routine. (aside from the alloc which I suggested moving)

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: Re: ntp crashes everytime the network goes up or down.

#13

_usr_sbin_ntpd.0.crash, another crash experienced. Edit (271.2 KiB, text/plain)

description:

updated

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: .etc.apparmor.d.usr.sbin.ntpd.txt

#14

.etc.apparmor.d.usr.sbin.ntpd.txt Edit (2.2 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: Dependencies.txt

#15

Dependencies.txt Edit (1.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: JournalErrors.txt

#16

JournalErrors.txt Edit (39.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: KernLog.txt

#17

KernLog.txt Edit (2.6 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: ProcEnviron.txt

#18

ProcEnviron.txt Edit (316 bytes, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: .etc.apparmor.d.usr.sbin.ntpd.txt

#19

.etc.apparmor.d.usr.sbin.ntpd.txt Edit (2.2 KiB, text/plain)

apport information

description:

updated

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: Dependencies.txt

#20

Dependencies.txt Edit (1.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: JournalErrors.txt

#21

JournalErrors.txt Edit (46.1 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: KernLog.txt

#22

KernLog.txt Edit (2.6 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-14: ProcEnviron.txt

#23

ProcEnviron.txt Edit (316 bytes, text/plain)

apport information

Revision history for this message

In bugs.ntp.org/ #2831, Stenn (stenn) wrote on 2016-04-17:

#69

*** This bug has been marked as a duplicate of bug 2954 ***

Revision history for this message

In bugs.ntp.org/ #2831, Perlinger (perlinger) wrote on 2016-04-17:

#70

(In reply to comment #24)
>
> *** This bug has been marked as a duplicate of bug 2954 ***

That was bit early -- my fault. It is *not* exactly a dup of 2954, but related -- that is, it is also a race condition in the async/threaded resolver code.

I think the lock in the latest patch does not protect all data races here, but I'm still digging.

Revision history for this message

In bugs.ntp.org/ #2831, Perlinger (perlinger) wrote on 2016-04-18:

#71

Harlan, the repo is in

psp.ntp.org:~perlinger/ntp-stable-2831

compiled and run with

  linux/x64 --with-threads (threading resolver)
  linux/x64 --without-threads (forking resolver)
  Windows7/x64/VS2008 (threading resolver)

Hal, Mike, good catch. Only the proposed lock falls a bit short. You have to interlock all access to the global table, not just the realloc() call.

And using pthread_mutex_t is not so easy with Windows, but we all knew that ;) I used a semaphore (again) since there is already a suitable wrapper.

Revision history for this message

In bugs.ntp.org/ #2831, Stenn (stenn) wrote on 2016-04-18:

#72

Hal,

Thanks for the report. John, Pearly, et al, thanks for your work on this.

Pearly's fix is STAGED for 4.2.8p7.

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: .etc.apparmor.d.usr.sbin.ntpd.txt

#24

.etc.apparmor.d.usr.sbin.ntpd.txt Edit (2.2 KiB, text/plain)

apport information

description:

updated

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: Dependencies.txt

#25

Dependencies.txt Edit (1.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: JournalErrors.txt

#26

JournalErrors.txt Edit (62.2 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: KernLog.txt

#27

KernLog.txt Edit (2.6 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: ProcEnviron.txt

#28

ProcEnviron.txt Edit (262 bytes, text/plain)

apport information

description:

updated

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: .etc.apparmor.d.usr.sbin.ntpd.txt

#29

.etc.apparmor.d.usr.sbin.ntpd.txt Edit (2.2 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: Dependencies.txt

#30

Dependencies.txt Edit (1.7 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: JournalErrors.txt

#31

JournalErrors.txt Edit (78.4 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: KernLog.txt

#32

KernLog.txt Edit (2.6 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-04-18: ProcEnviron.txt

#33

ProcEnviron.txt Edit (262 bytes, text/plain)

apport information

Revision history for this message

In bugs.ntp.org/ #2831, Stenn (stenn) wrote on 2016-04-27:

#73

Hal,

Thanks - please mark this bug as VERIFIED or IN_PROGRESS, as appropriate.

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-05-03: Re: ntp crashes everytime the network goes up or down.

#34

From the dumps

à¦à¦ªà§à¦°à¦¿ 07 15:51:02 nowhere-6 ntpd[6197]: work_thread.c:271: INSIST(((void *)0) != req) failed
à¦à¦ªà§à¦°à¦¿ 07 15:51:02 nowhere-6 ntpd[6197]: exiting (due to assertion failure)

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-05-03:

#35

The system also looks as it is in various problems - the kernel often reports vblank issues and dumps traces, also it seems that network in general or at least towards the configured NTP and DNS seems to be down.

Could you share a bit about the configuration related to that (networking/ntp/dns) - as this might help to recreate the case.

Changed in ntp (Ubuntu):
status:	New → Incomplete

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-17: .etc.apparmor.d.usr.sbin.ntpd.txt

#36

.etc.apparmor.d.usr.sbin.ntpd.txt Edit (2.2 KiB, text/plain)

apport information

tags:	added: third-party-packages
description:	updated

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-17: Dependencies.txt

#37

Dependencies.txt Edit (1.8 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-17: JournalErrors.txt

#38

JournalErrors.txt Edit (124.2 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-17: KernLog.txt

#39

KernLog.txt Edit (2.6 KiB, text/plain)

apport information

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-17: ProcEnviron.txt

#40

ProcEnviron.txt Edit (247 bytes, text/plain)

apport information

Christian Ehrhardt  (paelzer) on 2016-06-27

summary:	- ntp crashes everytime the network goes up or down. + ntpd crashed with SIGABRT (was: ntp crashes everytime the network goes + up or down.)
Changed in ntp (Ubuntu):
status:	Incomplete → Confirmed
importance:	Undecided → High

Christian Ehrhardt  (paelzer) on 2016-06-27

Changed in ntp (Ubuntu):
status:	Confirmed → Triaged

Bug Watch Updater (bug-watch-updater) on 2016-06-27

Changed in ntp:
importance:	Unknown → High
status:	Unknown → Fix Released

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-06-27:

#74

TL;DR

The NTP Code around this is simplified:
1. Complex thing eventually setting ret to next element
2. assert ret!=NULL <-- this is what our bug reports hit

"Complex thing" was completely rewritten in the referred patch set to close the race window that it had.

So no matter these NTP bugs refer to slightly other ways of this issue to surface it is very likely the same "race".

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-27:

#75

ntp.conf Edit (2.4 KiB, text/plain)

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-27:

#76

ifconfig -a Edit (1.5 KiB, text/plain)

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-27:

#77

route -n Edit (360 bytes, text/plain)

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-27:

#78

I used to use a PPOE connection through ethernet/adsl router, and there the issue was more frequent. ANd no, I am not heavily firewalled, the dlink 2750U supposed to has its own firewall, and in my system ufw.

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-27:

#79

And it was very unlucky that I tried mtrace on ntp but it didn't crashed then but it crashes on boot or when the trace is not running, sounds funny.

Revision history for this message

Pavlushka (pavelsayekat) wrote on 2016-06-27:

#80

And now I am using a 3g modem for internet but still ntp crashes sometime.

Revision history for this message

Sudhir Reddy (t-sudhirkumar) wrote on 2016-06-27: Re: [Bug 1567540] Re: ntpd crashed with SIGABRT (was: ntp crashes everytime the network goes up or down.)

#81

Download full text (6.2 KiB)

Yes.. this issue is seen once a while. Issue is occurring more often when I
upgraded..

On Mon, Jun 27, 2016 at 9:38 PM, Pavlushka <email address hidden> wrote:

> And now I am using a 3g modem for internet but still ntp crashes
> sometime.
>
> --
> You received this bug notification because you are subscribed to a
> duplicate bug report (1577292).
> https://bugs.launchpad.net/bugs/1567540
>
> Title:
> ntpd crashed with SIGABRT (was: ntp crashes everytime the network goes
> up or down.)
>
> Status in NTP:
> Fix Released
> Status in ntp package in Ubuntu:
> Triaged
>
> Bug description:
> ntp crashes every time the network goes up or down while the system is
> running and also crashes after booting up without network.
> ---
> ApportVersion: 2.20.1-0ubuntu1
> Architecture: amd64
> CurrentDesktop: XFCE
> DistroRelease: Ubuntu 16.04
> InstallationDate: Installed on 2016-03-12 (26 days ago)
> InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Alpha amd64
> (20160224)
> NtpStatus: ntpq: read: Connection refused
> Package: ntp 1:4.2.8p4+dfsg-3ubuntu4
> PackageArchitecture: amd64
> ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-17-generic
> root=UUID=306314bc-efcb-4c2d-b0e9-e05ec92ed0f0 ro
> ProcVersionSignature: Ubuntu 4.4.0-17.33-generic 4.4.6
> Tags: xenial
> Uname: Linux 4.4.0-17-generic x86_64
> UpgradeStatus: No upgrade log present (probably fresh install)
> UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
> _MarkForUpload: True
> ---
> ApportVersion: 2.20.1-0ubuntu1
> Architecture: amd64
> CurrentDesktop: XFCE
> DistroRelease: Ubuntu 16.04
> InstallationDate: Installed on 2016-03-12 (31 days ago)
> InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Alpha amd64
> (20160224)
> NtpStatus: ntpq: read: Connection refused
> Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
> PackageArchitecture: amd64
> ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-18-generic
> root=UUID=306314bc-efcb-4c2d-b0e9-e05ec92ed0f0 ro
> ProcVersionSignature: Ubuntu 4.4.0-18.34-generic 4.4.6
> Tags: xenial
> Uname: Linux 4.4.0-18-generic x86_64
> UpgradeStatus: No upgrade log present (probably fresh install)
> UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
> _MarkForUpload: True
> ---
> ApportVersion: 2.20.1-0ubuntu1
> Architecture: amd64
> CurrentDesktop: XFCE
> DistroRelease: Ubuntu 16.04
> InstallationDate: Installed on 2016-04-13 (0 days ago)
> InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64
> (20160412)
> NtpStatus: ntpq: read: Connection refused
> Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
> PackageArchitecture: amd64
> ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-18-generic
> root=UUID=13f57794-2e19-4a56-836a-94185bba5ec5 ro quiet splash
> ProcVersionSignature: Ubuntu 4.4.0-18.34-generic 4.4.6
> Tags: xenial
> Uname: Linux 4.4.0-18-generic x86_64
> UpgradeStatus: No upgrade log present (probably fresh install)
> UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
> _MarkForUpload: True
> ---
> ApportVersion: 2.20.1-0ubuntu1
> Architecture: amd64
> CurrentDesktop: XFCE
> DistroRelease: Ubuntu 16.04
> InstallationDate: I...

Yes.. this issue is seen once a while. Issue is occurring more often when I
upgraded..

On Mon, Jun 27, 2016 at 9:38 PM, Pavlushka <pavelsayekat@gmail.com> wrote:

> And now I am using a 3g modem for internet but still ntp crashes
> sometime.
>
> --
> You received this bug notification because you are subscribed to a
> duplicate bug report (1577292).
> https://bugs.launchpad.net/bugs/1567540
>
> Title:
>   ntpd crashed with SIGABRT (was: ntp crashes everytime the network goes
>   up or down.)
>
> Status in NTP:
>   Fix Released
> Status in ntp package in Ubuntu:
>   Triaged
>
> Bug description:
>   ntp crashes every time the network goes up or down while the system is
> running and also crashes after booting up without network.
>   ---
>   ApportVersion: 2.20.1-0ubuntu1
>   Architecture: amd64
>   CurrentDesktop: XFCE
>   DistroRelease: Ubuntu 16.04
>   InstallationDate: Installed on 2016-03-12 (26 days ago)
>   InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Alpha amd64
> (20160224)
>   NtpStatus: ntpq: read: Connection refused
>   Package: ntp 1:4.2.8p4+dfsg-3ubuntu4
>   PackageArchitecture: amd64
>   ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-17-generic
> root=UUID=306314bc-efcb-4c2d-b0e9-e05ec92ed0f0 ro
>   ProcVersionSignature: Ubuntu 4.4.0-17.33-generic 4.4.6
>   Tags:  xenial
>   Uname: Linux 4.4.0-17-generic x86_64
>   UpgradeStatus: No upgrade log present (probably fresh install)
>   UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
>   _MarkForUpload: True
>   ---
>   ApportVersion: 2.20.1-0ubuntu1
>   Architecture: amd64
>   CurrentDesktop: XFCE
>   DistroRelease: Ubuntu 16.04
>   InstallationDate: Installed on 2016-03-12 (31 days ago)
>   InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Alpha amd64
> (20160224)
>   NtpStatus: ntpq: read: Connection refused
>   Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
>   PackageArchitecture: amd64
>   ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-18-generic
> root=UUID=306314bc-efcb-4c2d-b0e9-e05ec92ed0f0 ro
>   ProcVersionSignature: Ubuntu 4.4.0-18.34-generic 4.4.6
>   Tags:  xenial
>   Uname: Linux 4.4.0-18-generic x86_64
>   UpgradeStatus: No upgrade log present (probably fresh install)
>   UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
>   _MarkForUpload: True
>   ---
>   ApportVersion: 2.20.1-0ubuntu1
>   Architecture: amd64
>   CurrentDesktop: XFCE
>   DistroRelease: Ubuntu 16.04
>   InstallationDate: Installed on 2016-04-13 (0 days ago)
>   InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64
> (20160412)
>   NtpStatus: ntpq: read: Connection refused
>   Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
>   PackageArchitecture: amd64
>   ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-18-generic
> root=UUID=13f57794-2e19-4a56-836a-94185bba5ec5 ro quiet splash
>   ProcVersionSignature: Ubuntu 4.4.0-18.34-generic 4.4.6
>   Tags:  xenial
>   Uname: Linux 4.4.0-18-generic x86_64
>   UpgradeStatus: No upgrade log present (probably fresh install)
>   UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
>   _MarkForUpload: True
>   ---
>   ApportVersion: 2.20.1-0ubuntu1
>   Architecture: amd64
>   CurrentDesktop: XFCE
>   DistroRelease: Ubuntu 16.04
>   InstallationDate: Installed on 2016-04-13 (0 days ago)
>   InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64
> (20160412)
>   NtpStatus: ntpq: read: Connection refused
>   Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
>   PackageArchitecture: amd64
>   ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-18-generic
> root=UUID=13f57794-2e19-4a56-836a-94185bba5ec5 ro quiet splash
>   ProcVersionSignature: Ubuntu 4.4.0-18.34-generic 4.4.6
>   Tags:  xenial
>   Uname: Linux 4.4.0-18-generic x86_64
>   UpgradeStatus: No upgrade log present (probably fresh install)
>   UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
>   _MarkForUpload: True
>   ---
>   ApportVersion: 2.20.1-0ubuntu2
>   Architecture: amd64
>   CurrentDesktop: XFCE
>   DistroRelease: Ubuntu 16.04
>   InstallationDate: Installed on 2016-04-14 (3 days ago)
>   InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64
> (20160412)
>   NtpStatus: ntpq: read: Connection refused
>   Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
>   PackageArchitecture: amd64
>   ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-20-generic
> root=UUID=b9c0528f-e81f-4b08-9b31-032f14f72ccd ro quiet splash vt.handoff=7
>   ProcVersionSignature: Ubuntu 4.4.0-20.36-generic 4.4.6
>   Tags:  xenial
>   Uname: Linux 4.4.0-20-generic x86_64
>   UpgradeStatus: No upgrade log present (probably fresh install)
>   UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
>   _MarkForUpload: True
>   ---
>   ApportVersion: 2.20.1-0ubuntu2
>   Architecture: amd64
>   CurrentDesktop: XFCE
>   DistroRelease: Ubuntu 16.04
>   InstallationDate: Installed on 2016-04-14 (3 days ago)
>   InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64
> (20160412)
>   NtpStatus: ntpq: read: Connection refused
>   Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
>   PackageArchitecture: amd64
>   ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-20-generic
> root=UUID=b9c0528f-e81f-4b08-9b31-032f14f72ccd ro quiet splash vt.handoff=7
>   ProcVersionSignature: Ubuntu 4.4.0-20.36-generic 4.4.6
>   Tags:  xenial
>   Uname: Linux 4.4.0-20-generic x86_64
>   UpgradeStatus: No upgrade log present (probably fresh install)
>   UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
>   _MarkForUpload: True
>   ---
>   ApportVersion: 2.20.1-0ubuntu2.1
>   Architecture: amd64
>   CurrentDesktop: XFCE
>   DistroRelease: Ubuntu 16.04
>   InstallationDate: Installed on 2016-04-14 (63 days ago)
>   InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64
> (20160412)
>   NtpStatus: ntpq: read: Connection refused
>   Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
>   PackageArchitecture: amd64
>   ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-25-generic
> root=UUID=3aea4570-4011-4247-9636-68317385324d ro
>   ProcVersionSignature: Ubuntu 4.4.0-25.44-generic 4.4.13
>   Tags: xenial third-party-packages
>   Uname: Linux 4.4.0-25-generic x86_64
>   UpgradeStatus: No upgrade log present (probably fresh install)
>   UserGroups: adm cdrom dialout dip lpadmin mail netdev plugdev sambashare
> sudo
>   _MarkForUpload: True
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/ntp/+bug/1567540/+subscriptions
>

Revision history for this message

Launchpad Janitor (janitor) wrote on 2016-07-05:

#82

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in ntp (Ubuntu Xenial):
status:	New → Confirmed

Christian Ehrhardt  (paelzer) on 2016-07-05

Changed in ntp (Ubuntu Xenial):
importance:	Undecided → High
Changed in ntp (Ubuntu):
assignee:	nobody → ChristianEhrhardt (paelzer)

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-07-05:

#83

FYI - Merge that will fix this in the development release created and entered review processing.
Once that is completed we have to think about SRU into Xenial (needs a rather complex backport from upstream)

Revision history for this message

Bob Jones (r-a-n-d-o-m-d-e-v-4+ubuntu) wrote on 2016-07-13:

#84

Have you finished "thinking about" fixing the broken NTP in Xenial yet ? Its becoming a bit of a joke to be without such a key package (let alone the hacks that have had to be put in place to keep server time accurate !).

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-07-13:

#85

Download full text (6.6 KiB)

Hi,
the fix has to go to the development release first (Yakkety).
The merge is waiting for a review quite a while already.

Thanks you for the push on this, I'll take this as an opportunity to raise
the priority of the merge.

Christian Ehrhardt
Software Engineer, Ubuntu Server
Canonical Ltd

On Wed, Jul 13, 2016 at 6:30 PM, Bob Jones <
<email address hidden>> wrote:

> Have you finished "thinking about" fixing the broken NTP in Xenial yet ?
> Its becoming a bit of a joke to be without such a key package (let alone
> the hacks that have had to be put in place to keep server time accurate
> !).
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1567540
>
> Title:
> ntpd crashed with SIGABRT (was: ntp crashes everytime the network goes
> up or down.)
>
> Status in NTP:
> Fix Released
> Status in ntp package in Ubuntu:
> Triaged
> Status in ntp source package in Xenial:
> Confirmed
>
> Bug description:
> ntp crashes every time the network goes up or down while the system is
> running and also crashes after booting up without network.
> ---
> ApportVersion: 2.20.1-0ubuntu1
> Architecture: amd64
> CurrentDesktop: XFCE
> DistroRelease: Ubuntu 16.04
> InstallationDate: Installed on 2016-03-12 (26 days ago)
> InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Alpha amd64
> (20160224)
> NtpStatus: ntpq: read: Connection refused
> Package: ntp 1:4.2.8p4+dfsg-3ubuntu4
> PackageArchitecture: amd64
> ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-17-generic
> root=UUID=306314bc-efcb-4c2d-b0e9-e05ec92ed0f0 ro
> ProcVersionSignature: Ubuntu 4.4.0-17.33-generic 4.4.6
> Tags: xenial
> Uname: Linux 4.4.0-17-generic x86_64
> UpgradeStatus: No upgrade log present (probably fresh install)
> UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
> _MarkForUpload: True
> ---
> ApportVersion: 2.20.1-0ubuntu1
> Architecture: amd64
> CurrentDesktop: XFCE
> DistroRelease: Ubuntu 16.04
> InstallationDate: Installed on 2016-03-12 (31 days ago)
> InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Alpha amd64
> (20160224)
> NtpStatus: ntpq: read: Connection refused
> Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
> PackageArchitecture: amd64
> ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-18-generic
> root=UUID=306314bc-efcb-4c2d-b0e9-e05ec92ed0f0 ro
> ProcVersionSignature: Ubuntu 4.4.0-18.34-generic 4.4.6
> Tags: xenial
> Uname: Linux 4.4.0-18-generic x86_64
> UpgradeStatus: No upgrade log present (probably fresh install)
> UserGroups: adm cdrom dip lpadmin plugdev sambashare sudo
> _MarkForUpload: True
> ---
> ApportVersion: 2.20.1-0ubuntu1
> Architecture: amd64
> CurrentDesktop: XFCE
> DistroRelease: Ubuntu 16.04
> InstallationDate: Installed on 2016-04-13 (0 days ago)
> InstallationMedia: Xubuntu 16.04 LTS "Xenial Xerus" - Beta amd64
> (20160412)
> NtpStatus: ntpq: read: Connection refused
> Package: ntp 1:4.2.8p4+dfsg-3ubuntu5
> PackageArchitecture: amd64
> ProcCmdline: BOOT_IMAGE=/boot/vmlinuz-4.4.0-18-generic
> root=UUID=13f57794-2e19-4a56-836a-94185bba5ec5 ro quiet splash
> ProcV...

This bug was fixed in the package ntp - 1:4.2.8p8+dfsg-1ubuntu1

---------------
ntp (1:4.2.8p8+dfsg-1ubuntu1) yakkety; urgency=medium

[ Christian Ehrhardt ]
  * Merge from Debian testing. Remaining changes:
    + debian/rules: enable debugging. Asked debian to add this in bug #643954.
    + debian/rules, debian/ntp.dirs, debian/source_ntp.py: Add apport hook.
    + debian/control: Add Suggests on apparmor.
    + debian/source_ntp.py: Add filter on AppArmor profile names to prevent
      false positives from denials originating in other packages
    + debian/ntpdate.if-up: Fix interaction with openntpd. Stop ntp before
      running ntpdate when an interface comes up, then start again afterwards.
    + debian/ntp.init, debian/rules: Only stop when entering single user mode,
      don't use /var/lib/ntp/ntp.conf.dhcp if /etc/ntp.conf is newer - it can
      get stale. Patch by Simon Déziel.
    + debian/ntp.conf, debian/ntpdate.default: Change default server to
      ntp.ubuntu.com.
    + debian/control: Add bison to Build-Depends (for ntpd/ntp_parser.y).
    + Extend PPS support
      - debian/README.Debian: Add a PPS section to the README.Debian
      - debian/ntp.conf: Add some configuration examples from the offical
        documentation.
    + SECURITY UPDATE: NTP statsdir cleanup cronjob insecure (LP: #1528050)
      - debian/ntp.cron.daily: fix security issues, patch thanks to halfdog!
      - CVE-2016-0727
    + Merge also contains an upstream fix that solves (LP: #1567540)
  * Added changes
    + match Ubuntu packages now that Debian has ntp apparmor accepted in
      d/control for Apparmor conflicts/replaces
    + d/apparmor-profile add samba winbindd pipe (LP: #1582767)
  * Drop Changes:
    + Add enforcing AppArmor profile (accepted in Debian):
      - debian/control: Add Conflicts/Replaces on apparmor-profiles.
      - debian/control: Add Suggests on apparmor.
      - debian/control: Build-Depends on dh-apparmor.
      - add debian/apparmor-profile*.
      - debian/ntp.dirs: Add apparmor directories.
      - debian/rules: Install apparmor-profile and apparmor-profile.tunable.
      - debian/source_ntp.py: Add filter on AppArmor profile names to prevent
        false positives from denials originating in other packages.
      - debian/README.Debian: Add note on AppArmor.
    + Add PPS support (accepted in Debian)
      - debian/control: Add Build-Depends on pps-tools
    + debian/apparmor-profile: allow 'rw' access to /dev/pps[0-9]* devices.
    + d/p/fix_local_sync.patch: fix local clock sync (fixed upstream)
    + debian/patches/ntpdate-fix-lp1526264.patch (fixed upstream):
      - Add Alfonso Sanchez-Beato's patch for fixing the cannot correct dates in
        the future bug
    + debian/apparmor-profile: adjust to handle AF_UNSPEC with dgram and stream
    + dropping previous ubuntu security patches/fixes that have been upstreamed
      in 4.2.8p6: CVE-2015-7973, CVE-2015-7975, CVE-2015-7976, CVE-2015-7977,
      CVE-2015-7978, CVE-2015-7979, CVE-2015-8138, CVE-2015-8158
    + dropping previous ubuntu security patches/fixes that have been upstreamed
      in 4.2.8p7: CVE-2016-1548, CVE-2016-1550, CVE-2016-2516, CVE-2016-2518,
      CVE-2015-7974, CVE-2016-1547

[ Robie Basak ]
  * Restore AppArmor entries in debian/ntp.dirs.

ntp (1:4.2.8p8+dfsg-1) unstable; urgency=high

* New usptream version
    - Fixes security issues

ntp (1:4.2.8p7+dfsg-4) unstable; urgency=high

* Update apparmor-profiles-extra again now we now in which version they
    removed it.
  * Call dh_apparmor.  Add build-depends on dh-apparmor.  (Closes: #824767)

ntp (1:4.2.8p7+dfsg-3) unstable; urgency=medium

[ Hideki Yamane ]
  * Properly enable Apparmor profile from Ubuntu (Closes: #823024)
    Patch from Hideki Yamane <henrich@debian.or.jp>
  * Update replace/breaks versions of apparmor-profiles-extra
    (Closes: #805183)

ntp (1:4.2.8p7+dfsg-2) unstable; urgency=medium

* Only build-depend on pps-tools on Linux

ntp (1:4.2.8p7+dfsg-1) unstable; urgency=medium

* New upstream version
    This might fix a few CVEs.
  * Drop CVE-2015-5300.patch and CVE-2015-7704.patch now claimed to
    be fixed upstream.
  * Remove Bdale from uploaders (Closes: #804377)
  * Remove section about patching the kernel for PPS support, it's already
    included in the kernel (Closes: #811171)
  * Pass --build and --host to configure. (Closes: #315935)
    Patch from Helmut Grohne <helmut@subdivi.de>
  * Missing Build-Depends libopts25-dev (which is not implicit in autogen,
    because autogen is M-A:foreign).
    Patch from Helmut Grohne <helmut@subdivi.de>
  * Fix ntp.dhcp to also check for pool and better handle spaces and tabs.
    (Closes: #809344, #806676)
  * Change watch file to use https (Closes: #793926)
  * Hook into NetworkManager to update ntp servers from dhcp. (Closes:
    #778415).  Patch from Helmut Grohne <helmut@subdivi.de>
  * Build Depend on pps-tools (Closes: #691672)
  * Don't run ntpdate when method is none.  Patch from
    Dmitry Borisyuk <q1werty@i.com.ua>
  * Also use flock to in the ntp init script, and update the lock file
    location.  (Closes: #806556)
  * Move apparmor profile from apparmor-profiles-extra. Add Breaks/Replaces.
    (Closes: #805183)

-- Christian Ehrhardt <christian.ehrhardt@canonical.com>  Fri, 29 Jul 2016 12:42:43 +0200

Changed in ntp (Ubuntu):
status:	Triaged → Fix Released

Christian Ehrhardt  (paelzer) on 2016-08-01

Changed in ntp (Ubuntu):
assignee:	ChristianEhrhardt (paelzer) → nobody
Changed in ntp (Ubuntu Xenial):
assignee:	nobody → ChristianEhrhardt (paelzer)

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-01:

#87

Looking through the crashes this seems usually one of the two:
http://bugs.ntp.org/show_bug.cgi?id=2831 (as mentioned before)
http://bugs.ntp.org/show_bug.cgi?id=2954 (related)

There was a bit back and forth on what of the two is a dop to the other.
Eventually 2954 has a fix I should be able to backport rather easily.
Eventually 2954 has the fix, but 2831 later on got reopened and became an extension of the old fix.

This is a rather invasive patch, but fortunately at least 2954 came right after p4 got released so it matches still. Not so sure about 2831.

A few, but really only a few crashes I looked at could have been http://bugs.ntp.org/show_bug.cgi?id=2969
Backporting that is rather easy so I'm going to include it (low risk of changing anything else).

Not getting recent patches is hard atm due to https://github.com/ntp-project/ntp/issues/15.
Looking for alternatives right now.

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-01:

#88

Found an alternative, thanks to Unit193 in #ubuntu-devel!

Backported four fixes overall to address the crashes I've seen in the reports.
Currently building and testing.

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-01:

#89

Backports and Testing done, coordinated with mdeslaur to not conflict with Security updates staged in https://launchpad.net/~ubuntu-security-proposed/+archive/ubuntu/ppa/+packages.

Plan is to push the SRU asap (which also i favorable looking at all the crash reports) and the Security Team will continue on top of that (there were some extra CVEs that need to be included anyway).

Adding patch and SRU template now...

tags:

removed: third-party-packages

Christian Ehrhardt  (paelzer) on 2016-08-01

description:	updated
Changed in ntp (Ubuntu Xenial):
status:	Confirmed → Fix Committed

Christian Ehrhardt  (paelzer) on 2016-08-01

description:

updated

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-01:

#92

Refined for SRU upload:
- clarified SRU template in this bug
- reduced number of patches by one to follow the "minimal change possible" guidance for SRU as hard
as possible
- fixed the reference in d/p/* files to the related upstream commits

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-01:

#93

SRU upload to xenial - v2 Edit (39.0 KiB, text/plain)

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-01:

#94

Build and Tested again, ready for sponsoring review

Revision history for this message

Robie Basak (racb) wrote on 2016-08-01:

#95

Looks good, thanks! I dropped debian/patches/ntp-4.2.8p4-segfaults-3-4.patch, added an apostrophe to the changelog and uploaded.

Changed in ntp (Ubuntu Xenial):
status:	Fix Committed → In Progress

Revision history for this message

Martin Pitt (pitti) wrote on 2016-08-02: Please test proposed package

#96

Hello Pavlushka, or anyone else affected,

Accepted ntp into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/ntp/1:4.2.8p4+dfsg-3ubuntu5.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in ntp (Ubuntu Xenial):
status:	In Progress → Fix Committed
tags:	added: verification-needed

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-02:

#97

Thanks Martin for verifying and passing this SRU on to proposed!

To Pavlushka, Bob Jones, Sudhir Reddy - due to the raciness of this bug it is hard for anyone else to "really" verify. While I'm quite confident given the upstream discussions and by studying fix and crashes I'd really like your help testing the fix as in proposed if it fixes your issue as intended.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you very much in advance!

P.S. I beg a pardon, but to let this message and status change reach you I took the initiative and also subscribed some of you to the bug.

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-24:

#98

Hi,
since there was no update I'd once more ask one of the people out there which have systems affected by this to verify the new ntp package available in proposed.

Revision history for this message

Alexis Huxley (alexishuxley) wrote on 2016-08-24:

#99

I am using ntp 1:4.2.8p4+dfsg-3ubuntu5 (i.e. the currently available package) and it crashes consistently and silently at, or shortly after, system boot up. If I restart it using systemctl then it crashes. If I start it manually from the command line just running 'ntpd' then it seems to keep running for longer, but even then it eventually silently crashes.

This is on a KVM-based VM running as a mail server with stock Postfix and Dovecot. I mention these packages because all other VMs (and PMs) have no issues, despite identical underlying installations.

I've installed 1:4.2.8p4+dfsg-3ubuntu5.1 and this seems to have fixed the problem.

Revision history for this message

Christian Ehrhardt  (paelzer) wrote on 2016-08-24:

#100

Thank you so much Alexis!

Due to the raciness even the slightest setup change can open/close the race-window - so it is "expected" that "... because all other VMs (and PMs) have no issues, despite identical underlying installations." can happen.

tags:

added: verification-done
removed: verification-needed

Revision history for this message

Launchpad Janitor (janitor) wrote on 2016-08-24:

#101

This bug was fixed in the package ntp - 1:4.2.8p4+dfsg-3ubuntu5.1

---------------
ntp (1:4.2.8p4+dfsg-3ubuntu5.1) xenial; urgency=medium

  * d/p/ntp-4.2.8p4-segfaults-[1-3]-3.patch fix startup crashes by
    including Juergen Perlinger's work on upstream bugs 2954 and 2831 to
    fix those (LP: #1567540).

-- Christian Ehrhardt <email address hidden> Mon, 01 Aug 2016 10:50:52 +0200

Changed in ntp (Ubuntu Xenial):
status:	Fix Committed → Fix Released

Revision history for this message

Chris J Arges (arges) wrote on 2016-08-24: Update Released

#102

The verification of the Stable Release Update for ntp has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Ubuntu
ntp package

ntpd crashed with SIGABRT (was: ntp crashes everytime the network goes up or down.)

Bug Description

CVE References

Duplicates of this bug

Other bug subscribers

Patches

Bug attachments

Remote bug watches

	Status	Importance	Assigned to
NTP	Fix Released	High	auto-bugs.ntp.org #2831
ntp (Ubuntu)	Fix Released	High	Unassigned
Xenial	Fix Released	High	Christian Ehrhardt 

Ubuntuntp package

ntpd crashed with SIGABRT (was: ntp crashes everytime the network goes up or down.)

Bug Description

CVE References

Duplicates of this bug

Other bug subscribers

Patches

Bug attachments

Remote bug watches

Ubuntu
ntp package