kdump service fails to start on Power8

Bug #1461078 reported by bugproxy
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kexec-tools (Ubuntu)
Fix Released
High
Unassigned
Trusty
Fix Released
High
Louis Bouchard

Bug Description

[SRU justification]
Needed to avoid load failure on Power8

[Impact]
Without this fix, kexec will not load on Power8

[Fix]
Apply upstream fix present in Dev release

[Test Case]
1) sudo apt-get install linux-crashdump
2) reboot server
3) kdump-config load

As outlined in the initial description, kdump will fail to load without the fix.

[Regression]
None expected, fix is already present in the development version (Wily)

[Original description of the problem]
== Comment: #0 - SACHIN P. SANT <email address hidden> - 2015-06-01 06:39:56 ==
---Problem Description---
kdump service fails to start

Contact Information = Sachin Sant / <email address hidden>

---uname output---
3.19.0-18-generic

Machine Type = POWER8

---Debugger---
A debugger is not configured

---Steps to Reproduce---
 1) Using latest daily ISO install 14.04.02 as a Power VM guest
2) Upgrade the kernel to 3.19 level (3.19.0-18-generic)
3) Configure kdump

kdump-config load command fails with following error:

root@alp9:~# cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinux-3.19.0-18-generic root=UUID=3ea23bcf-7269-432f-bacc-f82c6cdd774e ro splash crashkernel=2G-4G:320M,4G-32G:512M,32G-64G:1024M,64G-128G:2048M,128G-:4096M vt.handoff=7
root@alp9:~# kdump-config show
USE_KDUMP: 1
KDUMP_SYSCTL: kernel.panic_on_oops=1
KDUMP_COREDIR: /var/crash
crashkernel addr:
current state: Not ready to kdump

kexec command:
  no kexec command recorded
root@alp9:~# kdump-config load
unrecoverable error: short read from"/proc/device-tree//ibm,drc-names"
 * failed to load kdump kernel
root@alp9:~#

Userspace tool common name: kexec-tools

The userspace tool has the following bit modes: 64-bit

Userspace rpm: kdump-tools(1.5.5-2ubuntu1.2)

Userspace tool obtained from project website: na

*Additional Instructions for Sachin Sant / <email address hidden>:
-Post a private note with access information to the machine that the bug is occuring on.
-Attach ltrace and strace of userspace application.

== Comment: #2 - MAMATHA INAMDAR <email address hidden> - 2015-06-02 02:23:51 ==
root@alp9:~# /etc/init.d/kdump-tools start
Starting kdump-tools: unrecoverable error: short read from"/proc/device-tree//ibm,drc-names"
 * failed to load kdump kernel

root@alp9:~# dpkg -l | grep kexec
ii kexec-tools 1:2.0.6-0ubuntu2.1 ppc64el tools to support fast kexec reboots

root@alp9:~# dpkg -l | grep kdump
ii kdump-tools 1.5.5-2ubuntu1.2 all scripts and tools for automating kdump (Linux crash dumps)

root@alp9:~# cat /sys/kernel/kexec_crash_loaded
0
root@alp9:~# kdump-config status
current state : Not ready to kdump

root@alp9:~# dmesg | grep -i crash
[ 0.000000] Reserving 2048MB of memory at 128MB for crashkernel (System RAM: 102400MB)
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinux-3.19.0-18-generic root=UUID=3ea23bcf-7269-432f-bacc-f82c6cdd774e ro splash crashkernel=2G-4G:320M,4G-32G:512M,32G-64G:1024M,64G-128G:2048M,128G-:4096M vt.handoff=7
root@alp9:~#

== Comment: #3 - Hari Krishna Bathini <email address hidden> - 2015-06-02 07:29:23 ==
The following upstream commit fixes this issue:

---
commit d1932cd592e2a6aaf50ed22cfa2d7562b583854a
Author: Anton Blanchard <email address hidden>
Date: Tue Dec 2 10:59:40 2014 +1100

    kexec/fs2dt: Use slurp_file_len to avoid partial read of files

    The OPAL firmware is going to embed its symbol map in the device tree.
    The size is large enough to be more than a page, and it takes
    multiple reads to get the whole file. This is because sysfs uses
    the seq_file helpers which do a page at a time.

    Unfortunately fs2dt has no handling for short reads and we die with:

    unrecoverable error: short read from"/proc/device-tree//ibm,opal/firmware/symbol-map"

    This patch uses the slurp_file_len helper which does the right thing.
    It moves the explicit open of the file further down for
    add_usable_mem_property and add_dyn_reconf_usable_mem_property.
    We should convert both of these to use the buffer provided by
    slurp_file_len at some stage.

    Signed-off-by: Anton Blanchard <email address hidden>
    Signed-off-by: Simon Horman <email address hidden>
---

This patch applies cleanly on the kexec-tools version 1:2.0.6-0ubuntu2.1 on Ubuntu 14.04.2.

Thanks
Hari

bugproxy (bugproxy)
tags: added: architecture-ppc64le bugnameltc-125712 severity-critical targetmilestone-inin---
Revision history for this message
Ubuntu Foundations Team Bug Bot (crichton) wrote :

Thank you for taking the time to report this bug and helping to make Ubuntu better. It seems that your bug report is not filed about a specific source package though, rather it is just filed against Ubuntu in general. It is important that bug reports be filed about source packages so that people interested in the package can find the bugs about it. You can find some hints about determining what package your bug might be about at https://wiki.ubuntu.com/Bugs/FindRightPackage. You might also ask for help in the #ubuntu-bugs irc channel on Freenode.

To change the source package that this bug is filed about visit https://bugs.launchpad.net/ubuntu/+bug/1461078/+editstatus and add the package name in the text box next to the word Package.

[This is an automated message. I apologize if it reached you inappropriately; please just reply to this message indicating so.]

tags: added: bot-comment
affects: ubuntu → makedumpfile (Ubuntu)
Revision history for this message
Louis Bouchard (louis) wrote :

The cited patch that fixes the issue is a kernel patch on kexec. This does not apply to makedumpfile.

affects: makedumpfile (Ubuntu) → linux (Ubuntu)
Revision history for this message
Louis Bouchard (louis) wrote :

not a kernel patch after all but a kexec-tools one

affects: linux (Ubuntu) → kexec-tools (Ubuntu)
Louis Bouchard (louis)
summary: - kdump service fails to start
+ kdump service fails to start on Power8
Revision history for this message
Louis Bouchard (louis) wrote :
description: updated
Changed in kexec-tools (Ubuntu):
status: New → Fix Released
Changed in kexec-tools (Ubuntu Trusty):
status: New → In Progress
Changed in kexec-tools (Ubuntu):
importance: Undecided → High
Changed in kexec-tools (Ubuntu Trusty):
importance: Undecided → High
assignee: nobody → Louis Bouchard (louis-bouchard)
Revision history for this message
Chris J Arges (arges) wrote : Please test proposed package

Hello bugproxy, or anyone else affected,

Accepted kexec-tools into trusty-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/kexec-tools/1:2.0.6-0ubuntu2.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in kexec-tools (Ubuntu Trusty):
status: In Progress → Fix Committed
tags: added: verification-needed
Revision history for this message
bugproxy (bugproxy) wrote : Comment bridged from LTC Bugzilla

------- Comment From <email address hidden> 2015-07-16 05:33 EDT-------
Tested with latest kexec-tools. Works correctly.

root@alp9:~# dpkg --list | grep kexec-tools
ii kexec-tools 1:2.0.6-0ubuntu2.2 ppc64el tools to support fast kexec reboots
root@alp9:~# service kdump-tools start
Modified cmdline:BOOT_IMAGE=/boot/vmlinux-3.19.0-18-generic root=UUID=3ea23bcf-7269-432f-bacc-f82c6cdd774e ro splash quiet vt.handoff=7 irqpoll maxcpus=1 nousb elfcorehdr=155200K
segment[0].mem:0x8000000 memsz:24641536
segment[1].mem:0x9780000 memsz:65536
segment[2].mem:0x9790000 memsz:65536
segment[3].mem:0x97a0000 memsz:65536
segment[4].mem:0x97b0000 memsz:20971520
segment[5].mem:0xec80000 memsz:196608
* loaded kdump kernel
kdump-tools stop/waiting
root@alp9:~# kdump-config load
Modified cmdline:BOOT_IMAGE=/boot/vmlinux-3.19.0-18-generic root=UUID=3ea23bcf-7269-432f-bacc-f82c6cdd774e ro splash quiet vt.handoff=7 irqpoll maxcpus=1 nousb elfcorehdr=155200K
segment[0].mem:0x8000000 memsz:24641536
segment[1].mem:0x9780000 memsz:65536
segment[2].mem:0x9790000 memsz:65536
segment[3].mem:0x97a0000 memsz:65536
segment[4].mem:0x97b0000 memsz:20971520
segment[5].mem:0xec80000 memsz:196608
* loaded kdump kernel
root@alp9:~#

bugproxy (bugproxy)
tags: added: targetmilestone-inin14043 verification-done
removed: targetmilestone-inin--- verification-needed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package kexec-tools - 1:2.0.6-0ubuntu2.2

---------------
kexec-tools (1:2.0.6-0ubuntu2.2) trusty; urgency=medium

  * Fixes kexec load failure on Power8 (LP: #1461078)

 -- Louis Bouchard <email address hidden> Fri, 10 Jul 2015 11:42:41 -0500

Changed in kexec-tools (Ubuntu Trusty):
status: Fix Committed → Fix Released
Revision history for this message
Adam Conrad (adconrad) wrote : Update Released

The verification of the Stable Release Update for kexec-tools has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.