Ubuntu 15.10 daily ISO installation fails to reboot with Program Exception

------- Comment From <email address hidden> 2015-05-28 15:24 EDT-------
This exception isn't the same as the VSX one. The SRR0 is 0 so I believe that it's something else.

I'm not aware of any patch that needs to be forward-ported to 15.10. All necessary patches are in place.

------- Comment From <email address hidden> 2015-05-28 15:31 EDT-------
Did some tests and the daily and the problem started on May 23.

Thank you for taking the time to report this bug and helping to make Ubuntu better. It seems that your bug report is not filed about a specific source package though, rather it is just filed against Ubuntu in general. It is important that bug reports be filed about source packages so that people interested in the package can find the bugs about it. You can find some hints about determining what package your bug might be about at https://wiki.ubuntu.com/Bugs/FindRightPackage. You might also ask for help in the #ubuntu-bugs irc channel on Freenode.

To change the source package that this bug is filed about visit https://bugs.launchpad.net/ubuntu/+bug/1459706/+editstatus and add the package name in the text box next to the word Package.

[This is an automated message. I apologize if it reached you inappropriately; please just reply to this message indicating so.]

------- Comment From <email address hidden> 2015-05-29 15:59 EDT-------
*** Bug 125469 has been marked as a duplicate of this bug. ***

There is an updated build of grub in the wily daily images, compared with the 15.04 release. The source changes to grub should not be an issue, but there have been toolchain updates between the two builds of grub, which may come into play.

From the ppc64el build log of grub2 2.02~beta2-22ubuntu1:
Toolchain package versions: libc6-dev_2.21-0ubuntu4 make_4.0-8.1 dpkg-dev_1.17.24ubuntu1 gcc-4.9_4.9.2-10ubuntu12 g++-4.9_4.9.2-10ubuntu12 binutils_2.25-5ubuntu6 libstdc++-4.9-dev_4.9.2-10ubuntu12 libstdc++6_4.9.2-10ubuntu12

From the ppc64el build log of grub2 2.02~beta2-23:
Toolchain package versions: libc6-dev_2.21-0ubuntu4 make_4.0-8.1 dpkg-dev_1.17.25ubuntu1 gcc-4.9_4.9.2-17ubuntu1 g++-4.9_4.9.2-17ubuntu1 binutils_2.25-5ubuntu7 libstdc++-4.9-dev_4.9.2-17ubuntu1 libstdc++6_5.1.1-5ubuntu4

------- Comment (attachment only) From <email address hidden> 2015-06-08 16:34 EDT-------

------- Comment From <email address hidden> 2015-06-09 18:04 EDT-------
I downgrade gcc and the exception didn't happened.

Looking the changelog between version 4.9_4.9.2-10ubuntu12 and 4.9_4.9.2-17ubuntu1 I found a ppc related comment:

* Configure with --enable-targets=powerpcle-linux on ppc64el for backports to jessie, trusty, utopic and vivid.

[1] http://changelogs.ubuntu.com/changelogs/pool/main/g/gcc-4.9/gcc-4.9_4.9.2-20ubuntu1/changelog

------- Comment From <email address hidden> 2015-06-11 11:47 EDT-------
The exception occurs in the normal.mod, not in the kernel part of GRUB. I compared the old and new gcc normal.mod versions and found this small change:

14978c14978
< 8a08: 7f e1 07 19 stxvw4x vs63,r1,r0
---
> 8a08: 7f e1 01 ce stvx v31,r1,r0
15512c15512
< 8fc0: 7f e1 06 19 lxvw4x vs63,r1,r0
---
> 8fc0: 7f e1 00 ce lvx v31,r1,r0

Both stxvw4x and lxvw4x are VSX instructions. We already have a patch to avoid crashes with those instructions but for some reason it's not enough. I'm going to add a flag in CFLAGS in order to disable VSX at all.

------- Comment on attachment From <email address hidden> 2015-06-11 12:21 EDT-------

Can you add this patch into grub package? I'm planning to push it upstream soon.

This bug was fixed in the package grub2 - 2.02~beta2-25

---------------
grub2 (2.02~beta2-25) unstable; urgency=medium

  * Build-depend on dosfstools and mtools on arm64 as well as amd64.

 -- Colin Watson <email address hidden> Fri, 12 Jun 2015 12:29:19 +0100

------- Comment (attachment only) From <email address hidden> 2015-06-15 06:42 EDT-------

------- Comment From <email address hidden> 2015-06-15 12:49 EDT-------
I updated my machine with grub2 package 2.02~beta2-25 here and it works fine. I build the same version and it works fine too. I'm not sure if this is really a problem in grub2 binary.

Besides this exception, we have an installation failure since Jun 11:

Jun 15 10:06:09 in-target: The following information may help to resolve the situation:
Jun 15 10:06:09 in-target:
Jun 15 10:06:09 in-target: The following packages have unmet dependencies:
Jun 15 10:06:09 in-target: libpam-systemd : Depends: systemd (= 219-10ubuntu1) but 220-6ubuntu1 is to be installed
Jun 15 10:06:09 in-target: E
Jun 15 10:06:09 in-target: : Unable to correct problems, you have held broken packages.
Jun 15 10:06:09 in-target: tasksel: aptitude failed (100)
Jun 15 10:06:09 main-menu[232]: WARNING **: Configuring 'pkgsel' failed with error code 1
Jun 15 10:06:09 main-menu[232]: WARNING **: Menu item 'pkgsel' failed.

------- Comment From <email address hidden> 2015-06-15 12:52 EDT-------
Just FYI that I pushed the fix upstream today:
http://git.savannah.gnu.org/cgit/grub.git/commit/?id=afd0f21b2027310fda52b00ac1b964041d39a363

Well, that particular failure is unrelated to grub -- it's caused by systemd updates which fail the installation while all packages aren't up to date on the mirrors being used.

I've noticed the fix is on the upstream git as well as in Debian; we'll get it in Ubuntu shortly.

------- Comment From <email address hidden> 2015-06-18 13:28 EDT-------
Canonical, can you please check if the GRUB used by the daily image is updated? I opened the ISO file from today and the GRUB elf is from May 31:

total 274K
-r--r--r-- 1 root root 294 May 31 16:02 grub.cfg
-r--r--r-- 1 root root 272K May 31 16:02 powerpc.elf
dr-xr-xr-x 2 root root 2.0K May 31 16:02 powerpc-ieee1275

Moreover, the installation is failing, as I said in the previous comment, on the libpam-systemd package.

------- Comment From <email address hidden> 2015-06-22 12:28 EDT-------
Good news!

Both problems were fixed and we have a working wily again. Please test it.

------- Comment From <email address hidden> 2015-06-22 12:37 EDT-------
Working for PowerVM as well....

PowerPC Firmware
Version SV810_101
SMS 1.7 (c) Copyright IBM Corp. 2000,2008 All rights reserved.
-------------------------------------------------------------------------------
Current Boot Sequence
1. SCSI CD-ROM
( loc=U8247.21L.21239AA-V3-C2-T1-L8200000000000000 )
2. None
3. None
4. None

GNU GRUB version 2.02~beta2-26

+----------------------------------------------------------------------------+
|*Install |
| Rescue mode |

------- Comment From <email address hidden> 2015-06-22 20:45 EDT-------
I was able to successfully install and reboot 15.10 from both virtual CD-ROM (daily ISO downloaded today) and from the netboot image downloaded today on two different PowerKVM 3.1 guests.

This bug looks fixed to me.