[SRU] nova-compute-kvm does not pull ipxe-qemu on non-amd64 archs

Hi Junien,

Thanks for the detailed bug report. I'm wondering if ipxe-qemu installed is not getting installed because you're not installing recommended packages. ie. 'apt install --no-install-recommends'. They should get installed by default. Note that qemu-system-arm specifies ipxe-qemu as a 'Recommends' package whereas qemu-system-x86 specifies ipxe-qemu as a 'Depends' package.

For qemu 1:2.10+dfsg-0ubuntu3.5~cloud0 from xenial-pike, the debian/control file has:

Package: qemu-system
Architecture: amd64 arm arm64 armel armhf hppa i386 ia64 kfreebsd-amd64 kfreebsd-i386 mips mipsel powerpc powerpcspe ppc64 ppc64el s390x sparc sparc64
Multi-Arch: foreign
Depends: ${misc:Depends},
 qemu-system-arm,
 qemu-system-mips,
 qemu-system-ppc,
 qemu-system-sparc,
 qemu-system-x86,
 qemu-system-s390x,
 qemu-system-misc

Package: qemu-kvm
Architecture: i386 amd64 x32 armhf armel arm64 powerpc ppc64 ppc64el s390x
Multi-Arch: foreign
Pre-Depends: ${misc:Pre-Depends}
Depends:
 ${misc:Depends},
 qemu-system-x86 (= ${binary:Version}) [i386 amd64 x32],
 qemu-system-arm (= ${binary:Version}) [armhf armel arm64],
 qemu-system-ppc (= ${binary:Version}) [powerpc ppc64 ppc64el],
 qemu-system-s390x (= ${binary:Version}) [s390x],
 powerpc-utils [ppc64el],

Package: qemu-system-arm
Architecture: amd64 arm arm64 armel armhf hppa i386 ia64 kfreebsd-amd64 kfreebsd-i386 mips mipsel powerpc powerpcspe ppc64 ppc64el s390x sparc sparc64
Multi-Arch: foreign
Depends: ${shlibs:Depends}, ${misc:Depends}, qemu-system-common (>> 2.0.0+dfsg-7~)
Recommends: qemu-utils,
# aarch64 arm uses bootroms
 ipxe-qemu (>= 1.0.0+git-20131111.c3d1e78-1~),

Please let me know what you find. For now I'm going to mark this
Thanks,
Corey

... mark this incomplete until we have further details.

Hi,

Indeed we're not installing "recommended" packages.

Note that ipxe-qemu is also needed on ppc64el

Hi Junien,

I hope you're up and running now. Can we close this bug?

Thanks,
Corey

I don't think that we can't close this bug because it's not resolved. I shouldn't have to manually install packages to get a working cloud, even if I have APT::Install-Recommends set to False.

Either this is a package bug, or a charm bug, but my opinion is that it is a bug and it needs to be resolved before getting closed.

Hi,
first I agree to Coreys first checks.

In terms of packages, arm (as well as ppc) clearly are recommend dependencies.
They have several use cases that work without ipxe-qemu - just not the one that nova-compute-kvm is driving.

If we would follow the depend/recommend definition hard also x86 would become a recommend.
But for historical compatibility x86 stays a depend.
OTOH on arm/ppc there are more (likely) cases were one doesn't need ipxe-qemu.

That said making it a depends from ther qemu- packages is wrong.
The solution is:
1. install with recommends or fix up what you lack (general recommends case)
OR
2. nova-compute-kvm might depend on it since the use case "from nova-compute-kvm" seems to need it always
OR
3. pull it in from the charm or whatever is driving your install.

This bug was fixed in the package nova - 2:17.0.1-0ubuntu1

---------------
nova (2:17.0.1-0ubuntu1) bionic; urgency=medium

  * New upstream point release for OpenStack Queens.

 -- Corey Bryant <email address hidden> Mon, 12 Mar 2018 12:43:39 -0400

I've uploaded a new version of nova to the Artful review queue where it is awaiting SRU team review [1]. Once it is accepted into artful-proposed we can backport this to pike-proposed for testing.

[1] https://launchpad.net/ubuntu/artful/+queue?queue_state=1&queue_text=

Hello Junien, or anyone else affected,

Accepted nova into artful-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/nova/2:16.1.0-0ubuntu1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-artful to verification-done-artful. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-artful. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

I don't have an artful around to test, FWIW.

Hello Junien, or anyone else affected,

Accepted nova into pike-proposed. The package will build now and be available in the Ubuntu Cloud Archive in a few hours, and then in the -proposed repository.

Please help us by testing this new package. To enable the -proposed repository:

  sudo add-apt-repository cloud-archive:pike-proposed
  sudo apt-get update

Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-pike-needed to verification-pike-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-pike-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Status changed to 'Confirmed' because the bug affects multiple users.

Testing done :
1. create new xenial LXD
2. sudo add-apt-repository cloud-archive:pike-proposed ; sudo apt-get update
3. echo 'APT::Install-Recommends "false";' | sudo tee /etc/apt/apt.conf.d/99no-recommends
4. sudo apt-get install nova-compute-kvm
5. verify ipxe-qemu is installed

Testing successful !

Testing completed successfully for artful-proposed:
1. create new artful LXD container
2. sudo add-apt-repository cloud-archive:pike-proposed ; sudo apt update
3. echo 'APT::Install-Recommends "false";' | sudo tee /etc/apt/apt.conf.d/99no-recommends
4. sudo apt-get install nova-compute-kvm
5. version is 2:16.1.0-0ubuntu1
6. verify ipxe-qemu is installed

This bug was fixed in the package nova - 2:16.1.0-0ubuntu1

---------------
nova (2:16.1.0-0ubuntu1) artful; urgency=medium

  [ James Page ]
  * Add Depends nova-compute-kvm -> ipxe-qemu to ensure that required
    ROM's are installed for all architectures (LP: #1754015).

  [ Corey Bryant ]
  * New stable point release for OpenStack Pike (LP: #1758046).
  * d/p/aarch64-libvirt-compat.patch: Rebased and updated to mock
    os.path.exists return value to true in order to simulate
    _has_uefi_support returning true (LP: #1758060).

 -- Corey Bryant <email address hidden> Thu, 22 Mar 2018 08:44:37 -0400

The verification of the Stable Release Update for nova has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

The verification of the Stable Release Update for nova has completed successfully and the package has now been released to -updates. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

This bug was fixed in the package nova - 2:16.1.0-0ubuntu1~cloud0
---------------

 nova (2:16.1.0-0ubuntu1~cloud0) xenial-pike; urgency=medium
 .
   * New upstream release for the Ubuntu Cloud Archive.
 .
 nova (2:16.1.0-0ubuntu1) artful; urgency=medium
 .
   [ James Page ]
   * Add Depends nova-compute-kvm -> ipxe-qemu to ensure that required
     ROM's are installed for all architectures (LP: #1754015).
 .
   [ Corey Bryant ]
   * New stable point release for OpenStack Pike (LP: #1758046).
   * d/p/aarch64-libvirt-compat.patch: Rebased and updated to mock
     os.path.exists return value to true in order to simulate
     _has_uefi_support returning true (LP: #1758060).