Packages was corrupt

Bug #1023069 reported by Niklas Andersson
18
This bug affects 3 people
Affects Status Importance Assigned to Milestone
debootstrap (Debian)
Fix Released
Unknown
debootstrap (Ubuntu)
Fix Released
High
Louis Bouchard
Lucid
Fix Released
Undecided
Louis Bouchard
Precise
Fix Released
Undecided
Louis Bouchard

Bug Description

SRU justification :
Without this fix, unattended installation using preseed/kickstart files for 10.04.4 fails with a red screen and the message "Packages was corrupt"

Impact :
Impossible to preform unattended preseed installation in 10.04.4

Fix :
Backport and adapt the upstream debian fix in the following commit :
http://anonscm.debian.org/gitweb/?p=d-i/debootstrap.git;a=commitdiff;h=733069bb97bdfe3f9c16ca4c9ef58685205eabf3;hp=412608c1fbe28074f56d930242e4269d5588d101

Test Case :
1) Build new debootstrap-udeb_1.0.20ubuntu1.5_all.udeb package with the fix
2) Make a local copy of the 10.04.4 alternate cd
3) Use instructions in the following Wiki entry to rebuild the local archive with the modified .udeb package
https://help.ubuntu.com/community/InstallCDCustomization
4) Use PXE installation with the rebuilt local archive to verify that the new .udeb does a complete installation without the "Packages was corrupt" message

Regression :
This could only potentially affect netinst installation as no new .iso file will be created for Lucid. Moreover, this fix is already implemented in 12.04 LTS which runs debootstrap 1.0.39

Description of the problem :

Doing unattended kickstart-installation and during install I get a red screen with "Warning: http://..../ubuntu/dists/precise/restricted/binary-amd64/Packages was corrupt."

I have to click "Continue" to go on.

The file in question (Packages.gz) is only 20 bytes bit, same file on ubuntu-12.04-desktop is a couple of kilobytes, that looks more reasonable. "zcat Packages" reports no problem though. It looks like an empty .gz-file.

There is nothing problem with my download. My downloaded iso has md5 9fcc322536575dda5879c279f0b142d7 just as it shold be.

Either there is a problem with Packages.gz that should have some content, or it is a problem with the installer that detects an empty .gz-file as "corrupt". Anyways - it's a bug.

Revision history for this message
Fabio Marconi (fabiomarconi) wrote :

Thank you for taking the time to report this bug and helping to make Ubuntu better. Unfortunately, we cannot work on this bug because your description didn't include enough information. You may find it helpful to read "How to report bugs effectively" http://www.chiark.greenend.org.uk/~sgtatham/bugs.html. We'd be grateful if you would then provide a more complete description of the problem.

We have instructions on debugging some types of problems at http://wiki.ubuntu.com/DebuggingProcedures

At a minimum, we need:
1. the specific steps or actions you took that caused you to encounter the problem,
2. the behavior you expected, and
3. the behavior you actually encountered (in as much detail as possible).
Thanks!

Changed in debian-installer (Ubuntu):
status: New → Incomplete
Revision history for this message
Dimitri John Ledkov (xnox) wrote :

Problem with internet (e.g. fake internet redirect to login page) or borked up mirror. Try offline installation or a different mirror / network.

Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for debian-installer (Ubuntu) because there has been no activity for 60 days.]

Changed in debian-installer (Ubuntu):
status: Incomplete → Expired
Revision history for this message
Matt Rae (mattrae) wrote :
Download full text (4.4 KiB)

Expected Behavior:

Installer continues without warning about a corrupt Packages file.

Behavior actually encountered:

During install a red warning screen appears with the following message:

[!!] Install the base system
Debootstrap warning
Warning:
http://192.168.0.1/ubuntu/dists/lucid/restricted/binary-amd64/Packages was corrupt
<Go Back> <Continue>

Pressing enter to continue allows the installer to continue installing.

Reproduction steps:

To reproduce this bug, create a pxe boot server and apt repo.

Build a vm with 2 nics for the server.

Configure the second nic (eth1) for a private network we will use to test netbooting the installer on a separate vm.

Install Ubuntu with 10.04.04 amd64 alternate install cd for our server:
http://releases.ubuntu.com/lucid/ubuntu-10.04.4-alternate-amd64.iso

Boot Ubuntu and add the following lines to /etc/network/interfaces to configure eth1 with a static address replacing gateway with your internet gateway:

auto eth1
iface eth1 inet static
  address 192.168.0.1
  netmask 255.255.255.0
  gateway 192.168.1.1

Reboot Ubuntu so that the second nic is configured at boot.

Attach/insert the Ubuntu 10.04.04 cd to the vm so we can use it later.

Install dnsmasq for dhcp and tftp servers:

apt-get install dnsmasq

Edit /etc/dnsmasq.conf adding the following lines to enable dhcp and tftp:

dhcp-boot=pxelinux.0
dhcp-range=192.168.0.50,192.168.0.150,12h
enable-tftp
interface=eth1

Restart dnsmasq:

service dnsmasq restart

Mount the Ubuntu 10.04 cd’s install/tftpboot directory under /var/lib/tftpboot:

mkdir /var/lib/tftpboot
mount --bind /media/Ubuntu\ 10.04.4\ LTS\ amd64/install/netboot/ /var/lib/tftpboot

Create pxe boot config file /root/mydefault containing the following lines:

TIMEOUT 50
PROMPT 1
default netboot
 nabel netboot
 kernel ubuntu-installer/amd64/linux
 append vga=normal local=en_US setup/layoutcode=en_US console-setup/layoutcode=us initrd=ubuntu-installer/amd64/initrd.gz ks=http://192.168.0.1/ks.cfg

Note above, ks=http://192.168.0.1/ks.cfg points to the kickstart file.

Mount mydefault under /var/lib/tftpboot:

mount --bind /root/mydefault /var/lib/tftpboot/pxelinux.cfg/default

To set up apt repo, mount the Ubuntu cd under /var/www/ubuntu:

mkdir -p /var/www/ubuntu
mount --bind /media/Ubuntu\ 10.04.4\ LTS\ amd64/ /var/www/ubuntu

Install apache to serve packages via http for apt repo:

apt-get install apache2

Create the kickstart config file in /var/www/ks.cfg containing the following lines:

###########################################################################
# Installer Section
###########################################################################
#--------------------------------------------------------------------------
# Installation Options
#--------------------------------------------------------------------------
#
# Install OS in text mode
#
install
text

#
# System Language
#
lang en_US
langsupport en_US

#
# System Keyboard and Mouse Settings
#
keyboard us

#
# Timezone Setting
#
timezone America/Chicago

#--------------------------------------------------------------------------
# License Key
#---------------------------------------------------------------------...

Read more...

Changed in debian-installer (Ubuntu):
status: Expired → Confirmed
importance: Undecided → High
Revision history for this message
Louis Bouchard (louis) wrote :

Regarding precise, this bug has been fixed in Debian/upstream by the following bug :

http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=618920

It was included in Precise in version 1.0.39 which is in the precise-updates archive :

http://packages.ubuntu.com/fr/precise-updates/debootstrap

Changed in debian-installer (Ubuntu):
assignee: nobody → Louis Bouchard (louis-bouchard)
affects: debian-installer (Ubuntu) → debootstrap (Ubuntu)
Changed in debootstrap (Ubuntu):
assignee: Louis Bouchard (louis-bouchard) → nobody
assignee: nobody → Louis Bouchard (louis-bouchard)
Revision history for this message
Louis Bouchard (louis) wrote :

marking Precise as fixed released since the correction is in precise-updates already

For lucid, a backport of 1.0.39 will be required. Please be aware that this will not fix a situation where the .iso file is used as an archive since the .iso will always use debootstrap from the .iso

Changed in debootstrap (Ubuntu Lucid):
assignee: nobody → Louis Bouchard (louis-bouchard)
Changed in debootstrap (Ubuntu Precise):
assignee: nobody → Louis Bouchard (louis-bouchard)
status: New → Fix Released
Louis Bouchard (louis)
Changed in debootstrap (Ubuntu Lucid):
status: New → In Progress
Changed in debootstrap (Debian):
status: Unknown → Fix Released
Louis Bouchard (louis)
description: updated
Revision history for this message
Louis Bouchard (louis) wrote :

Important to note : the upstream debian commit required changing references to $checksum and verify_checksum used in more recent versions by $md5 and check_md5 which was in use in version 1.0.20

Revision history for this message
Dimitri John Ledkov (xnox) wrote :

as far as I understand this is fixed in precise and up, or at least in raring hence marking the default task "fix released".

Changed in debootstrap (Ubuntu):
status: Confirmed → Fix Released
Revision history for this message
Iain Lane (laney) wrote :

Uploaded to Lucid. Removing sponsors - thanks!

Louis Bouchard (louis)
Changed in debootstrap (Ubuntu Lucid):
status: In Progress → Fix Committed
Revision history for this message
Dimitri John Ledkov (xnox) wrote :

Please do not change bug status to those that contradict SRU workflow. "Fix committed" should only be set by SRU team once the package is accepted into -proposed pocket. See https://wiki.ubuntu.com/StableReleaseUpdates#Procedure for description of status changes for SRUs.

Changed in debootstrap (Ubuntu Lucid):
status: Fix Committed → In Progress
Revision history for this message
Louis Bouchard (louis) wrote :

oups, sorry about that :-/ I thought that the upload msg from laney was sufficient.

Chris J Arges (arges)
tags: added: cts-client-review
Chris J Arges (arges)
tags: removed: cts-client-review
Revision history for this message
Colin Watson (cjwatson) wrote : Please test proposed package

Hello Niklas, or anyone else affected,

Accepted debootstrap into lucid-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/debootstrap/1.0.20ubuntu1.5 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Changed in debootstrap (Ubuntu Lucid):
status: In Progress → Fix Committed
tags: added: verification-needed
Revision history for this message
Colin Watson (cjwatson) wrote :

This works as far as it goes, but if a download keeps failing then debootstrap will carry on without it and claim to have succeeded. This is something I fixed in Debian 1.0.39 along with the change Louis backported here - although not in the same commit, which may be why he missed it - and I think it needs to be backported for safety. Fixing this is a one-liner, and I'll upload it.

tags: added: verification-failed
removed: verification-needed
Revision history for this message
Stéphane Graber (stgraber) wrote :

Hello Niklas, or anyone else affected,

Accepted debootstrap into lucid-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/debootstrap/1.0.20ubuntu1.6 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

tags: removed: verification-failed
tags: added: verification-needed
Revision history for this message
Louis Bouchard (louis) wrote :

Verified the uploaded fix in -proposed using steps described in the "Test case" paragraph. upload does fix the issue

tags: added: verification-done
removed: verification-needed
Revision history for this message
Scott Kitterman (kitterman) wrote : Update Released

The verification of this Stable Release Update has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regresssions.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package debootstrap - 1.0.20ubuntu1.6

---------------
debootstrap (1.0.20ubuntu1.6) lucid; urgency=low

  * Stop at the end of the retrieval phase if any packages failed to
    download (LP: #1023069).

debootstrap (1.0.20ubuntu1.5) lucid-proposed; urgency=low

  * Fix Packages was corrupt warning on preseed install. Backport fix for
    Debian bug #618920 to solve LP: #1023069. Patch slightly reworked to adapt
    to older codebase.
 -- Colin Watson <email address hidden> Thu, 08 Aug 2013 17:49:14 +0100

Changed in debootstrap (Ubuntu Lucid):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.