unpacking the upstream tarball not working

This bug was fixed in the package bzr-builddeb - 2.2~ubuntu2

---------------
bzr-builddeb (2.2~ubuntu2) karmic; urgency=low

  * Don't cause the commit to fail if the changelog file is present but
    unknown.
  * Also avoid problems with SIGPIPE when running the build command.
    (LP: #399938)

 -- James Westby <email address hidden> Wed, 15 Jul 2009 18:05:38 +0100

i'm still experiencing this broken pipe issue with bzr-builddeb 2.2~ubuntu2 every few days.

and it seems it's not limited to python...

$ apt-get source tar
Reading package lists... Done
Building dependency tree
Reading state information... Done
Need to get 2626kB of source archives.
Get:1 http://archive.ubuntu.com karmic/main tar 1.22-1 (dsc) [929B]
Get:2 http://archive.ubuntu.com karmic/main tar 1.22-1 (tar) [2608kB]
Get:3 http://archive.ubuntu.com karmic/main tar 1.22-1 (diff) [16.8kB]
Fetched 2626kB in 0s (8221kB/s)
gpgv: Signature made Fri 03 Apr 2009 10:36:14 PM CEST using DSA key ID F2CF01A8
gpgv: Can't check signature: public key not found
dpkg-source: warning: failed to verify signature on ./tar_1.22-1.dsc
dpkg-source: info: extracting tar in tar-1.22
dpkg-source: info: unpacking tar_1.22.orig.tar.gz

gzip: stdout: Broken pipe
dpkg-source: error: gunzip gave error exit status 1
Unpack command 'dpkg-source -x tar_1.22-1.dsc' failed.
Check if the 'dpkg-dev' package is installed.
E: Child process failed

this seems to be an issue on karmic x64 only.

You get this problem from "apt-get source" without involving bzr-builddeb
at all?

Thanks,

James

An identical error is breaking Launchpad tests (specifically gina.txt) on Karmic. The "dpkg-source -sn -x" failures are not always reproducible, and I haven't ever been able to reproduce with an identical command called from a shell rather than Python. Only some packages (ubuntu-meta 0.80 in the gina test archive is the one that fails most of the time) are affected.

This is all in a karmic i386 chroot, but with an amd64 kernel. Debian bug #523329 looks very relevant, but that's meant to be fixed.

OK, so it seems I misunderstood all this. Oops.

So, for those people who will inevitably stumble upon this bug like I did:

It looks like tar changed, which caused that Debian dpkg bug, which was then fixed. But Python sets a custom SIGPIPE hander, which breaks the fix when calling dpkg-source using subprocess. See http://www.chiark.greenend.org.uk/ucgi/~cjwatson/blosxom/2009-07-02-python-sigpipe.html for details of how to work around that.

James, yes, I see this with bzr-builddeb, with bzr-builddeb and even with python.

Last month, we discussed that on irc.

It's not all tarballs, but some tarballs, and it's 100% reproducible.
http://paste.ubuntu.com/209301/
http://www.sofaraway.org/ubuntu/tmp/songbird_1.3.0~a~svn20090703r14148.orig.tar.gz

This is wider than just bzr-builddeb. I'm experiencing this issue every once in a while on my x64 karmic server, doing the mozilla & chromium dailies.

$ bzr bd --merge --build-dir=/data/bot/ppa --orig-dir=../tarballs --builder='dpkg-buildpackage -rfakeroot -S -sd -kB6EE20E8'
Building using working tree
Running in merge mode
Looking for a way to retrieve the upstream tarball
Upstream tarball already exists in build directory, using that

gzip: stdout: Broken pipe
tar: Child returned status 1
tar: Exiting with failure status due to previous errors
bzr: ERROR: There was an error executing tar to uncompress /data/bot/ppa/chromium-browser_4.0.210.0~svn20090915r26226.orig.tar.gz.
$ cd ../tarballs
$ tar ztvf chromium-browser_4.0.210.0~svn20090915r26226.orig.tar.gz
drwxr-xr-x fta/fta 0 2009-09-15 19:46 chromium-browser-4.0.210.0~svn20090915r26226/
-rw-r--r-- fta/fta 73786421 2009-09-15 19:46 chromium-browser-4.0.210.0~svn20090915r26226/chromium-browser-4.0.210.0~svn20090915r26226-source.tar.lzma

gzip: stdout: Broken pipe
tar: Child returned status 1
tar: Exiting with failure status due to previous errors
$ tar zxvf chromium-browser_4.0.210.0~svn20090915r26226.orig.tar.gz
chromium-browser-4.0.210.0~svn20090915r26226/
chromium-browser-4.0.210.0~svn20090915r26226/chromium-browser-4.0.210.0~svn20090915r26226-source.tar.lzma

gzip: stdout: Broken pipe
tar: Child returned status 1
tar: Exiting with failure status due to previous errors

$ cp -a chromium-browser_4.0.210.0~svn20090915r26226.orig.tar.gz foo.tar.gz
tar ztvf foo.tar.gz
drwxr-xr-x fta/fta 0 2009-09-15 19:46 chromium-browser-4.0.210.0~svn20090915r26226/
-rw-r--r-- fta/fta 73786421 2009-09-15 19:46 chromium-browser-4.0.210.0~svn20090915r26226/chromium-browser-4.0.210.0~svn20090915r26226-source.tar.lzma

gzip: stdout: Broken pipe
tar: Child returned status 1
tar: Exiting with failure status due to previous errors
$ gunzip foo.tar.gz
$ echo $?
0
$ tar tvf foo.tar
drwxr-xr-x fta/fta 0 2009-09-15 19:46 chromium-browser-4.0.210.0~svn20090915r26226/
-rw-r--r-- fta/fta 73786421 2009-09-15 19:46 chromium-browser-4.0.210.0~svn20090915r26226/chromium-browser-4.0.210.0~svn20090915r26226-source.tar.lzma
$ tar xvf foo.tar
chromium-browser-4.0.210.0~svn20090915r26226/
chromium-browser-4.0.210.0~svn20090915r26226/chromium-browser-4.0.210.0~svn20090915r26226-source.tar.lzma
$ ls -l chromium-browser-4.0.210.0~svn20090915r26226/
total 72136
-rw-r--r-- 1 fta fta 73786421 2009-09-15 19:46 chromium-browser-4.0.210.0~svn20090915r26226-source.tar.lzma

If i scp this tarball to my 32bit desktop (karmic too), it's all fine.

on the same x64 box:

$ apt-get source evolution-data-server
Reading package lists... Done
Building dependency tree
Reading state information... Done
NOTICE: 'evolution-data-server' packaging is maintained in the 'Bzr' version control system at:
https://code.launchpad.net/~ubuntu-desktop/evolution-data-server/ubuntu
Please use:
bzr get https://code.launchpad.net/~ubuntu-desktop/evolution-data-server/ubuntu
to retrieve the latest (possible unreleased) updates to the package.
Need to get 32.0MB of source archives.
Get:1 http://archive.ubuntu.com karmic/main evolution-data-server 2.27.92-0ubuntu1 (dsc) [3024B]
Get:2 http://archive.ubuntu.com karmic/main evolution-data-server 2.27.92-0ubuntu1 (tar) [32.0MB]
Get:3 http://archive.ubuntu.com karmic/main evolution-data-server 2.27.92-0ubuntu1 (diff) [33.2kB]
Fetched 32.0MB in 2s (10.9MB/s)
gpgv: Signature made Mon 07 Sep 2009 04:17:35 PM CEST using DSA key ID A2D7D292
gpgv: Can't check signature: public key not found
dpkg-source: warning: failed to verify signature on ./evolution-data-server_2.27.92-0ubuntu1.dsc
dpkg-source: info: extracting evolution-data-server in evolution-data-server-2.27.92
dpkg-source: info: unpacking evolution-data-server_2.27.92.orig.tar.gz

gzip: stdout: Broken pipe
dpkg-source: error: gunzip gave error exit status 1
Unpack command 'dpkg-source -x evolution-data-server_2.27.92-0ubuntu1.dsc' failed.
Check if the 'dpkg-dev' package is installed.
E: Child process failed

Maybe it's not the same bug but it also occurs with other commands (still on that x64 box):

$ bzr log --line | grep '\[merge\]' | head -1 | cut -d: -f1
613
grep: write error: Broken pipe
$ bzr log --line | grep '\[merge\]' | cut -d: -f1 | head -1
613
$