Merge ~rbalint/autopkgtest-cloud:sbuild-long into autopkgtest-cloud:master

[Balint Reczey]

New sbuild adds new autopkgtest which exercises qemu for quite long.

[Steve Langasek (vorlon)]

How have you determined that this is a long-running test rather than a hang?

Why is this test only present on amd64?

review: Needs Information

[Balint Reczey (rbalint)]

I've retried it several times and it got stuck at different points thus it does not look like a simple hang.

Local reproduction fails due to LP: #1906970.

The test is run only on amd64 by the Debian maintainer's choice.

[Julian Andres Klode (juliank)]

There does not seem to be any evidence here that it would pass if given more time. Reproduce it in canonistack without a timeout, or we can run it once without one in production autopkgtest cloud, but I don't wanna merge that without having done either.

review: Needs Information

[Balint Reczey (rbalint)]

@juliank Sure, could you please run it once to have the most reliable prediction for passing when merged?

[Julian Andres Klode (juliank)]

The test has been running for 6 hours now and seems stuck, so this does not seem to be a solution.

mtime of the log is 16:09 UTC, the test's last ssh process (which is still running) started at 16:07

review: Disapprove

[Julian Andres Klode (juliank)]

Hanging Process tree

root 415 0.0 0.4 13464 7316 ? Ss 16:06 0:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
root 435 0.0 0.6 15148 9152 ? Ss 16:06 0:00 \_ sshd: ubuntu [priv]
ubuntu 475 0.0 0.4 15280 6320 ? S 16:06 0:00 \_ sshd: ubuntu@pts/0
root 13475 0.0 0.3 11584 4536 ? Ss 16:07 0:00 \_ sudo -n /tmp/autopkgtest-run-wrapper su -s /bin/bash root -c set -e; export USER=`id -nu`; . /etc/profile >/dev/null 2>&1 || true; .
root 13476 0.0 0.1 8832 2288 ? S 16:07 0:00 | \_ /bin/bash /tmp/autopkgtest-run-wrapper su -s /bin/bash root -c set -e; export USER=`id -nu`; . /etc/profile >/dev/null 2>&1 || tru
root 13478 0.0 0.2 10360 3924 ? S 16:07 0:00 | \_ su -s /bin/bash root -c set -e; export USER=`id -nu`; . /etc/profile >/dev/null 2>&1 || true; . ~/.profile >/dev/null 2>&1 ||
root 13479 0.0 0.1 8940 2640 ? S 16:07 0:00 | \_ bash -c set -e; export USER=`id -nu`; . /etc/profile >/dev/null 2>&1 || true; . ~/.profile >/dev/null 2>&1 || true; build
root 13488 0.0 0.0 2624 712 ? S 16:07 0:00 | \_ /bin/sh /tmp/autopkgtest.Ui3ELY/build.ewv/src/debian/tests/unshare-qemuwrapper
root 13489 0.0 0.0 8940 1252 ? S 16:07 0:00 | \_ bash -c set -e; export USER=`id -nu`; . /etc/profile >/dev/null 2>&1 || true; . ~/.profile >/dev/null 2>&1 || tru
root 13493 0.0 0.0 7396 704 ? S 16:07 0:00 | | \_ tee -a /tmp/autopkgtest.Ui3ELY/unshare-qemuwrapper-stderr
root 13490 0.0 0.0 8940 1252 ? S 16:07 0:00 | \_ bash -c set -e; export USER=`id -nu`; . /etc/profile >/dev/null 2>&1 || true; . ~/.profile >/dev/null 2>&1 || tru
root 13492 0.0 0.0 7396 704 ? S 16:07 0:00 | | \_ tee -a /tmp/autopkgtest.Ui3ELY/unshare-qemuwrapper-stdout
root 17692 0.0 1.3 76376 19708 ? S 16:09 0:00 | \_ guestfish -N /tmp/autopkgtest.Ui3ELY/autopkgtest_tmp/host.img disk:2G -- part-disk /dev/sda mbr : mkfs ext2 /dev/s
root 18510 99.8 12.6 1627920 190752 ? Sl 16:09 383:25 | \_ /usr/bin/qemu-system-x86_64 -global virtio-blk-pci.scsi=off -no-user-config -enable-fips -nodefaults -display
root 18511 0.0 0.2 76376 4068 ? S 16:09 0:00 | \_ guestfish -N /tmp/autopkgtest.Ui3ELY/autopkgtest_tmp/host.img disk:2G -- part-disk /dev/sda mbr : mkfs ext2 /d
ubuntu 18658 0.6 0.3 10048 5064 pts/0 Ss 22:33 0:00 \_ -bash
ubuntu 18666 0.0 0.2 12684 3796 pts/0 R+ 22:33 0:00 \_ ps faux

[Julian Andres Klode (juliank)]

Copy of /tmp/autopkgtest.Ui3ELY/unshare-qemuwrapper-stdout:

 https://gist.github.com/julian-klode/d1ae569be70b4d19404eaa07dc989fcb

(I wish we could attach files to merge proposals :D)

This one has not been modified since 16:07 either, so it really made no progress in those 7 hours.

[Julian Andres Klode (juliank)]

Filed as bug 1918740

[Iain Lane (laney)]

Thanks Julian!

review: Disapprove

Unmerged commits

a2f115f... by Balint Reczey on 2021-03-03

Mark sbuild as a long test on amd64

diff --git a/worker-config-production/worker.conf b/worker-config-production/worker.conf
index 9d7c435..593dfcb 100644
--- a/worker-config-production/worker.conf
+++ b/worker-config-production/worker.conf
@@ -17,7 +17,7 @@ architectures = i386 amd64
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
 big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python2.7 python3.6 python3.7 python3.8 python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 nodejs cl-ironclad python-scipy scipy cross-toolchain-base-mipsen mkl-dnn samtools satpy python-cffi yt skimage scikit-learn silx statsmodels puma multipath-tools tgt dask assimp mariadb-10.3 mariadb-10.5 deal.ii libsis-jhdf5-java octave-parallel r-bioc-beachmat
-long_tests = gutenprint gmp-ecm open-iscsi diffoscope snapcraft cross-toolchain-base mercurial
+long_tests = gutenprint gmp-ecm open-iscsi diffoscope snapcraft cross-toolchain-base mercurial sbuild
 blacklist = bionic/i386/upstart bionic/amd64/upstart bionic/i386/libnih bionic/amd64/libnih bionic/i386/r-cran-vioplot bionic/amd64/r-cran-vioplot bionic/amd64/stress-ng bionic/i386/stress-ng bionic/i386/openjdk-lts xenial/amd64/virtualbox-ext-pack bionic/amd64/virtualbox-ext-pack xenial/i386/virtualbox-ext-pack bionic/i386/virtualbox-ext-pack hirsute/i386/rust-onig hirsute/amd64/rust-onig
 
 [virt]