Merge lp:~james-page/britney/ovs-2.11.0-0ubuntu2 into lp:britney

[James Page]

Update openvswitch version for i386 build failure

Update bug reference - hopefully we'll have a fix soon!

Unmerged revisions

3643. By James Page on 2019-04-08

Bump OVS version of i386 test failure, update bug reference

3642. By Adam Conrad on 2019-04-06

Drop Qt hints.

3641. By Adam Conrad on 2019-04-05

Hint Qt a little harder.

3640. By Adam Conrad on 2019-04-05

badtest kdelibs4support/5.56.0-0ubuntu2/s390x for now

3639. By Adam Conrad on 2019-04-05

Let qtbase-opensource-src/5.12.2+dfsg-2 in

3638. By Steve Langasek on 2019-04-04

bump python-scipy/amd64

3637. By Steve Langasek on 2019-04-04

more linux skiptests

3636. By Steve Langasek on 2019-04-04

more linux skiptests

3635. By Steve Langasek on 2019-04-04

more linux skiptests

3634. By Steve Langasek on 2019-04-04

badtest vuls

=== added file 'adconrad'
--- adconrad	1970-01-01 00:00:00 +0000
+++ adconrad	2019-04-08 08:46:23 +0000
@@ -0,0 +1,29 @@
+# Regressed in release pocket:
+force-badtest mash/2.0-2/armhf
+force-badtest node-platform/1.3.5-1/s390x
+force-badtest node-yargs/10.0.3-2
+# These tests fail now that s390x provides isolation-machine:
+force-badtest dahdi-linux/all/s390x
+# Depends on x86-only libngs-java
+force-badtest beagle/all/armhf beagle/all/ppc64el beagle/all/s390x
+force-badtest fastqc/all/armhf fastqc/all/ppc64el fastqc/all/s390x
+# Depends on stuff no longer built:
+force-badtest libcatmandu-store-mongodb-perl/all/i386
+force-badtest roary/all/armhf roary/all/s390x
+force-badtest pbgenomicconsensus/all/i386
+# Not built on i386, the test might not work:
+force-badtest pbh5tools/all/i386
+# Mysteriously passed once, and never again:
+force-badtest vagrant-libvirt/0.0.45-2/amd64 vagrant-libvirt/0.0.45-2/s390x
+# debootstrap's tests are a flaming heap in containers:
+force-badtest debootstrap/all/s390x
+# fails only on lxc hosts
+force-badtest sbuild/all/armhf
+# The libreoffice failures are clearly not kio's fault:
+force-skiptest kio/5.53.0-0ubuntu1
+# Upstream ticket filed: https://github.com/citusdata/postgresql-hll/issues/67
+force-badtest postgresql-hll/2.12-3
+# A (new) test skipped during build fails on autopkgtest, fixing in next upload:
+force-badtest glibc/2.29-0ubuntu1
+# Beta unblocks:
+unblock ukui-greeter/1.1.8-0ubuntu1

=== added file 'apw'
--- apw	1970-01-01 00:00:00 +0000
+++ apw	2019-04-08 08:46:23 +0000
@@ -0,0 +1,40 @@
+# While copying kernels forward from xenial it rather too easy for linux
+# to slip out without the testing being fully reviewed.  As britney is not
+# able to track previous failures correctly for kernels.
+#block linux
+#block linux-raspi2
+block linux-oem
+#block linux-aws
+#block linux-azure
+#block linux-gcp
+#block linux-kvm
+
+# Development kernel unblocks:
+#unblock linux/4.18.0-11.12
+#unblock linux-raspi2/4.18.0-1010.12
+unblock linux-oem/4.15.0-1034.39
+#unblock linux-aws/4.18.0-1011.13
+#unblock linux-azure/4.18.0-1013.13
+#unblock linux-gcp/4.18.0-1007.8
+#unblock linux-kvm/4.18.0-1008.8
+
+# linux-raspi on arm64 fails in such a way that it is not identified as a failure.  Therefore
+# the tests never complete and the package can never migrate.  skiptest this once the armhf
+# testing is complete and good.
+force-skiptest linux-meta-raspi2/4.18.0.1005.2
+
+#
+# arm* removed in zesty-proposed hint in-progress tests against them.
+force-badtest sunpy/all/armhf
+
+# python-pysam does not (and never has) built on armhf and i386
+force-badtest python-pysam/all/armhf python-pysam/all/i386
+
+# 14-feb-2017: armhf test non-installable
+force-badtest python-cobra/all/armhf
+
+# linux-gcp/armhf -- does not even build here, so tests here cannot be relevant
+force-badtest linux-gcp/all/armhf
+
+# Skip an unrelated linux/s390x test failure.
+force-skiptest gcc-7/7.3.0-29ubuntu1

=== added file 'arges'
=== added file 'brian-murray'
=== added file 'freeze'
=== added file 'laney'
--- laney	1970-01-01 00:00:00 +0000
+++ laney	2019-04-08 08:46:23 +0000
@@ -0,0 +1,52 @@
+# firewalld regression which is nothing to do with gtk
+force-skiptest gtk+3.0/3.24.7-1ubuntu1
+
+# systemd/arm64..
+force-skiptest gdm3/3.32.0-1ubuntu1
+
+# remaining failures (sbd/x86, systemd/arm64) are not glib2.0's fault
+# 11/03 13:23:51 <Laney> xnox: yo, so I was just looking at systemd/arm64
+# 11/03 13:24:03 <Laney> the boot-and-services seems flaky wrt gdm3 and test_no_options
+# 11/03 13:24:43 <Laney> test_no_options looks for the kernel commandline in the journal but I think that's hidden by "Missed 50 kernel messages"
+# 11/03 13:25:14 <Laney> which is "journal can't keep up with messages", not normal journald rate limiting afaics
+# 11/03 13:31:12 <Laney> not sure about gdm3; guess: much slower to start up than the other things being tested, and the test is run "too early"?
+force-skiptest glib2.0/2.60.0-1
+
+# systemd failures, not the fault of dnsmasq (systemd is very flaky on arm64)
+force-skiptest dnsmasq/2.80-1ubuntu1
+
+# systemd has its common remaining service type of failure in boot smoke test
+# not gnutls28's fault
+force-skiptest gnutls28/3.6.5-2ubuntu1
+
+# apport is failing, not gtk's fault
+force-skiptest gtk+3.0/3.24.2-2ubuntu2
+
+# seems broken in release & for a while
+force-badtest gerris/20131206+dfsg-18build2/armhf
+
+# ditto, not leaks but something to do with SVGs
+force-badtest php-imagick/3.4.3~rc2-2ubuntu6
+
+# isolation-machine, needs thunderbird which isn't available
+force-badtest firejail/all/s390x
+
+# passed once by fluke on armhf it seems
+
+force-badtest ostree/all/armhf
+
+# mongo isn't built for armhf/i386 any more
+force-badtest flask-mongoengine/all/i386
+force-badtest mongodb/all/i386
+force-badtest flask-mongoengine/all/armhf
+force-badtest mongodb/all/armhf
+
+# FTBFS, no package on this arch, unclear how it passed(!)
+force-badtest python-fitsio/all/armhf
+
+# Field3D only supports Ogawa-backed files on little-endian systems.
+force-badtest field3d/all/s390x
+
+# bad test which fails if the test runner can't reach the public Internet.
+# LP: #1427982
+force-badtest libtest-requiresinternet-perl/0.05-2

=== added file 'pitti'
--- pitti	1970-01-01 00:00:00 +0000
+++ pitti	2019-04-08 08:46:23 +0000
@@ -0,0 +1,43 @@
+# new PEP-8 errors with zesty's newer pep8 tool; don't bump!
+force-badtest rpmlint/1.9-6
+
+# segfaults on 32 bit
+force-badtest baloo-kf5/all/i386 baloo-kf5/all/armhf
+
+# started failing with move to lxd on armhf
+force-badtest pbuilder/all/armhf
+
+#
+# blacklisted for test runs as they kill testbeds
+#
+#
+force-badtest stress-ng/blacklisted/ppc64el
+
+#
+# flaky, universe, nobody cares in Ubuntu
+#
+#
+force-badtest beets/all/s390x
+# times out
+force-badtest c2esp/all/armhf
+force-badtest elasticsearch-curator/5.2.0-1
+# takes painfully long, times out on armhf, testing on x86 is enough
+force-badtest epson-inkjet-printer-escpr/all/armhf
+force-badtest gjs/all/s390x
+force-badtest libcgi-application-plugin-captcha-perl/0.04-2
+# flaky on s390x, alwaysfail on others
+force-badtest palabos/s390x/all
+force-badtest pdns/all
+force-badtest pbsuite/all/i386
+force-badtest php-horde-http/2.1.7-3
+force-badtest php-horde-icalendar/all/armhf php-horde-icalendar/all/i386
+force-badtest python-publicsuffix/1.1.0-2
+force-badtest pyzmq/all/s390x pyzmq/all/armhf
+force-badtest rexical/1.0.5-2build1
+force-badtest ruby-amq-protocol/all/s390x
+force-badtest ruby-augeas/1:0.5.0-3build6
+# Debian #816161
+force-badtest ruby-minitest-excludes/2.0.0-1
+force-badtest ruby-mixlib-shellout/2.2.6-1
+force-badtest ruby-sshkit/all/s390x
+force-badtest zodb/1:3.10.7-1build1/ppc64el zodb/1:3.10.7-1build1/s390x

=== added file 'racb'
=== added file 'raof'
=== added file 'sil2100'
--- sil2100	1970-01-01 00:00:00 +0000
+++ sil2100	2019-04-08 08:46:23 +0000
@@ -0,0 +1,11 @@
+# Some more R badtests that are failing, some of which basically from the start
+force-badtest r-cran-memoise/1.1.0-2/armhf
+
+# Temporarily badtest the current release puppet as now it's failing due to a deprecation warning printed out to stderr. This is fixed in the -proposed puppet but that one still needs some work to be migrate-able.
+force-badtest puppet/5.4.0-2ubuntu3
+
+# Regressed in release, FP precision errors (LP: #1813904)
+force-badtest xtensor/0.10.11-1/i386
+
+# virtualbox stopped providing its binary package on i386, on which the ext-pack tests depend on.
+force-badtest virtualbox-ext-pack/all/i386

=== added file 'stefanor'
=== added file 'stgraber'
=== added file 'tjaalton'
=== added file 'ubuntu-release'
--- ubuntu-release	1970-01-01 00:00:00 +0000
+++ ubuntu-release	2019-04-08 08:46:23 +0000
@@ -0,0 +1,261 @@
+# ported from vorlon
+force-badtest aptdaemon/1.1.1+bzr982-0ubuntu20 aptdaemon/1.1.1+bzr982-0ubuntu21
+
+# passed previously in containers, now fails everywhere
+force-badtest ruby-fakeweb/1.3.0+git20170806+dfsg1-1
+
+# regressed in release
+force-badtest adequate/0.15.1ubuntu5
+force-badtest apt-clone/0.4.1ubuntu2
+force-badtest colord/1.4.3-4/i386
+force-badtest colord/1.4.3-4
+## arch-specific loop device raciness we don't yet understand
+force-badtest cloud-utils/0.31-0ubuntu1/ppc64el
+force-badtest ddcci-driver-linux/0.3.2-1/s390x
+force-badtest debci/1.14 debci/1.15.1 debci/2.0
+force-badtest diaspora-installer/0.7.6.1build1
+force-badtest fdroidserver/1.1.1-1ubuntu1
+force-badtest fuse-zip/0.5.0-1/arm64
+force-badtest git-lfs/2.6.1-3
+force-badtest hello/2.10-1ubuntu1
+force-badtest libdevel-size-perl/0.82-1build1/armhf
+force-badtest libfile-userconfig-perl/0.06-4/i386
+force-badtest libterm-filter-perl/0.03-2/arm64 libterm-filter-perl/0.03-2/i386
+force-badtest libtest-valgrind-perl/1.19-1/ppc64el
+force-badtest node-gulp-coffee/2.3.4-1/arm64
+force-badtest lua-nvim/0.1.0-1-1
+force-badtest octave-image/2.10.0-2/amd64 octave-image/2.10.0-2/i386 octave-image/2.10.0-2/ppc64el
+force-badtest pdb2pqr/2.1.1+dfsg-4build1
+force-badtest php-horde-exception/2.0.8-2ubuntu1
+force-badtest php-horde-util/2.5.8-1ubuntu1
+force-badtest php-horde-serialize/2.0.5-3ubuntu1
+force-badtest php-horde-support/2.2.0-1ubuntu1
+force-badtest php-horde-view/2.0.6-3ubuntu1
+force-badtest php-pimple/3.0.2-2ubuntu1
+force-badtest php-text-password/1.2.1-2
+force-badtest profnet/1.0.22-6
+force-badtest python-h5netcdf/0.5.0-1
+force-badtest qbzr/0.23.2-6/ppc64el qbzr/0.23.2-6/s390x
+force-badtest r-cran-maxlik/1.3-4-4/amd64
+force-badtest ruby-encryptor/3.0.0-2
+force-badtest ruby-handlebars-assets/2:0.23.2+dfsg-2
+force-badtest ruby-jquery-rails/4.3.3-1
+force-badtest ruby-rails-assets-blueimp-gallery/2.33.0-1 
+force-badtest ruby-rails-assets-diaspora-jsxc/0.1.5+dfsg2~develop.7-3
+force-badtest ruby-rspec-puppet/2.6.1-1
+force-badtest sbd/1.3.1-4/amd64
+force-badtest sextractor/2.19.5+dfsg-6/amd64
+force-badtest sfepy/2018.1-4ubuntu1/armhf
+force-badtest starjava-ttools/3.1.5-1/i386
+force-badtest svgpp/1.2.3+dfsg1-6/s390x
+# https://twistedmatrix.com/trac/ticket/9495
+force-badtest twisted/18.9.0-3
+force-badtest ubuntu-image/1.6+19.04ubuntu1
+force-badtest vagrant-lxc/1.4.3-1/amd64
+force-badtest vuls/0.6.1-1
+force-badtest yorick/2.2.04+dfsg1-10
+
+# skip tests that fail now that s390x has full VMs
+force-badtest vagrant-lxc/1.4.3-1/s390x
+force-badtest python-docker/3.4.1-4/s390x
+force-badtest libdata-uuid-libuuid-perl/0.05-3build2/s390x
+# Was skipped in lxc, never passed in a vm, questionable usefulness on s390x/ppc64el given it tests usb camera...
+force-badtest gvfs/all/s390x
+
+# flaky due to dependency on network resources
+force-badtest vagrant-mutate/1.2.0-4/armhf
+
+# Only "passed" because of an exit 0 on 32-bits, now fails to install test deps:
+force-badtest zfs-linux/all/i386 zfs-linux/all/armhf
+
+# tests broken with proxy
+force-badtest golang-github-hashicorp-atlas-go/0.0~git20170808.8261ea0-3
+force-badtest ruby-webmock/3.4.2-1
+
+# primer3 builds binary-all package but binary-arch package removed on architecture
+force-badtest primer3/2.4.0-2/s390x
+# build binary-all packages but binary-arch package removed on architecture
+force-badtest barrnap/all/i386
+force-badtest camitk/all/armhf camitk/all/arm64 camitk/all/ppc64el camitk/all/s390x
+force-badtest freecad/all/arm64
+force-badtest roary/all/i386
+force-badtest shark/all/armhf shark/all/i386
+
+# flaky
+force-badtest bdfproxy/0.3.9-3/amd64
+force-badtest jsurf-alggeo/0.4.1+ds-2
+force-badtest saods9/8.0.1+repack-2/arm64 saods9/8.0.1+repack-2/amd64
+## races the launch of an X window
+force-badtest xmobar/0.29.4-2
+
+# passed once as a fluke
+force-badtest barrnap/0.9+dfsg-1/armhf
+force-badtest dask.distributed/1.25.0+ds.1-1/s390x
+force-badtest libgd2/2.2.5-5/amd64 libgd2/2.2.5-5.1/amd64
+force-badtest node-axios/0.17.1+dfsg-1/armhf
+force-badtest makedumpfile/1:1.6.5-1ubuntu1/s390x
+
+# architectures not available; tests never should have passed
+force-badtest nanopolish/all/arm64 nanopolish/all/armhf nanopolish/all/ppc64el nanopolish/all/s390x
+
+# superseded by python-ldap
+force-badtest python-pyldap/all
+
+# this is seemingly always-failed from the history we can see but is reporting
+# regression at least on patch.  Hint this until it is investigated.
+force-badtest nvidia-graphics-drivers-340/all/armhf
+
+# fails to start if it cannot bind to [::]:53, which conflicts with systemd-resolved; LP: #1764327
+force-badtest gdnsd/2.4.0-1
+
+# only doc package on these archs
+force-badtest julia/all/i386
+force-badtest pyfai/all/ppc64el pyfai/all/s390x
+force-badtest pymca/all/ppc64el pymca/all/s390x
+force-badtest kicad/all/ppc64el
+
+# binaries removed on arch
+force-badtest trnascan-se/all/arm64 trnascan-se/all/armhf trnascan-se/all/ppc64el trnascan-se/all/s390x
+force-badtest gudhi/all/arm64
+
+# assumes /etc/init.d/networking
+force-badtest pcs/0.10.1-2
+
+# flaky / test timeouts
+force-badtest mercurial/4.8.2-1ubuntu3/arm64
+
+# Custom kernels can never pass tests, as the right meta is not
+# included, and some of these may not even run in scalingstack These
+# are therefore false-regressions, as triggered by e.g. pciutils -- xnox
+force-badtest linux-aws/all
+force-badtest linux-azure/all
+force-badtest linux-azure-edge/all
+force-badtest linux-euclid/all
+force-badtest linux-gcp/all
+force-badtest linux-gke/all
+force-badtest linux-hwe/all
+force-badtest linux-hwe-edge/all
+force-badtest linux-oem/all
+
+# regressed in release due to missing python deps and changed transitive dependencies
+force-badtest snapcraft/2.43.1+18.10
+
+# Odd_Bloke: tests don't compile in release pocket, filed https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=900367
+force-badtest xtensor-python/0.12.4-1
+
+# Was skipped in lxc, never passed in a vm, not supported on big-endian
+# https://github.com/markfasheh/ocfs2-tools/issues/22
+force-badtest ocfs2-tools/1.8.5-7/s390x ocfs2-tools/1.8.5-7build1/s390x
+
+# unsatisfiable test dep, should be ignored
+force-badtest racket-mode/all/s390x
+
+# previous pass is from a version no longer in release pocket due to removal
+force-badtest python-bayespy/0.5.17-1 python-bayespy/0.5.18-1
+
+# test failure not reproducible locally or in Debian; not worth blocking on
+force-badtest ack/2.24-1
+
+# bad proxy handling, how did this ever pass?
+force-badtest r10k/2.6.3-1 r10k/3.1.0-1
+
+# was already broken but silently passing; failure now exposed thanks to the maintainer
+force-badtest python-asdf/2.3.2-2/s390x
+
+# Test is flaky on all arches, it's a miracle it passed once:
+force-badtest pglogical/2.2.1-4
+
+# New 2.x tests fail on armhf due to slow I/O
+force-badtest pgbackrest/2.10-1/armhf
+
+# depends on ANAIS sagemath
+force-badtest sagetex/all/armhf
+
+# new test exposing existing breakage
+force-badtest dijitso/2018.1.1~git1-1/armhf
+
+# depends on desktop components no longer built on s390x
+force-badtest ubuntu-make/all/s390x
+
+# arch:all package adds test dep on unavailable package
+force-badtest libmongodb-perl/all/s390x
+force-badtest python-pbcommand/all/armhf python-pbcommand/all/i386 python-pbcommand/all/s390x
+
+# unsatisfiable indirect test dep on r-cran-v8, not available on these archs
+force-badtest r-cran-rnexml/2.3.0-1/arm64 r-cran-rnexml/2.3.0-1/s390x
+# test was previously skippable, now it fails with uninstallables because this package is x86-only
+force-badtest beignet/all/arm64 beignet/all/armhf beignet/all/ppc64el beignet/all/s390x
+
+# bad tests in new version; mwhudson knows
+force-badtest python-scipy/1.1.0-2/i386 python-scipy/1.2.1-0ubuntu1/i386
+# regressed on amd64 somewhere along the line
+force-badtest python-scipy/1.1.0-2/amd64 python-scipy/1.2.1-0ubuntu3/amd64
+
+# broken by infra; remove badtest asap - LP: #1813244
+force-badtest openvswitch/2.11.0~git20190214.a8a67726e-0ubuntu1/i386 openvswitch/2.11.0-0ubuntu2/i386
+
+# test breaks with new clisp, but not reproducible locally
+force-badtest cl-asdf/2:3.3.2-1/armhf
+force-badtest cl-unicode/20180328-2/i386
+
+# sil2100: the ubuntu-image armhf tests are failing due to some issues with mkfs.ext4 on that arch, in-progress, hard to debug. No sense in blocking migrations (LP: #1740840)
+force-badtest ubuntu-image/1.6+19.04ubuntu1/armhf
+
+# never worked, was wrongly skipped before autopkgtest was upgraded.
+force-badtest openjdk-8/8u212-b01-1
+
+# The "failure" is a progression in precision:
+force-badtest cminpack/1.3.6-4
+
+# kernel testing issues:
+#  known to be test issues
+force-badtest linux/4.19.0-13.14
+#  i386 failing anew test
+force-badtest linux/5.0.0-7.8/i386 linux/5.0.0-8.9/i386
+#  apparmor testing failure
+force-skiptest gcc-7/7.4.0-8ubuntu1 gcc-8/8.3.0-4ubuntu1
+
+# tries to connect to the network
+force-badtest gap-io/4.5.4+ds-3
+
+# the whole test suite is horrible and flaky and blocks swaths of updates
+force-badtest jekyll/3.8.3+dfsg-3 jekyll/3.8.3+dfsg-3.1 jekyll/3.8.3+dfsg-4
+
+# bad tests assume legacy eth0 as default interface; Debian bug #895342
+force-badtest suricata/1:4.1.2-2ubuntu1
+
+# broken by removal of r-cran-lwgeom
+force-badtest r-cran-sf/0.7-2+dfsg-1
+
+# something changed with loop device handling https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1814373
+force-badtest systemd/240-6ubuntu3/ppc64el
+# gdm3 subtest is flaky
+force-badtest systemd/240-6ubuntu3/arm64
+
+# broken with nodejs 10; this is a segfault in nodejs but only this package is broken and only on i386 so don't block the world for it.
+force-badtest node-yarnpkg/1.13.0-1build1/i386
+
+# binaries removed on i386
+force-badtest virtualbox/all/i386
+
+# badly-mocked test of Xen detection
+force-badtest salt/2018.3.4~git20180207+dfsg1-1/ppc64el salt/2018.3.4~git20180207+dfsg1-1/s390x
+
+# flaky/racy test that fails 5 out of 6 times on ppc64el; someone needs to fix this
+force-badtest network-manager/1.16.0-0ubuntu1/ppc64el network-manager/1.16.0-0ubuntu2/ppc64el
+
+# picard-tools is now is arch-specific and builds only amd64
+force-badtest picard-tools/all/i386
+
+# now failing with timeouts
+force-badtest haveged/1.9.1-6/armhf haveged/1.9.1-6ubuntu1/armhf
+
+# previously had no meaningful tests; test now fails because of an operation that's not allowed in containers. Debian bug #923156
+force-badtest keyutils/1.6-5/armhf
+
+# KalmanFilter gives wrong results on armhf (LP: #1819227)
+force-badtest statsmodels/0.8.0-9/armhf
+
+# cifs fails to mount with SMB3.11 and guest access
+# kernel 5.0 regression, patch available (LP: #1821053)
+force-badtest autofs/5.1.2-4ubuntu2

=== added file 'ubuntu-sru'
=== added file 'vorlon'
--- vorlon	1970-01-01 00:00:00 +0000
+++ vorlon	2019-04-08 08:46:23 +0000
@@ -0,0 +1,70 @@
+# per apw the linux autopkgtest failures should be ignored
+force-skiptest gcc-8/8.3.0-5ubuntu1 lsb/10.2019031300ubuntu1 openssl/1.1.1b-1ubuntu2
+
+force-badtest gist/all/armhf gist/all/s390x
+force-badtest ruby-parallel/all/armhf ruby-parallel/all/s390x ruby-ferret/all/armhf
+
+# regressed with move to kvm
+force-badtest coz-profiler/0.1.0-2
+
+# ANAIS
+force-badtest ruby-mongo/all/i386
+
+# regressed in release
+force-badtest ruby-httpclient/2.8.3-1ubuntu1
+force-badtest ghub-plus-el/0.3-2/s390x
+force-badtest node-sinon-chai/2.10.0-1
+force-badtest libcoap/4.1.2-1/s390x
+force-badtest zodb/1:3.10.7-1build1/amd64 zodb/1:3.10.7-1build1/i386
+force-badtest reel/0.6.1-4
+
+# how does someone write a tty-related test so bad that it passes in a container and fails in a VM?
+force-badtest pinentry/1.1.0-1build2/arm64 pinentry/1.1.0-1build2/s390x pinentry/1.1.0-1build2/i386 pinentry/1.1.0-1build2/amd64
+
+# bad test, assumes that architecture has WiFi, urfkill, dhcp.  previously it would SKIP on s390x, now it is run in nova-kvm and is treated as a regression rather than an always-failed
+force-badtest network-manager/all/s390x
+
+# passed once as a fluke
+force-badtest libanyevent-httpd-perl/0.93-5/ppc64el libanyevent-httpd-perl/all/s390x libanyevent-httpd-perl/all/armhf
+
+# regressed in release
+force-badtest libpoe-component-client-dns-perl/1:1.054-1ubuntu1
+
+# The only test that is run is a rebuild test because the integration test doesn't work in a container; a kernel build takes 7h on armhf, the max a test is allowed to run on autopkgtest is 2h47m.  Blacklist this until further notice.
+force-badtest linux-raspi2/all linux/all/armhf
+
+# pandas no longer available on armhf
+force-badtest lmfit-py/armhf/all
+
+# mongodb-server is not installable on armhf/i386; this tells us nothing of whether the client works
+force-badtest python-motor/all/armhf python-motor/all/i386
+
+# test deps now unsatisfiable because of kde removals
+force-badtest kopete/all/ppc64el kopete/all/s390x
+force-badtest libkf5ksieve/all/ppc64el libkf5ksieve/all/s390x
+force-badtest kf5-kdepim-apps-libs/all/ppc64el kf5-kdepim-apps-libs/all/s390x
+force-badtest libkf5calendarsupport/all/ppc64el libkf5calendarsupport/all/s390x
+force-badtest libkf5incidenceeditor/all/ppc64el libkf5incidenceeditor/all/s390x
+force-badtest libkf5gravatar/all/ppc64el libkf5gravatar/all/s390x
+force-badtest libkf5mailimporter/all/ppc64el libkf5mailimporter/all/s390x
+force-badtest akonadi-calendar/all/ppc64el akonadi-calendar/all/s390x
+force-badtest libkf5eventviews/all/ppc64el libkf5eventviews/all/s390x
+force-badtest kdepim-addons/all/s390x
+force-badtest kdepim-runtime/all/ppc64el kdepim-runtime/all/s390x
+force-badtest parley/all/ppc64el parley/all/s390x
+
+# "blacklisted", self-explanatory.
+force-badtest upstart/blacklisted libnih/blacklisted linux/blacklisted/i386 linux/blacklisted/amd64 linux/blacklisted/ppc64el
+force-badtest stress-ng/blacklisted
+
+# As requested by yofel: testing needed to allow a xenial SRU.
+force-badtest plasma-framework/all/s390x
+
+# bad test, but better to have this package in xenial and unblock things than leave it on the list
+force-badtest guessit/0.11.0-2
+
+# sil2100: unreliable test-suite, we don't care about qt bindings on s390x
+force-badtest python-qtpy/1.3.1-1build1/s390x
+
+# rbalint: arm64 testbed hard-reboots breaking shutdown test LP: #1748280
+force-badtest unattended-upgrades/all/arm64