Merge lp:~racb/britney/mysql-8.0-migration into lp:britney

[Robie Basak]

Unmerged revisions

3962. By Robie Basak on 2019-10-10

force-badtest false positives needed for mysql-8.0 migration

3961. By Iain Lane on 2019-10-10

badtest network-manager/i386, needs kernel headers

3960. By Adam Conrad on 2019-10-10

badtest resource-agents/1:4.2.0-1ubuntu2/arm64

3959. By Adam Conrad on 2019-10-09

Skip some open-iscsi-using tests on i386.

3958. By Adam Conrad on 2019-10-09

Remove obsolete easy kernel hint.

3957. By Andy Whitcroft on 2019-10-09

kernels: remove blocks for real kernels

Signed-off-by: Andy Whitcroft <email address hidden>

3956. By Steve Langasek on 2019-10-09

Drop some obsolete hints

3955. By Steve Langasek on 2019-10-09

badtest python-azure

3954. By Steve Langasek on 2019-10-09

Drop some obsolete hints

3953. By Adam Conrad on 2019-10-08

Update glibc hints.

=== added file 'adconrad'
--- adconrad	1970-01-01 00:00:00 +0000
+++ adconrad	2019-10-10 12:49:09 +0000
@@ -0,0 +1,56 @@
+# Test depends on python3-lupa, which doesn't exist on ppc64el:
+force-badtest python-fakeredis/all/ppc64el
+# Times out far too often to be reliable:
+force-badtest mysql-8.0/8.0.16-0ubuntu3/arm64 mysql-8.0/8.0.17-0ubuntu1/arm64
+# Regressed in release pocket:
+force-badtest node-platform/1.3.5-1/s390x
+force-badtest node-yargs/10.0.3-2
+# These tests fail now that s390x provides isolation-machine:
+force-badtest dahdi-linux/all/s390x
+# Depends on x86-only libngs-java
+force-badtest beagle/all/armhf beagle/all/ppc64el beagle/all/s390x
+force-badtest fastqc/all/armhf fastqc/all/ppc64el fastqc/all/s390x
+# Depends on stuff no longer built:
+force-badtest libcatmandu-store-mongodb-perl/all/i386
+force-badtest roary/all/armhf roary/all/s390x
+force-badtest pbgenomicconsensus/all/i386
+# Not built on i386, the test might not work:
+force-badtest pbh5tools/all/i386
+# Mysteriously passed once, and never again:
+force-badtest vagrant-libvirt/0.0.45-2/amd64 vagrant-libvirt/0.0.45-2/s390x
+# debootstrap's tests are a flaming heap in containers:
+force-badtest debootstrap/all/s390x
+# fails only on lxc hosts
+force-badtest sbuild/all/armhf
+# The libreoffice failures are clearly not kio's fault:
+force-skiptest kio/5.53.0-0ubuntu1
+# Upstream ticket filed: https://github.com/citusdata/postgresql-hll/issues/67
+force-badtest postgresql-hll/2.12-3
+force-skiptest pulseaudio/1:12.2-2ubuntu3
+force-skiptest libxslt/1.1.32-2ubuntu0.1
+# Remaining failures are not apparmor's fault:
+force-skiptest apparmor/2.13.2-9ubuntu6
+# vim and debootstrap have nothing to do with docker's lack of lxd images:
+force-skiptest vim/2:8.1.0320-1ubuntu4
+force-skiptest debootstrap/1.0.114ubuntu1
+# Beta unblocks:
+unblock mate-netbook/1.22.2-0ubuntu1
+unblock ubuntu-meta/1.436
+unblock ubuntu-mate-meta/1.253
+unblock ubuntukylin-meta/0.39
+unblock ubuntu-budgie-meta/0.52
+unblock ubiquity-slideshow-ubuntu/148
+unblock update-manager/1:19.04.8
+unblock ubuntu-mate-guide/19.10.0-0ubuntu1
+unblock ubuntu-mate-artwork/19.10.9
+unblock efivar/37-2ubuntu2
+unblock ubuntu-wallpapers/19.10.2-0ubuntu1
+unblock ubuntustudio-look/0.66
+# This has had enough testing, considering the change:
+force-skiptest iptables/1.8.3-2ubuntu5
+unblock iptables/1.8.3-2ubuntu5
+force-skiptest grub2/2.04-1ubuntu6
+unblock grub2/2.04-1ubuntu6
+unblock grub2-signed/1.122
+unblock ubiquity/19.10.12
+unblock casper/1.419
 
=== added file 'apw'
--- apw	1970-01-01 00:00:00 +0000
+++ apw	2019-10-10 12:49:09 +0000
@@ -0,0 +1,46 @@
+# While copying kernels forward from xenial it rather too easy for linux
+# to slip out without the testing being fully reviewed.  As britney is not
+# able to track previous failures correctly for kernels.
+#block linux
+#block linux-aws
+#block linux-azure
+#block linux-gcp
+#block linux-kvm
+block linux-oem
+block linux-oem-osp1
+#block linux-oracle
+#block linux-raspi2
+block linux-snapdragon
+
+# Development kernel unblocks:
+#unblock linux/5.0.0-20.21
+#unblock linux-aws/5.0.0-1012.13
+#unblock linux-azure/5.0.0-1018.19
+#unblock linux-gcp/5.0.0-1015.15
+#unblock linux-kvm/5.0.0-1015.16
+unblock linux-oem/4.15.0-1056.65
+unblock linux-oem-osp1/5.0.0-1022.24
+#unblock linux-oracle/4.15.0-1018.20
+#unblock linux-raspi2/5.0.0-1017.17
+unblock linux-snapdragon/5.0.0-1021.22
+
+# linux-raspi on arm64 fails in such a way that it is not identified as a failure.  Therefore
+# the tests never complete and the package can never migrate.  skiptest this once the armhf
+# testing is complete and good.
+force-skiptest linux-meta-raspi2/4.18.0.1005.2
+
+#
+# arm* removed in zesty-proposed hint in-progress tests against them.
+force-badtest sunpy/all/armhf
+
+# python-pysam does not (and never has) built on armhf and i386
+force-badtest python-pysam/all/armhf python-pysam/all/i386
+
+# 14-feb-2017: armhf test non-installable
+force-badtest python-cobra/all/armhf
+
+# linux-gcp/armhf -- does not even build here, so tests here cannot be relevant
+force-badtest linux-gcp/all/armhf
+
+# Skip an unrelated linux/s390x test failure.
+force-skiptest gcc-7/7.3.0-29ubuntu1
 
=== added file 'arges'
=== added file 'brian-murray'
=== added file 'freeze'
=== added file 'laney'
--- laney	1970-01-01 00:00:00 +0000
+++ laney	2019-10-10 12:49:09 +0000
@@ -0,0 +1,49 @@
+# needs kernel headers, not available on i386 any more, waiting for advice on how to proceed
+force-badtest network-manager/all/i386
+
+# test-deps can't be installed due to python-jsondiff and python-jsonpatch not being coinstallable; currently being fixed in eoan-proposed
+force-badtest diffoscope/125
+
+# not built here
+force-badtest gazebo/all/arm64 gazebo/all/armhf gazebo/all/ppc64el
+
+# bustle removed on ppc64el, test-deps now uninstallable
+force-badtest dbus-test-runner/all/ppc64el
+
+# new test, 'accidentally' passed on s390x once
+force-badtest at-spi2-atk/all/s390x
+
+# gnome-shell is not built on s390x
+force-badtest gnome-shell-pomodoro/all/s390x
+
+# this went from neutral to fail and we should not be considering that a regression, but we do, because we suck
+force-badtest onioncircuits/all
+
+# remaining failures (network-manager/amd64 oss4/x86)
+force-skiptest glib2.0/2.61.1-2
+
+# seems broken in release & for a while
+force-badtest gerris/20131206+dfsg-18build2/armhf
+ 
+# isolation-machine, needs thunderbird which isn't available
+force-badtest firejail/all/s390x
+
+# passed once by fluke on armhf it seems
+
+force-badtest ostree/all/armhf
+
+# mongo isn't built for armhf/i386 any more
+force-badtest flask-mongoengine/all/i386
+force-badtest mongodb/all/i386
+force-badtest flask-mongoengine/all/armhf
+force-badtest mongodb/all/armhf
+
+# FTBFS, no package on this arch, unclear how it passed(!)
+force-badtest python-fitsio/all/armhf
+
+# Field3D only supports Ogawa-backed files on little-endian systems.
+force-badtest field3d/all/s390x
+
+# bad test which fails if the test runner can't reach the public Internet.
+# LP: #1427982
+force-badtest libtest-requiresinternet-perl/0.05-2
 
=== added file 'pitti'
--- pitti	1970-01-01 00:00:00 +0000
+++ pitti	2019-10-10 12:49:09 +0000
@@ -0,0 +1,40 @@
+# new PEP-8 errors with zesty's newer pep8 tool; don't bump!
+force-badtest rpmlint/1.9-6
+
+# segfaults on 32 bit
+force-badtest baloo-kf5/all/i386 baloo-kf5/all/armhf
+
+# started failing with move to lxd on armhf
+force-badtest pbuilder/all/armhf
+
+#
+# blacklisted for test runs as they kill testbeds
+#
+#
+force-badtest stress-ng/blacklisted/ppc64el
+
+#
+# flaky, universe, nobody cares in Ubuntu
+#
+#
+force-badtest beets/all/s390x
+# times out
+force-badtest c2esp/all/armhf
+# takes painfully long, times out on armhf, testing on x86 is enough
+force-badtest epson-inkjet-printer-escpr/all/armhf
+force-badtest gjs/all/s390x
+force-badtest libcgi-application-plugin-captcha-perl/0.04-2
+# flaky on s390x, alwaysfail on others
+force-badtest palabos/s390x/all
+force-badtest pdns/all
+force-badtest php-horde-http/2.1.7-3
+force-badtest php-horde-icalendar/all/armhf php-horde-icalendar/all/i386
+force-badtest python-publicsuffix/1.1.0-2
+force-badtest pyzmq/all/s390x pyzmq/all/armhf
+force-badtest rexical/1.0.5-2build1
+force-badtest ruby-amq-protocol/all/s390x
+force-badtest ruby-augeas/1:0.5.0-3build6
+# Debian #816161
+force-badtest ruby-minitest-excludes/2.0.0-1
+force-badtest ruby-mixlib-shellout/2.2.6-1
+force-badtest ruby-sshkit/all/s390x
 
=== added file 'racb'
=== added file 'raof'
=== added file 'sil2100'
--- sil2100	1970-01-01 00:00:00 +0000
+++ sil2100	2019-10-10 12:49:09 +0000
@@ -0,0 +1,8 @@
+# Some more R badtests that are failing, some of which basically from the start
+force-badtest r-cran-memoise/1.1.0-2/armhf
+
+# Temporarily badtest the current release puppet as now it's failing due to a deprecation warning printed out to stderr. This is fixed in the -proposed puppet but that one still needs some work to be migrate-able.
+force-badtest puppet/5.4.0-2ubuntu3
+
+# virtualbox stopped providing its binary package on i386, on which the ext-pack tests depend on.
+force-badtest virtualbox-ext-pack/all/i386
 
=== added file 'stefanor'
=== added file 'stgraber'
=== added file 'tjaalton'
=== added file 'ubuntu-release'
--- ubuntu-release	1970-01-01 00:00:00 +0000
+++ ubuntu-release	2019-10-10 12:49:09 +0000
@@ -0,0 +1,363 @@
+# https://trello.com/c/ogFUzPsO/33-cant-install-snaps-in-autopkgtest-lxd-containers
+force-badtest kopano-webapp/all/armhf
+
+# passed previously in containers, now fails everywhere
+force-badtest ruby-fakeweb/1.3.0+git20170806+dfsg1-1.1
+
+# regressed in release
+force-badtest abi-monitor/1.12-2/armhf abi-monitor/1.12-2/i386
+## deliberate arch exclusion, not understood by dkms autodep8 test.
+force-badtest acpi-call/all/armhf acpi-call/all/ppc64el acpi-call/all/s390x
+##
+force-badtest adequate/0.15.1ubuntu5
+force-badtest apt-clone/0.4.1ubuntu2
+force-badtest bacula/9.4.2-2ubuntu3
+force-badtest barbican/1:9.0.0~b1~git2019061315.3c2a9960-0ubuntu1/armhf barbican/1:9.0.0~rc1-0ubuntu1/armhf
+force-badtest beanstalkd/1.11-1
+force-badtest bzr/2.7.0+bzr6622-17ubuntu1
+force-badtest bubblewrap/0.3.3-2/s390x
+force-badtest changeme/1.2.1-1
+force-badtest cinfony/1.2-4ubuntu1
+force-badtest courier-filter-perl/0.200+ds-4
+force-badtest cryfs/0.9.10-2/i386
+## briefly passed but can never work on s390x; LP: #1837073
+force-badtest ddcci-driver-linux/all/s390x
+##
+force-badtest debci/2.0
+## fails to build on armhf: https://github.com/codahale/bcrypt-ruby/issues/201
+force-badtest diaspora-installer/0.7.6.1+debian1/ppc64el diaspora-installer/0.7.6.1+debian1/armhf
+##
+force-badtest dmarc-cat/0.9.2-4
+force-badtest fdroidserver/1.1.1-1ubuntu1
+force-badtest firewalld/0.7.1-1ubuntu9
+## regression in one codec when built with new toolchain
+force-badtest ffmpeg/7:4.1.4-1build2/armhf
+## behaves the same as 0.5.0-1 under linux 4.15 and 5.0 with old and new fuse:
+force-badtest fuse-zip/0.6.0-0ubuntu1
+##
+force-badtest ghub-plus-el/0.3-5/s390x
+## requires netstat without dependency
+force-badtest gitlab-workhorse/7.6.0+debian-1
+## x32 tests now run and fail on i386 with amd64 kernels, whee:
+force-badtest glibc/2.30-0ubuntu2/i386
+##
+force-badtest htslib/1.9-10/i386
+force-badtest kpatch/0.5.0-0ubuntu2/amd64
+force-badtest libfile-userconfig-perl/0.06-4/i386
+force-badtest libmonitoring-livestatus-perl/0.80-1
+force-badtest libterm-filter-perl/0.03-2/arm64 libterm-filter-perl/0.03-2/i386
+force-badtest libtest-valgrind-perl/1.19-1/ppc64el
+force-badtest link-grammar/5.6.2-1ubuntu1/armhf link-grammar/5.6.2-1ubuntu1/i386
+## test of 5.3.0-13.14 pulls in 5.3.0-16.17 to rebuild and that fails
+force-badtest linux/5.3.0-16.17/i386
+## broken with new gcc, needs rebase on 5.2
+force-badtest linux-kvm/5.0.0-1015.16
+force-badtest linux-oem-osp1/5.0.0-1022.24
+##
+force-badtest mira/4.9.6-4build1/ppc64el
+force-badtest mothur/1.42.1-1/i386
+force-badtest node-buble/0.19.4-3build2
+force-badtest node-gulp-coffee/2.3.4-1/arm64
+force-badtest node-rollup/0.50.0-6build3
+force-badtest ocfs2-tools/1.8.6-1ubuntu1
+force-badtest octave-image/2.10.0-2/amd64 octave-image/2.10.0-2/i386 octave-image/2.10.0-2/ppc64el
+force-badtest openstack-trove/1:12.0.0~rc1-0ubuntu2
+force-badtest ostree/2019.3-1/ppc64el
+force-badtest panko/7.0.0~rc1-0ubuntu1 panko/7.0.0~b2~git2019073019.07f2d20b-0ubuntu1
+## python2 test deps removed; will be resolved in the next version
+force-badtest pandas/0.23.3+dfsg-3ubuntu1
+## autopkgtest depends on procenv not being ftbfs, procenv regressed due to toolchain changes
+force-badtest pbuilder/0.230.4
+##
+force-badtest php-horde-exception/2.0.8-2ubuntu1
+force-badtest php-horde-util/2.5.8-1ubuntu1
+force-badtest php-horde-serialize/2.0.5-3ubuntu1
+force-badtest php-horde-support/2.2.0-1ubuntu1
+force-badtest php-horde-view/2.0.6-3ubuntu1
+force-badtest php-pimple/3.0.2-2ubuntu1
+force-badtest php-text-password/1.2.1-2
+force-badtest profnet/1.0.22-6
+force-badtest prometheus/2.7.1+ds-3
+## uninstallable
+force-badtest prometheus-blackbox-exporter/0.13.0+ds-2/i386
+##
+force-badtest puppet-module-asciiduck-sssd/0.3.0-1
+force-badtest python-adal/1.2.1-1
+force-badtest python-azure/20181112+git-3
+force-badtest python-pysam/0.15.2+ds-2
+force-badtest r-bioc-biocparallel/1.18.1-1/armhf
+force-badtest r-bioc-bitseq/1.28.0+dfsg-1
+force-badtest r-bioc-deseq2/1.24.0+dfsg-1/i386
+force-badtest r-bioc-pcamethods/1.76.0-1
+force-badtest r-bioc-rhdf5/2.28.0+dfsg-1
+force-badtest r-bioc-rhtslib/1.16.1+dfsg-1
+force-badtest r-bioc-variantannotation/1.30.1-1
+force-badtest r-cran-data.table/1.12.2+dfsg-1
+force-badtest r-cran-fs/1.3.1+dfsg-1
+force-badtest r-cran-later/0.8.0+dfsg-1
+force-badtest r-cran-mice/3.6.0-1
+force-badtest r-cran-pdftools/2.2-1
+force-badtest r-cran-svglite/1.2.2-1
+force-badtest r-cran-vctrs/0.2.0-1
+force-badtest reprotest/0.7.8/i386
+force-badtest roary/3.12.0+dfsg-3
+force-badtest ruby-encryptor/3.0.0-2
+force-badtest ruby-ferret/0.11.8.6-2build3/arm64
+force-badtest ruby-jquery-rails/4.3.3-1
+force-badtest ruby-rack/2.0.6-3
+force-badtest ruby-rails-assets-blueimp-gallery/2.33.0-1 
+force-badtest ruby-rails-assets-diaspora-jsxc/0.1.5+dfsg2~develop.7-3
+force-badtest ruby-rspec-puppet/2.6.1-1
+force-badtest rust-utf8-ranges/1.0.4-1
+## autopkgtest depends on procenv not being ftbfs, procenv regressed due to toolchain changes
+force-badtest sbuild/0.78.1-2ubuntu1
+##
+force-badtest sextractor/2.19.5+dfsg-6/amd64
+force-badtest spice/0.14.2-0ubuntu2/ppc64el
+force-badtest spyder-memory-profiler/0.1.2-1/s390x
+force-badtest stunnel4/3:5.55-2build1
+force-badtest svgpp/1.2.3+dfsg1-6/s390x
+## https://twistedmatrix.com/trac/ticket/9495
+force-badtest twisted/18.9.0-3ubuntu1
+##
+force-badtest ubuntu-make/18.09+disco1
+force-badtest udisks2/2.8.4-1
+force-badtest unicycler/0.4.7+dfsg-2/amd64
+force-badtest unrar-free/1:0.0.1+cvs20140707-4/ppc64el
+## video pre-dependencies dropped from s390x kernel
+force-badtest v4l2loopback/all/s390x
+##
+force-badtest vagrant-lxc/1.4.3-1/amd64
+force-badtest vuls/0.6.1-1
+## toolchain-triggered build regression
+force-badtest webcamoid/8.6.1+dfsg-2/ppc64el
+##
+force-badtest yorick/2.2.04+dfsg1-10
+
+# skip tests that fail now that s390x has full VMs
+force-badtest vagrant-lxc/1.4.3-1/s390x
+force-badtest python-docker/3.4.1-4/s390x
+force-badtest libdata-uuid-libuuid-perl/0.05-3build2/s390x
+# Was skipped in lxc, never passed in a vm, questionable usefulness on s390x/ppc64el given it tests usb camera...
+force-badtest gvfs/all/s390x
+# doesn't fail every time, but is now very flaky
+force-badtest gvfs/1.42.1-1ubuntu1/ppc64el
+
+# flaky due to dependency on network resources
+force-badtest vagrant-mutate/1.2.0-4/armhf
+
+# Only "passed" because of an exit 0 on 32-bits, now fails to install test deps:
+force-badtest zfs-linux/all/i386 zfs-linux/all/armhf
+
+# tests broken with proxy
+force-badtest golang-github-hashicorp-atlas-go/0.0~git20170808.8261ea0-3
+force-badtest ruby-webmock/3.4.2-1
+
+# primer3 builds binary-all package but binary-arch package removed on architecture
+force-badtest primer3/2.4.0-2/s390x
+# build binary-all packages but binary-arch package removed on architecture
+force-badtest camitk/all/armhf camitk/all/arm64 camitk/all/ppc64el camitk/all/s390x
+force-badtest deal.ii/all/arm64
+
+# flaky
+force-badtest bambam/1.0.1+dfsg-1/s390x
+force-badtest bdfproxy/0.3.9-3/amd64
+force-badtest deepnano/0.0+git20170813.e8a621e-3
+force-badtest jsurf-alggeo/0.4.1+ds-3
+force-badtest packer/1.3.4+dfsg-4/arm64
+force-badtest saods9/8.0.1+repack-2/arm64 saods9/8.0.1+repack-2/amd64
+## possibly borderline memory usage; may benefit from huge_packages treatment
+force-badtest scikit-learn/0.20.2+dfsg-6/amd64 scikit-learn/0.20.3+dfsg-0ubuntu2/amd64
+## races the launch of an X window
+force-badtest xmobar/0.29.4-2build1
+
+# passed once as a fluke
+force-badtest aptdaemon/1.1.1+bzr982-0ubuntu28/arm64
+force-badtest barrnap/0.9+dfsg-1/armhf
+force-badtest dask.distributed/1.25.0+ds.1-1/s390x
+force-badtest libgd2/2.2.5-5.2/amd64
+force-badtest makedumpfile/all/s390x
+
+# never passed, previously neutral, now failing
+force-badtest mysql-connector-c++/1.1.12-4ubuntu1/arm64 mysql-connector-c++/1.1.12-4ubuntu1/s390x
+force-badtest rust-byteorder/1.3.2-1
+force-badtest rust-md5-asm/0.4.3-2
+force-badtest rust-rayon/1.1.0-2/armhf rust-rayon/1.1.0-2/i386
+
+# used to pass, now failing, evidently due to test platform failures rather
+# than the object of the tests
+force-badtest mysql-connector-c++/1.1.12-4ubuntu1/ppc64el
+force-badtest libreoffice/1:6.3.2-0ubuntu2/armhf
+
+# architectures not available; tests never should have passed
+force-badtest nanopolish/all/arm64 nanopolish/all/armhf nanopolish/all/ppc64el nanopolish/all/s390x
+
+# superseded by python-ldap
+force-badtest python-pyldap/all
+
+# this is seemingly always-failed from the history we can see but is reporting
+# regression at least on patch.  Hint this until it is investigated.
+force-badtest nvidia-graphics-drivers-340/all/armhf
+
+# fails to start if it cannot bind to [::]:53, which conflicts with systemd-resolved; LP: #1764327
+force-badtest gdnsd/2.4.2-1
+
+# only doc package on these archs
+force-badtest julia/all/i386
+force-badtest pyfai/all/ppc64el pyfai/all/s390x
+force-badtest pymca/all/ppc64el pymca/all/s390x
+force-badtest kicad/all/ppc64el
+
+# binaries removed on arch
+force-badtest trnascan-se/all/arm64 trnascan-se/all/armhf trnascan-se/all/ppc64el trnascan-se/all/s390x
+force-badtest gudhi/all/arm64
+force-badtest libnanomsg-raw-perl/all/armhf
+force-badtest golang-github-go-debos-fakemachine/all/arm64 golang-github-go-debos-fakemachine/all/i386
+force-badtest macsyfinder/1.0.5-3/arm64 macsyfinder/1.0.5-3/armhf macsyfinder/1.0.5-3/ppc64el macsyfinder/1.0.5-3/s390x
+force-badtest sysbench/all/armhf
+
+# depends on corosync, which is not container-friendly
+force-badtest pcs/0.10.2-1/armhf
+
+# flaky / test timeouts
+force-badtest mercurial/4.8.2-1ubuntu4/arm64
+
+# Custom kernels can never pass tests, as the right meta is not
+# included, and some of these may not even run in scalingstack These
+# are therefore false-regressions, as triggered by e.g. pciutils -- xnox
+force-badtest linux-aws/all
+force-badtest linux-azure/all
+force-badtest linux-gcp/all
+force-badtest linux-gke/all
+force-badtest linux-oem/all
+# fails rebuild test due to timeouts, but linux/arm64 passes
+force-badtest linux-snapdragon/all
+
+# Was skipped in lxc, never passed in a vm, not supported on big-endian
+# https://github.com/markfasheh/ocfs2-tools/issues/22
+force-badtest ocfs2-tools/1.8.6-1ubuntu1/s390x
+
+# unsatisfiable test dep, should be ignored
+force-badtest racket-mode/all/s390x
+
+# previous pass is from a version no longer in release pocket due to removal
+force-badtest python-bayespy/0.5.18-1
+
+# test failure not reproducible locally or in Debian; not worth blocking on
+force-badtest ack/3.0.2-1
+
+# bad proxy handling, how did this ever pass?
+force-badtest r10k/3.1.0-1
+
+# was already broken but silently passing; failure now exposed thanks to the maintainer
+force-badtest python-asdf/2.3.2-2/s390x python-asdf/2.3.3-1ubuntu1/s390x
+
+# Test is flaky on all arches, it's a miracle it passed once:
+force-badtest pglogical/2.2.2-1
+
+# new test exposing existing breakage
+force-badtest dijitso/2018.1.1~git1-1/armhf dijitso/2019.1.0-2/armhf
+
+# depends on desktop components no longer built on s390x
+force-badtest ubuntu-make/all/s390x
+
+# arch:all package adds test dep on unavailable package
+force-badtest libmongodb-perl/all/s390x
+force-badtest python-pbcommand/all/armhf python-pbcommand/all/i386 python-pbcommand/all/s390x
+
+# unsatisfiable indirect test dep on r-cran-v8, not available on these archs
+force-badtest r-cran-rnexml/2.3.0-1/arm64 r-cran-rnexml/2.3.0-1/s390x
+# test was previously skippable, now it fails with uninstallables because this package is x86-only
+force-badtest beignet/all/arm64 beignet/all/armhf beignet/all/ppc64el beignet/all/s390x
+
+# bad tests in new version; mwhudson knows
+force-badtest python-scipy/1.2.2-4/i386
+
+# test breaks with new clisp, but not reproducible locally
+force-badtest cl-unicode/20180328-2/i386
+
+# The "failure" is a progression in precision:
+force-badtest cminpack/1.3.6-4
+
+# the whole test suite is horrible and flaky and blocks swaths of updates
+force-badtest jekyll/3.8.3+dfsg-6
+
+# bad tests assume legacy eth0 as default interface; Debian bug #895342
+force-badtest suricata/1:4.1.2-2ubuntu1
+
+# something changed with loop device handling https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1814373
+# root-unittests fail on armhf starting with v242 LP: #1845201
+# i386 changed to use an amd64 kernel and this breaks systemd which uses uname -m
+force-badtest systemd/242-7ubuntu1/ppc64el systemd/242-7ubuntu1/i386
+
+# broken with nodejs 10; this is a segfault in nodejs but only this package is broken and only on i386 so don't block the world for it.
+force-badtest node-yarnpkg/1.13.0-1build1/i386
+
+# binaries removed on i386
+force-badtest virtualbox/all/i386
+
+# picard-tools is now is arch-specific and builds only amd64
+force-badtest picard-tools/all/i386
+
+# now failing with timeouts
+force-badtest haveged/1.9.1-6ubuntu1/armhf
+
+# KalmanFilter gives wrong results on armhf (LP: #1819227)
+force-badtest statsmodels/0.8.0-9ubuntu1/armhf
+
+# not a regression; new test that shows the existing package is broken
+force-badtest dcfldd/1.3.4.1-13/i386 dcfldd/1.3.4.1-13/armhf
+
+# mis-tagged as a regression
+force-badtest mailman/1:2.1.29-1/amd64
+
+# never passed, only skipped. rebuild test is broken for this package
+force-badtest linux-oracle/all
+
+# how does someone write a tty-related test so bad that it passes in a container and fails in a VM?
+force-badtest pinentry/1.1.0-3/amd64 pinentry/1.1.0-3/arm64 pinentry/1.1.0-3/s390x pinentry/1.1.0-3/i386
+
+# 5.2 kernel broke it LP: #1838476
+force-badtest conntrack-tools/1:1.4.5-2
+
+# part of the test was skipped, now if fails differently
+# also this is being worked on in LPs: #1741860, #1681909
+force-badtest makedumpfile/1:1.6.6-2ubuntu1/ppc64el
+
+# tests probably always failed, but the testsuite didn't capture error codes properly
+force-badtest flexi-streams/20181214.git0fd872a-1/armhf flexi-streams/20181214.git0fd872a-1/i386
+
+# i386 uninteresting for redis
+force-badtest golang-github-go-redis-redis/6.15.0-1/i386
+
+# i386 uninteresting as a host generally
+force-badtest apport/all/i386
+force-badtest bcmwl/all/i386
+force-badtest casper/all/i386
+force-badtest crash/all/i386
+force-badtest firewalld/0.7.1-1ubuntu9/i386
+force-badtest node-nodedbi/1.0.13+dfsg-1/i386
+force-badtest nvidia-graphics-drivers-340/all/i386
+force-badtest nvidia-graphics-drivers-390/all/i386
+force-badtest virtualbox-hwe/all/i386
+
+# test failures previously ignored in error
+force-badtest trivial-features/20161107.git29ab1da-2/arm64 trivial-features/20161107.git29ab1da-2/armhf
+
+# allow tests to regress to let astropy+cfitsio transition in; Debian bug #932688
+force-badtest astroplan/0.4-4
+
+# regressed, now fails build test but so does the release version
+force-badtest packer/1.3.4+dfsg-4/ppc64el
+
+# depends on snapshot.debian.org not returning 503s
+force-badtest unattended-upgrades/1.14ubuntu1/amd64
+
+# depends on sbcl, not available on these archs
+force-badtest slime/2:2.24+dfsg-1ubuntu1/ppc64el slime/2:2.24+dfsg-1ubuntu1/s390x
+
+# tests use open-isci, where i386 tools don't appear to work on amd64 kernels:
+force-badtest resource-agents/all/i386 multipath-tools/all/i386 tgt/all/i386
+
+# Appears to have regressed in release; could use investigation:
+force-badtest resource-agents/1:4.2.0-1ubuntu2/arm64
 
=== added file 'ubuntu-sru'
=== added file 'vorlon'
--- vorlon	1970-01-01 00:00:00 +0000
+++ vorlon	2019-10-10 12:49:09 +0000
@@ -0,0 +1,62 @@
+# ubuntu-image tests broken by linux-libc-dev being missing on i386
+force-skiptest livecd-rootfs/2.6.14
+
+force-badtest gist/all/armhf gist/all/s390x
+force-badtest ruby-parallel/all/armhf ruby-parallel/all/s390x ruby-ferret/all/armhf
+
+# regressed with move to kvm
+force-badtest coz-profiler/0.1.0-2
+
+# ANAIS
+force-badtest ruby-mongo/all/i386
+
+# regressed in release
+force-badtest ruby-httpclient/2.8.3-1ubuntu1
+force-badtest node-sinon-chai/2.10.0-1
+force-badtest libcoap/4.1.2-1/s390x
+force-badtest reel/0.6.1-4
+
+# bad test, assumes that architecture has WiFi, urfkill, dhcp.  previously it would SKIP on s390x, now it is run in nova-kvm and is treated as a regression rather than an always-failed
+force-badtest network-manager/all/s390x
+
+# passed once as a fluke
+force-badtest libanyevent-httpd-perl/0.93-5/ppc64el libanyevent-httpd-perl/all/s390x libanyevent-httpd-perl/all/armhf
+
+# regressed in release
+force-badtest libpoe-component-client-dns-perl/1:1.054-1ubuntu1
+
+# The only test that is run is a rebuild test because the integration test doesn't work in a container; a kernel build takes 7h on armhf, the max a test is allowed to run on autopkgtest is 2h47m.  Blacklist this until further notice.
+force-badtest linux-raspi2/all linux/all/armhf
+
+# pandas no longer available on armhf
+force-badtest lmfit-py/armhf/all
+
+# mongodb-server is not installable on armhf/i386; this tells us nothing of whether the client works
+force-badtest python-motor/all/armhf python-motor/all/i386
+
+# test deps now unsatisfiable because of kde removals
+force-badtest kopete/all/ppc64el kopete/all/s390x
+force-badtest libkf5ksieve/all/ppc64el libkf5ksieve/all/s390x
+force-badtest kf5-kdepim-apps-libs/all/ppc64el kf5-kdepim-apps-libs/all/s390x
+force-badtest libkf5calendarsupport/all/ppc64el libkf5calendarsupport/all/s390x
+force-badtest libkf5incidenceeditor/all/ppc64el libkf5incidenceeditor/all/s390x
+force-badtest libkf5gravatar/all/ppc64el libkf5gravatar/all/s390x
+force-badtest libkf5mailimporter/all/ppc64el libkf5mailimporter/all/s390x
+force-badtest akonadi-calendar/all/ppc64el akonadi-calendar/all/s390x
+force-badtest libkf5eventviews/all/ppc64el libkf5eventviews/all/s390x
+force-badtest kdepim-addons/all/s390x
+force-badtest kdepim-runtime/all/ppc64el kdepim-runtime/all/s390x
+force-badtest parley/all/ppc64el parley/all/s390x
+
+# "blacklisted", self-explanatory.
+force-badtest linux/blacklisted/i386 linux/blacklisted/amd64 linux/blacklisted/ppc64el
+force-badtest stress-ng/blacklisted
+
+# As requested by yofel: testing needed to allow a xenial SRU.
+force-badtest plasma-framework/all/s390x
+
+# sil2100: unreliable test-suite, we don't care about qt bindings on s390x
+force-badtest python-qtpy/1.3.1-1build1/s390x
+
+# rbalint: arm64 testbed hard-reboots breaking shutdown test LP: #1748280
+force-badtest unattended-upgrades/all/arm64