Merge lp:~nacc/britney/badtest-freedombox-setup into lp:britney

Proposed by Nish Aravamudan
Status: Superseded
Proposed branch: lp:~nacc/britney/badtest-freedombox-setup
Merge into: lp:britney
Diff against target: 588 lines (+542/-0)
8 files modified
adconrad (+77/-0)
apw (+62/-0)
laney (+55/-0)
pitti (+82/-0)
stefanor (+8/-0)
stgraber (+3/-0)
tjaalton (+3/-0)
vorlon (+252/-0)
To merge this branch: bzr merge lp:~nacc/britney/badtest-freedombox-setup
Reviewer Review Type Date Requested Status
Steve Langasek Pending
Review via email: mp+337190@code.launchpad.net

Description of the change

freedombox-setup 0.11 has dropped the DEP8 tests in Debian, which is not a regression.

To post a comment you must log in.

Unmerged revisions

2763. By Nish Aravamudan

badtest: freedombox-setup/0.11

2762. By Steve Langasek

badtest octave-symbolic/{amd64,ppc64el}

2761. By Steve Langasek

bump profnet hint

2760. By Steve Langasek

bump pgpool2/armhf hint

2759. By Steve Langasek

drop finished perl hint

2758. By St├ęphane Graber

Let lttng-modules through, running out of memory during tests

2757. By Steve Langasek

badtest ruby-mongo/i386

2756. By Adam Conrad

Bump linux-meta hint

2755. By Steve Langasek

bump openvswitch hint

2754. By Adam Conrad

Bump systemd hint

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1=== added file 'adconrad'
2--- adconrad 1970-01-01 00:00:00 +0000
3+++ adconrad 2018-02-06 00:16:00 +0000
4@@ -0,0 +1,77 @@
5+# This has been flapping forever and is brute-forced with retries:
6+force-badtest haskell-hoogle/all/arm64
7+# The tests that have run look good, and we don't want to wait for all:
8+force-skiptest linux-meta/4.13.0.32.34
9+# This is regressed with s390x moving to kvm, xnox working on fixes:
10+force-badtest systemd/235-2ubuntu3/s390x systemd/235-3ubuntu2/s390x
11+# Ran out of patience and ran i386/amd64 coyote tests manually:
12+force-skiptest plplot/5.13.0+dfsg-6ubuntu2 gnudatalanguage/0.9.7-6
13+# No code changes, breaking update-manager upgrades:
14+force-skiptest gnupg1/1.4.22-3ubuntu2
15+# Consistently times out on armhf:
16+force-badtest snapcraft/2.34+17.10/armhf
17+# Regressed in release pocket:
18+force-badtest mash/1.1.1-2build2/armhf mash/2.0-2/armhf
19+force-badtest cinder/2:11.0.0-0ubuntu2/s390x
20+force-badtest node-chokidar/1.7.0-1/s390x
21+force-badtest node-platform/1.3.4-3/s390x
22+force-badtest node-yargs/6.4.0-2/armhf
23+# These tests fail now that s390x provides isolation-machine:
24+force-badtest dahdi-linux/all/s390x
25+force-badtest gsequencer/1.2.1-1/s390x
26+force-badtest libdata-uuid-libuuid-perl/0.05-3build1/s390x
27+# This test randomly times out only on i386 and has done so for eons:
28+force-badtest kwin/4:5.10.5-0ubuntu1/i386
29+# This test is flaky as all get out:
30+force-badtest golang-gopkg-lxc-go-lxc.v2/0.0~git20161126.1.82a07a6-0ubuntu7/amd64
31+# Click should never have had users on ppc64el, so carefactor zero:
32+force-badtest click/0.4.46+17.10.20170607.3-0ubuntu1/ppc64el click-apparmor/0.3.18/ppc64el
33+# Test is flaky on all arches, it's a miracle it passed once:
34+force-badtest pglogical/2.0.0-1
35+force-badtest pglogical/2.1.0-1
36+# It's a mystery that this ever passed:
37+force-badtest libffi-platypus-perl/0.45-1/amd64 libffi-platypus-perl/0.45-1build1/amd64
38+# https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=855092
39+force-badtest beets/1.3.19-2.1/i386
40+# The only remaining failure is a chicken-and-egg with lxc images not existing yet:
41+force-skiptest debootstrap/1.0.91ubuntu2
42+# Regressed in release pocket:
43+force-badtest twisted/16.6.0-2ubuntu3 twisted/17.9.0-1
44+# Depends on x86-only libngs-java
45+force-badtest beagle/all/armhf beagle/all/ppc64el beagle/all/s390x
46+force-badtest fastqc/all/armhf fastqc/all/ppc64el fastqc/all/s390x
47+# Depends on stuff no longer built:
48+force-badtest libcatmandu-store-mongodb-perl/all/i386
49+force-badtest roary/all/armhf roary/all/s390x
50+force-badtest pbgenomicconsensus/all/i386
51+# Not built on i386, the test might not work:
52+force-badtest pbh5tools/all/i386
53+# Not built on ppc64el or s390x, so whee:
54+force-badtest phyml/all/ppc64el
55+force-badtest phyml/all/s390x
56+# Mysteriously passed once, and never again:
57+force-badtest vagrant-libvirt/0.0.40-1/amd64 vagrant-libvirt/0.0.40-1/s390x
58+# Racy test, debugging in progress, but shouldn't prevent dep migration:
59+force-badtest libpam-alreadyloggedin/0.3-6
60+# Regression exists in release and proposed:
61+force-badtest r-bioc-annotationhub/2.8.1-1build1 r-bioc-annotationhub/2.10.1-1
62+force-badtest r-bioc-biocparallel/1.10.1-1build1/s390x
63+# Alignment error exposed by no longer doing fixups on test infra:
64+force-badtest ruby-ferret/0.11.8.6-2
65+# Infra-related, not the package:
66+force-badtest libdbd-mysql-perl/all/s390x
67+# debootstrap's tests are a flaming heap in containers:
68+force-badtest debootstrap/all/s390x
69+# ACC Test broken by new GCC: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=837162
70+force-badtest purpose/1.1-5ubuntu2
71+force-badtest gpgmepp/16.04.3-2
72+force-badtest libkf5kdgantt2/4:16.04.3-0ubuntu1
73+force-badtest telepathy-logger-qt/15.04.0-2
74+# fails only on lxc hosts
75+force-badtest sbuild/all/armhf sbuild/all/s390x
76+# Not a regression from the previous version:
77+force-badtest kdepim-runtime/all/armhf
78+# profnet-snapfun test is regressed in both release and proposed:
79+force-badtest profnet/1.0.22-4build2 profnet/1.0.22-5
80+# needs to be taught about bionic, queued for 2.29:
81+force-badtest snapd/2.28.5+17.10
82
83=== added file 'apw'
84--- apw 1970-01-01 00:00:00 +0000
85+++ apw 2018-02-06 00:16:00 +0000
86@@ -0,0 +1,62 @@
87+# While copying kernels forward from xenial it rather too easy for linux
88+# to slip out without the testing being fully reviewed. As britney is not
89+# able to track previous failures correctly for kernels.
90+block linux
91+block linux-raspi2
92+block linux-snapdragon
93+
94+# Development kernel unblocks:
95+unblock linux/4.13.0-32.35
96+unblock linux-raspi2/4.13.0-1008.8
97+unblock linux-snapdragon/4.4.0-1081.86
98+
99+#
100+# arm* removed in zesty-proposed hint in-progress tests against them.
101+force-badtest sunpy/all/armhf
102+
103+# dkms failures here are actually kernel 4.9 related
104+force-badtest kpatch/0.3.2-3ubuntu1
105+
106+# broken by python 2.7
107+force-badtest freecad/0.16+dfsg2-3build3/ppc64el freecad/0.16+dfsg2-3build3/s390x
108+force-badtest freecad/0.16.6712+dfsg1-1/ppc64el freecad/0.16.6712+dfsg1-1/s390x
109+force-badtest freecad/0.16.6712+dfsg1-1build1/ppc64el freecad/0.16.6712+dfsg1-1build1/s390x
110+force-badtest freecad/0.16.6712+dfsg1-1ubuntu1/ppc64el freecad/0.16.6712+dfsg1-1ubuntu1/s390x
111+
112+# python-pysam does not (and never has) built on armhf and i386
113+force-badtest python-pysam/all/armhf python-pysam/all/i386
114+
115+# ginggs -- monkeysign ... unexpected pass
116+force-badtest monkeysign/2.2.3/i386 monkeysign/2.2.3/armhf monkeysign/2.2.3/ppc64el
117+
118+# kde is splittins apps out of this package, it is not relevant to those split apps.
119+force-badtest kde-baseapps/4:16.04.3-0ubuntu1
120+
121+# 14-feb-2017: armhf test non-installable
122+force-badtest python-cobra/all/armhf
123+
124+# wireguard should never have got into a stable release (LP: #1685522)
125+block wireguard
126+
127+# ginggs: this is an old existing error on armhf, masked by another error in all arches.
128+force-badtest r-cran-dplyr/0.5.0-1ubuntu4/armhf r-cran-dplyr/0.7.4-2/armhf
129+
130+# samtools got removed on armhf and s390x
131+force-badtest winff/1.5.5-4/armhf
132+
133+# lttgng-modules failure on ppc64el is an internal compiler error
134+force-badtest lttng-modules/2.9.0-1ubuntu3/ppc64el
135+force-badtest lttng-modules/2.9.0-1ubuntu4/ppc64el
136+
137+# python-scipy/i386 is failing due a bug in the tests, do not want to trigger
138+# a whole new set of tests to fix it.
139+force-badtest python-scipy/0.19.1-2ubuntu1/i386
140+
141+# snapd/s390x testing is failing becuase it is now in nova
142+force-badtest snapd/2.29.4.1+18.04/s390x snapd/2.29.4.2+18.04/s390x
143+
144+# openssl/1.0.2g-1ubuntu14 being held by an unrelated ruby test failure
145+force-skiptest openssl/1.0.2g-1ubuntu14
146+
147+# two failing tests are not related to sphinx
148+force-skiptest sphinx/1.6.5-3
149
150=== added file 'arges'
151=== added file 'brian-murray'
152=== added file 'cjwatson'
153=== added file 'freeze'
154=== added file 'jriddell'
155=== added file 'kitterman'
156=== added file 'laney'
157--- laney 1970-01-01 00:00:00 +0000
158+++ laney 2018-02-06 00:16:00 +0000
159@@ -0,0 +1,55 @@
160+# libpinyin 2.1.0-1~exp3 takes over libzhuyin's binaries
161+force-badtest libzhuyin/1.1.1-1
162+
163+# isolation-machine, needs thunderbird which isn't available
164+force-badtest firejail/all/s390x
165+
166+# 21/11 17:37:35 <ginggs> would some kind soul please 'force-badtest r-bioc-ensembldb/2.2.0-1' ? all of the autopkgtests now need https://bioconductor.org/packages/release/data/annotation/html/EnsDb.Hsapiens.v75.html which is 75MB in size and no plans to package it in debian
167+# (testsuite to be dropped in debian with the next upload)
168+force-badtest r-bioc-ensembldb/2.2.0-1
169+
170+# someone manually triggered these, unfortunately logs don't go back far enough
171+force-badtest akonadi-calendar/4:17.04.3-0ubuntu1/s390x akonadi-calendar/4:17.04.3-0ubuntu1/ppc64el
172+force-badtest libkf5eventviews/4:17.04.3-0ubuntu1/s390x libkf5eventviews/4:17.04.3-0ubuntu1/ppc64el
173+
174+# acheronuk asked for this to be ignored, will report upstream (LP: https://bugs.launchpad.net/ubuntu/+source/konqueror/+bug/1732680)
175+force-badtest konqueror/4:17.04.3-0ubuntu1
176+
177+# passed once by fluke on armhf it seems
178+
179+force-badtest ostree/all/armhf
180+
181+# according to xnox, autopkgtest-build-lxc doesn't work in nplan-only images
182+# any more we're switching to cloud VMs soon for s390x; don't invest time in
183+# fixing the LXC backend up right now. Drop this when we're switched over.
184+
185+force-badtest nplan/all/s390x
186+
187+# https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1699772
188+force-badtest libreoffice/1:5.4.2-0ubuntu5/i386 libreoffice/1:5.4.3-0ubuntu1/i386
189+
190+# mongo isn't built for armhf/i386 any more
191+force-badtest flask-mongoengine/all/i386
192+force-badtest mongodb/all/i386
193+force-badtest flask-mongoengine/all/armhf
194+force-badtest mongodb/all/armhf
195+
196+# FTBFS, no package on this arch, unclear how it passed(!)
197+force-badtest python-fitsio/all/armhf
198+
199+# Field3D only supports Ogawa-backed files on little-endian systems.
200+force-badtest field3d/all/s390x
201+
202+# @INC problem; not perl 5.24
203+force-badtest eekboek/2.02.05+dfsg-2
204+force-badtest slice/1.3.8-13
205+
206+# pre-existing, skipped last time
207+force-badtest parcimonie/all/s390x
208+
209+# bad test which fails if the test runner can't reach the public Internet.
210+# LP: #1427982
211+force-badtest libtest-requiresinternet-perl/0.05-2
212+
213+# kubuntu doesn't care about s390x
214+force-badtest okular/all/s390x
215
216=== added file 'pitti'
217--- pitti 1970-01-01 00:00:00 +0000
218+++ pitti 2018-02-06 00:16:00 +0000
219@@ -0,0 +1,82 @@
220+# new PEP-8 errors with zesty's newer pep8 tool; don't bump!
221+force-badtest rpmlint/1.9-6
222+
223+# segfaults on 32 bit
224+force-badtest baloo-kf5/all/i386 baloo-kf5/all/armhf
225+
226+# LP: #1510060
227+force-badtest apt-clone/0.4.1ubuntu2
228+
229+# started failing with move to lxd on armhf
230+force-badtest pbuilder/all/armhf
231+
232+#
233+# blacklisted for test runs as they kill testbeds
234+#
235+#
236+force-badtest stress-ng/all/ppc64el
237+
238+#
239+# flaky, universe, nobody cares in Ubuntu
240+#
241+#
242+force-badtest beets/all/s390x
243+# times out
244+force-badtest c2esp/all/armhf
245+force-badtest debci/1.7 debci/1.7.1
246+force-badtest elasticsearch-curator/4.2.5-1 elasticsearch-curator/5.2.0-1
247+# takes painfully long, times out on armhf, testing on x86 is enough
248+force-badtest epson-inkjet-printer-escpr/all/armhf
249+# works in manual run
250+force-badtest eso-midas/17.02pl1.2-2build1/s390x
251+# got broken with new python2.7
252+force-badtest flufl.lock/2.4.1-1
253+force-badtest gjs/all/s390x
254+force-badtest gtml/3.5.4-21/s390x gtml/3.5.4-22/s390x
255+force-badtest jsurf-alggeo/0.3.0+ds-1
256+force-badtest julia/all/i386
257+force-badtest libcgi-application-plugin-captcha-perl/0.04-2
258+# broken test if git is installed
259+force-badtest libdist-zilla-plugin-githubmeta-perl/0.52-1
260+force-badtest mercurial/all/armhf
261+# SIGBUS
262+force-badtest ostree/all/i386
263+# flaky on s390x, alwaysfail on others
264+force-badtest palabos/s390x/all
265+force-badtest pdns/all
266+# fails to install in yakkety
267+force-badtest pdns-recursor/4.0.6-1/ppc64el
268+force-badtest pbsuite/all/all
269+force-badtest php-horde-http/2.1.7-1
270+force-badtest php-horde-icalendar/all/armhf php-horde-icalendar/all/i386
271+force-badtest postgresql-multicorn/1.3.3-2ubuntu2
272+force-badtest puppet-module-asciiduck-sssd/0.3.0-1
273+force-badtest python-publicsuffix/1.1.0-2
274+force-badtest python-ruffus/2.6.3+dfsg-4/amd64
275+force-badtest pyzmq/all/s390x pyzmq/all/armhf
276+force-badtest rexical/1.0.5-2build1
277+force-badtest ruby-amq-protocol/all/s390x
278+force-badtest ruby-augeas/1:0.5.0-3build4
279+# Debian #816161
280+force-badtest ruby-awesome-print/1.6.1-2
281+force-badtest ruby-fakeweb/1.3.0+git20131202.48208f9+dfsg-3
282+force-badtest ruby-kaminari/0.17.0-3
283+force-badtest ruby-minitest-excludes/2.0.0-1
284+force-badtest ruby-mixlib-shellout/2.2.6-1
285+force-badtest ruby-rack/1.6.4-4
286+force-badtest ruby-roadie-rails/1.1.0-1
287+force-badtest ruby-sshkit/all/s390x
288+force-badtest ruby-test-unit/3.2.5-1/amd64
289+force-badtest ruby-typhoeus/all/armhf
290+force-badtest ruby-webmock/3.0.1-1
291+force-badtest s3ql/2.23+dfsg-1 s3ql/2.24+dfsg-1
292+# samtools got removed on armhf and s390x
293+force-badtest fastaq/all/armhf fastaq/all/s390x
294+force-badtest smalt/all/armhf smalt/all/s390x
295+force-badtest zodb/1:3.10.5+1.gb28a24c-1
296+
297+#
298+# ignored stuff for CI train (vivid)
299+#
300+
301+force-badtest nvidia-graphics-drivers-340/all/armhf
302
303=== added file 'raof'
304=== added file 'stefanor'
305--- stefanor 1970-01-01 00:00:00 +0000
306+++ stefanor 2018-02-06 00:16:00 +0000
307@@ -0,0 +1,8 @@
308+# autodep8 bug #832567
309+force-badtest ruby-cucumber-wire/0.0.1-2
310+
311+# pbbam is currently FTBFS on 32bit Debian: #829741
312+force-badtest pbsuite/15.8.24+dfsg-2/i386
313+
314+# https://github.com/jelmer/dulwich/issues/541
315+force-badtest dulwich/0.18.5-1/s390x
316
317=== added file 'stgraber'
318--- stgraber 1970-01-01 00:00:00 +0000
319+++ stgraber 2018-02-06 00:16:00 +0000
320@@ -0,0 +1,3 @@
321+# Running out of memory in dkms test
322+force-badtest lttng-modules/2.10.5-1/amd64
323+force-badtest lttng-modules/2.10.5-1/ppc64el
324
325=== added file 'tjaalton'
326--- tjaalton 1970-01-01 00:00:00 +0000
327+++ tjaalton 2018-02-06 00:16:00 +0000
328@@ -0,0 +1,3 @@
329+# hardly ever passes, blocks pyasn1 from migrating
330+force-badtest bdfproxy/0.3.9-1ubuntu1/amd64
331+
332
333=== added file 'vorlon'
334--- vorlon 1970-01-01 00:00:00 +0000
335+++ vorlon 2018-02-06 00:16:00 +0000
336@@ -0,0 +1,252 @@
337+# ANAIS
338+force-badtest ruby-mongo/all/i386
339+
340+# package removed from release, no point in keeping it out due to 32-bit-specific autopkgtest failure
341+force-badtest why/2.39-2build1/i386 why/2.39-2build1/armhf
342+
343+# missing test dep on fakeroot
344+force-badtest gsequencer/1.1.4-1
345+
346+# ignore an unrelated systemd failure and straggling results
347+force-skiptest perl/5.26.1-4
348+
349+# only passes in a newer version.
350+force-badtest slurm-llnl/17.02.9-1/armhf slurm-llnl/17.02.9-1/i386
351+
352+# failing kernel autopkgtest not caused by a no-change rebuild of gdb
353+force-badtest linux/4.14.0-13.15/s390x
354+
355+# broken by new flake8
356+force-badtest ubuntu-image/1.3+18.04ubuntu1
357+
358+# regressed in release due to changed output of 'ip route get'
359+force-badtest freeipa/4.4.4-3ubuntu1
360+
361+# unfortunately unreliable
362+force-badtest systemd/235-3ubuntu3
363+
364+# regressed in release
365+force-badtest dogtag-pki/10.3.5+12-5
366+force-badtest ruby-httpclient/2.8.3-1ubuntu1
367+force-badtest octave-symbolic/2.6.0-2/amd64 octave-symbolic/2.6.0-2/ppc64el
368+
369+# how does someone write a tty-related test so bad that it passes in a container and fails in a VM?
370+force-badtest pinentry/1.0.0-3/s390x pinentry/1.0.0-3/arm64
371+
372+# unclear how this test ever passed on Ubuntu, with its misuse of nc and general non-functioning
373+force-badtest zorp/6.0.10-3
374+
375+# Was skipped in lxc, never passed in a vm, should be "always failed"
376+force-badtest lxcfs/2.0.8-1ubuntu2/s390x
377+
378+# Was skipped in lxc, never passed in a vm, not supported on big-endian
379+# https://github.com/markfasheh/ocfs2-tools/issues/22
380+force-badtest ocfs2-tools/1.8.5-2/s390x
381+force-badtest ocfs2-tools/1.8.5-3ubuntu1/s390x
382+
383+# Was skipped in lxc, never passed in a vm, questionable usefulness on s390x/ppc64el given it tests usb camera...
384+force-badtest gvfs/1.34.1-1ubuntu3/s390x gvfs/1.34.1-1ubuntu3/ppc64el gvfs/1.34.1-1ubuntu4/s390x gvfs/1.34.1-1ubuntu4/ppc64el
385+
386+# Did previously pass, but upstream (pitti) say the failing avocado test is bogus and will be removed in the next upload
387+force-badtest cockpit/156-1/s390x
388+
389+# bad test, assumes that architecture has WiFi, urfkill, dhcp. previously it would SKIP on s390x, now it is run in nova-kvm and is treated as a regression rather than an always-failed
390+force-badtest network-manager/all/s390x
391+
392+# Skip tests that fail now that s390x has full VMs
393+force-badtest dahdi-linux/1:2.11.1~dfsg-1ubuntu3/s390x
394+force-badtest firejail/0.9.50-3/s390x
395+force-badtest vagrant-lxc/1.2.1-3ubuntu1/s390x
396+force-badtest c-icap/1:0.4.4-1/s390x
397+
398+# regresses with perl/5.26.1-2ubuntu1 but doesn't look like a perl bug, so don't block perl migration
399+force-badtest libtest-valgrind-perl/1.19-1/ppc64el
400+
401+# postgresql-common hard-codes the list of supported Ubuntu releases and throws a warning if not recognized.
402+force-badtest slony1-2/2.2.6-1
403+
404+# nonsensical error with new perl; allow it to regress to let perl migrate
405+force-badtest libdata-dpath-perl/0.55-1 libdata-dpath-perl/0.57-1
406+
407+# broken with newer glibc
408+force-badtest snapcraft/2.34+17.10/amd64 snapcraft/2.34+17.10/i386
409+
410+# testing triggered from autodep-8: the kernel contains matching modules which causes an installation
411+# failure when used with a kernel which contains them.
412+force-badtest virtualbox/5.1.28-dfsg-3
413+
414+# dependencies removed on these archs
415+force-badtest astroml/all/s390x astroml/all/ppc64el
416+
417+# passed once as a fluke
418+force-badtest libanyevent-httpd-perl/0.93-5/ppc64el libanyevent-httpd-perl/all/s390x libanyevent-httpd-perl/all/armhf
419+
420+# assumes /etc/init.d/networking
421+force-badtest pcs/0.9.159-3ubuntu2 pcs/0.9.161-1
422+
423+# passed once as a fluke
424+force-badtest mbuffer/20161115-1/ppc64el mbuffer/20171011-1/ppc64el
425+
426+# regressed in release
427+force-badtest nut/2.7.4-5.1ubuntu1/s390x nut/2.7.4-5.1ubuntu2/s390x
428+force-badtest mailman3-core/3.1.0-1
429+force-badtest libpoe-component-client-dns-perl/1:1.054-1ubuntu1
430+force-badtest libanyevent-yubico-perl/0.9.3-1/ppc64el
431+force-badtest grr/3.1.0.2+dfsg-4
432+force-badtest cacti/1.1.27+ds1-3/armhf
433+force-badtest xandikos/0.0.6-2/amd64 xandikos/0.0.6-2/i386
434+force-badtest kio/5.38.0-0ubuntu1/amd64 kio/5.38.0-0ubuntu1/i386
435+force-badtest python-py/1.4.34-3
436+force-badtest bubblewrap/0.2.0-2/i386
437+# hicolor-icon-theme
438+force-badtest pyxdg/0.25-4
439+
440+# tests that hit the network and are proxy-aware but not passing in scalingstack. Infrastructure bug, don't block.
441+force-badtest python-mechanicalsoup/0.7.0-1
442+
443+# regressed in release; maybe related to resolved/netplan.
444+force-badtest ifupdown/0.8.16ubuntu2/ppc64el
445+
446+# regressed in release due to demotion of resolvconf
447+force-badtest open-iscsi/2.0.874-4ubuntu2/amd64
448+
449+# broken by infra; remove badtest asap - LP: #1736390
450+force-badtest openvswitch/2.8.1-0ubuntu2/i386 openvswitch/2.8.1-0ubuntu3/i386
451+
452+# The only test that is run is a rebuild test because the integration test doesn't work in a container; a kernel build takes 7h on armhf, the max a test is allowed to run on autopkgtest is 2h47m. Blacklist this until further notice.
453+force-badtest linux-raspi2/all linux/all/armhf
454+
455+# regressed in release
456+force-badtest udisks2/2.6.5-2ubuntu2/ppc64el
457+force-badtest htslib/1.5-1/i386
458+
459+# flaky
460+force-badtest mysql-5.7/5.7.19-0ubuntu1/i386
461+
462+# passed once as a fluke
463+force-badtest casync/2-1ubuntu1/ppc64el
464+# and flaky on other archs
465+force-badtest casync/2-1ubuntu1/amd64 casync/2-1ubuntu1/i386 casync/2-1ubuntu1/s390x
466+
467+# regressed in release
468+force-badtest pdb2pqr/2.1.1+dfsg-2
469+force-badtest gap-guava/3.13+ds-2/i386 gap-guava/3.13+ds-2/s390x gap-guava/3.13+ds-2/amd64
470+
471+# regressed in release due to compiler strictness (stderr)
472+force-badtest globjects/1.1.0-2/armhf
473+force-badtest mathicgb/1.0~git20170606-1/armhf
474+force-badtest primesieve/5.7.2+ds-2/armhf
475+
476+# testdep removed from archive
477+force-badtest mercurial/4.3.1-2 mercurial/4.4.1-1
478+
479+# now failing with timeouts
480+force-badtest haveged/1.9.1-6/armhf
481+
482+# regressed in release
483+force-badtest yorick/2.2.04+dfsg1-6build1
484+
485+# pandas no longer available on armhf
486+force-badtest lmfit-py/armhf/all
487+
488+# regressed in release (udev/container related)
489+force-badtest pgpool2/armhf/3.6.6-2 pgpool2/armhf/3.6.7-1
490+
491+# still bad
492+force-badtest bareos/14.2.6-3 bareos/16.2.6-1
493+
494+# flaky test
495+force-badtest tracker/all/s390x
496+
497+# flaky / timeouts
498+force-badtest node-tap/8.0.0-4ubuntu5/armhf
499+
500+# regressed in release due to gdata
501+force-badtest r-cran-surveillance/1.13.0-1build1
502+
503+# regressed in release; possibly all due to the same cause of something updating in the perl auto test infrastructure
504+force-badtest license-reconcile/0.14
505+force-badtest libsoap-wsdl-perl/3.003-2
506+force-badtest libjson-validator-perl/0.92+dfsg-1
507+force-badtest libdist-zilla-util-configdumper-perl/0.003007-1
508+force-badtest bioperl/1.7.1-2 bioperl/1.7.1-3
509+force-badtest bio-tradis/1.3.3+dfsg-1 bio-tradis/1.3.3+dfsg-2
510+
511+# mongodb-server is not installable on armhf/i386; this tells us nothing of whether the client works
512+force-badtest python-motor/all/armhf python-motor/all/i386
513+
514+# already broken in release
515+force-badtest ddcci-driver-linux/0.3.1-1/s390x
516+
517+# test deps now unsatisfiable because of kde removals
518+force-badtest kopete/all/ppc64el kopete/all/s390x
519+force-badtest libkf5ksieve/all/ppc64el libkf5ksieve/all/s390x
520+force-badtest kf5-kdepim-apps-libs/all/ppc64el kf5-kdepim-apps-libs/all/s390x
521+force-badtest libkf5calendarsupport/all/ppc64el libkf5calendarsupport/all/s390x
522+force-badtest libkf5incidenceeditor/all/ppc64el libkf5incidenceeditor/all/s390x
523+force-badtest libkf5gravatar/all/ppc64el libkf5gravatar/all/s390x
524+force-badtest libkf5mailimporter/all/ppc64el libkf5mailimporter/all/s390x
525+force-badtest akonadi-calendar/all/ppc64el akonadi-calendar/all/s390x
526+force-badtest libkf5eventviews/all/ppc64el libkf5eventviews/all/s390x
527+force-badtest kdepim-addons/all/s390x
528+force-badtest kdepim-runtime/all/ppc64el kdepim-runtime/all/s390x
529+
530+# non-empty stderr with new g++
531+force-badtest glbinding/2.1.1-1/armhf
532+
533+# passes once in a blue moon, just often enough to gum things up.
534+force-badtest pyzmq/16.0.2-2build2
535+
536+# was already broken but silently passing; failure now exposed thanks to the maintainer
537+force-badtest python-asdf/1.2.1-2/s390x python-asdf/1.3.1-1/s390x
538+
539+# regressed in release by unknown means
540+force-badtest qbzr/0.23.2-2ubuntu2/ppc64el qbzr/0.23.2-2ubuntu2/s390x
541+
542+# regressed due to new warnings from gcc
543+force-badtest fast5/0.5.8-1build3/armhf ciftilib/1.5.1-1 ciftilib/1.5.1-1build1
544+
545+# regressed in release pocket
546+force-badtest octave-io/2.4.7-1build1/armhf octavio-/2.4.8-1/armhf
547+
548+force-badtest aptdaemon/1.1.1+bzr982-0ubuntu17
549+
550+# "blacklisted", self-explanatory.
551+force-badtest upstart/blacklisted libnih/blacklisted linux/blacklisted/i386 linux/blacklisted/amd64 linux/blacklisted/ppc64el
552+force-badtest stress-ng/blacklisted
553+
554+# regressed in release in some way related to gphoto2 tests
555+force-badtest umockdev/0.9.2-1
556+
557+# regression of unknown origin
558+force-badtest kpatch/0.3.2-3ubuntu1/amd64
559+
560+# As requested by yofel: testing needed to allow a xenial SRU.
561+force-badtest plasma-framework/all/s390x
562+
563+# breaks with firefox 49, which (with this hint) we are allowing into the release
564+force-badtest y-u-no-validate/2013052407-3
565+
566+# bad test, but better to have this package in xenial and unblock things than leave it on the list
567+force-badtest guessit/0.11.0-2
568+
569+# sil2100: snapd/amd64 started failing in release for unknown reasons
570+force-badtest snapd/2.29.4.2+18.04/amd64
571+
572+# sil2100: the ubuntu-image armhf tests are failing due to some issues with mkfs.ext4 on that arch, in-progress, hard to debug. No sense in blocking migrations (LP: #1740840)
573+force-badtest ubuntu-image/1.3+18.04ubuntu1/armhf ubuntu-image/1.3+18.04ubuntu2/armhf
574+
575+# sil2100: click-apparmor run_testsuite-as-root is now failing for armhf - apparently we no longer care about click *at all*
576+force-badtest click-apparmor/0.3.18/armhf
577+
578+# sil2100: <mvo> our integration test fails because the snap store changed
579+force-badtest snapd/2.29.4.2+18.04/ppc64el
580+
581+# broken in bionic, fixed in -proposed. override to unblock various things.
582+force-badtest 389-ds-base/1.3.7.5-1build2
583+
584+# sil2100: started failing in bionic, ruby2.3 will go away anyway soon
585+force-badtest ruby2.3/2.3.6-2/arm64
586+
587+# nacc: tests removed from Debian
588+force-badtest freedombox-setup/0.11

Subscribers

People subscribed via source and target branches

to all changes: