Code review comment for lp:~paelzer/britney/hints-ubuntu-bionic-linux-fails-march-2019

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Sometimes it helps to check if only a few subtests usually fail to mask those, here an info on the stats overall of the last 40 runs:
$ check-autopkgtest-stats.sh -p linux -r bionic -c 40 -a i386 -P "^TestFail: Test failed"
Check last 40 test results for src:linux on releases 'bionic' on architectures 'i386'
Fetch Data to /tmp/tmp.dFoc5ZtuBN
Of the 40 last tests, we had these subtest failing per release/arch:

bionic
  i386
      1 rebuild ( 2.50%) ....................F...................
     40 ubuntu-regression-suite (100.00%) FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF

Pattern found, sum/order found patterns
     17 TestFail: Test failed for ftrace
     17 TestFail: Test failed for net
     17 TestFail: Test failed for seccomp
     15 TestFail: Test failed for timers

So those seem to be involved at least half the time of the last series of 100% fails.
I also found some test timeouts and some breaking on "/mnt/vfat-test-4902 is already mounted" and such.

Anyway - the TL;DR is that atm the i386 test for src:linux seems not useful and gates a lot of packages (I guess there will be more over time).

« Back to merge proposal