Merge ~paelzer/autopkgtest-cloud:avoid-oom-on-fio-based-tests-hirsute into autopkgtest-cloud:master

[Christian Ehrhardt ]

[Christian Ehrhardt  (paelzer)]

fio does in >=hirsute increase memory consumption a lot and thereby
can bump these two tests that utilize fio into OOMs.

For details see:
https://bugs.launchpad.net/ubuntu/+source/multipath-tools/+bug/1903962
https://github.com/axboe/fio/issues/1123

[Iain Lane (laney)]

This is not ideal because big tests take up 4x as much quota as regular ones, affecting our throughput when the queues are loaded, so could you please make sure to work on being able to remove this when possible?

Thanks

review: Approve

[Christian Ehrhardt  (paelzer)]

Yeah I'm already on it together with upstream to get it resolved eventually.

I have submitted to MPs for the Debian packages that own the tests
https://salsa.debian.org/debian/tgt/-/merge_requests/1
https://salsa.debian.org/linux-blocks-team/multipath-tools/-/merge_requests/1

Once they are merged and uploaded we can revert this big_package hint again.

diff --git a/worker-config-production/worker-bos01-arm64.conf b/worker-config-production/worker-bos01-arm64.conf
index 8777619..d915e02 100644
--- a/worker-config-production/worker-bos01-arm64.conf
+++ b/worker-config-production/worker-bos01-arm64.conf
@@ -16,7 +16,7 @@ releases = trusty xenial bionic focal groovy hirsute
 architectures = arm64
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts lintian cl-ironclad samtools mysql-8.0 satpy python-cffi yt scipy skimage node-immutable-tuple node-redis gscan2pdf cwltool
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts lintian cl-ironclad samtools mysql-8.0 satpy python-cffi yt scipy skimage node-immutable-tuple node-redis gscan2pdf cwltool multipath-tools tgt
 long_tests = glibc gutenprint gmp-ecm lintian open-iscsi diffoscope snapcraft snapd cross-toolchain-base automake-1.16 salt epson-inkjet-printer-escpr haveged
 blacklist = bionic/arm64/stress-ng bionic/arm64/upstart bionic/arm64/libnih bionic/arm64/r-cran-vioplot bionic/arm64/openjdk-lts focal/arm64/openjdk-lts groovy/arm64/openjdk-lts xenial/arm64/virtualbox-ext-pack bionic/arm64/virtualbox-ext-pack focal/arm64/openjdk-13 groovy/arm64/openjdk-13 focal/arm64/openjdk-14 groovy/arm64/openjdk-14 hirsute/arm64/openjdk-lts hirsute/arm64/openjdk-13 hirsute/arm64/openjdk-14 hirsute/arm64/rust-onig hirsute/arm64/debuerreotype
 
diff --git a/worker-config-production/worker-bos01-ppc64el.conf b/worker-config-production/worker-bos01-ppc64el.conf
index 53e6fc1..d1a96cc 100644
--- a/worker-config-production/worker-bos01-ppc64el.conf
+++ b/worker-config-production/worker-bos01-ppc64el.conf
@@ -16,7 +16,7 @@ releases = trusty xenial bionic focal groovy hirsute
 architectures = ppc64el
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 makedumpfile samtools satpy python-cffi yt scipy skimage puma cross-toolchain-base cwltool
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 makedumpfile samtools satpy python-cffi yt scipy skimage puma cross-toolchain-base cwltool multipath-tools tgt
 long_tests = gutenprint gmp-ecm open-iscsi diffoscope snapcraft snapd systemd systemd-upstream cross-toolchain-base
 blacklist = bionic/ppc64el/stress-ng bionic/ppc64el/upstart bionic/ppc64el/libnih bionic/ppc64el/r-cran-vioplot bionic/ppc64el/openjdk-lts xenial/ppc64el/virtualbox-ext-pack bionic/ppc64el/virtualbox-ext-pack hirsute/ppc64el/rust-onig hirsute/ppc64el/debuerreotype
 
diff --git a/worker-config-production/worker-bos01-s390x.conf b/worker-config-production/worker-bos01-s390x.conf
index 63fce8e..d22b4e6 100644
--- a/worker-config-production/worker-bos01-s390x.conf
+++ b/worker-config-production/worker-bos01-s390x.conf
@@ -16,7 +16,7 @@ releases = trusty xenial bionic focal groovy hirsute
 architectures = s390x
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 samtools satpy python-cffi yt scipy
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 samtools satpy python-cffi yt scipy multipath-tools tgt
 long_tests = gutenprint gmp-ecm open-iscsi diffoscope snapcraft snapd cross-toolchain-base
 blacklist = bionic/s390x/stress-ng bionic/s390x/upstart bionic/s390x/libnih bionic/s390x/r-cran-vioplot bionic/s390x/openjdk-lts xenial/s390x/virtualbox-ext-pack bionic/s390x/virtualbox-ext-pack hirsute/s390x/rust-onig hirsute/s390x/debuerreotype
 
diff --git a/worker-config-production/worker-bos01.conf b/worker-config-production/worker-bos01.conf
index 8bcc249..7229b42 100644
--- a/worker-config-production/worker-bos01.conf
+++ b/worker-config-production/worker-bos01.conf
@@ -16,7 +16,7 @@ releases = trusty xenial bionic focal groovy hirsute
 architectures = ppc64el
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 samtools satpy python-cffi yt skimage
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 samtools satpy python-cffi yt skimage multipath-tools tgt
 long_tests = gutenprint gmp-ecm open-iscsi diffoscope snapcraft snapd cross-toolchain-base
 blacklist = bionic/ppc64el/stress-ng bionic/ppc64el/upstart bionic/ppc64el/libnih bionic/ppc64el/r-cran-vioplot bionic/ppc64el/openjdk-lts hirsute/ppc64el/rust-onig
 
diff --git a/worker-config-production/worker-bos02-arm64.conf b/worker-config-production/worker-bos02-arm64.conf
index 31f3fe6..9cbf01e 100644
--- a/worker-config-production/worker-bos02-arm64.conf
+++ b/worker-config-production/worker-bos02-arm64.conf
@@ -16,7 +16,7 @@ releases = trusty xenial bionic focal groovy hirsute
 architectures = arm64
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts lintian cl-ironclad samtools mysql-8.0 satpy python-cffi yt scipy skimage node-immutable-tuple node-redis gscan2pdf cwltool
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts lintian cl-ironclad samtools mysql-8.0 satpy python-cffi yt scipy skimage node-immutable-tuple node-redis gscan2pdf cwltool multipath-tools tgt
 long_tests = glibc gutenprint gmp-ecm lintian open-iscsi diffoscope snapcraft snapd cross-toolchain-base automake-1.16 salt epson-inkjet-printer-escpr haveged
 blacklist = bionic/arm64/stress-ng bionic/arm64/upstart bionic/arm64/libnih bionic/arm64/r-cran-vioplot bionic/arm64/openjdk-lts focal/arm64/openjdk-lts groovy/arm64/openjdk-lts xenial/arm64/virtualbox-ext-pack bionic/arm64/virtualbox-ext-pack focal/arm64/openjdk-13 focal/arm64/openjdk-13 focal/arm64/openjdk-14 focal/arm64/openjdk-14 hirsute/arm64/openjdk-lts hirsute/arm64/openjdk-13 hirsute/arm64/openjdk-14 hirsute/arm64/rust-onig hirsute/arm64/debuerreotype
 
diff --git a/worker-config-production/worker-bos02-ppc64el.conf b/worker-config-production/worker-bos02-ppc64el.conf
index c20e9aa..305c174 100644
--- a/worker-config-production/worker-bos02-ppc64el.conf
+++ b/worker-config-production/worker-bos02-ppc64el.conf
@@ -16,7 +16,7 @@ releases = trusty xenial bionic focal groovy hirsute
 architectures = ppc64el
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 pandas makedumpfile samtools satpy python-cffi yt scipy skimage puma cross-toolchain-base cwltool
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 pandas makedumpfile samtools satpy python-cffi yt scipy skimage puma cross-toolchain-base cwltool multipath-tools tgt
 long_tests = gutenprint gmp-ecm open-iscsi diffoscope snapcraft snapd systemd systemd-upstream cross-toolchain-base
 blacklist = bionic/ppc64el/stress-ng bionic/ppc64el/upstart bionic/ppc64el/libnih bionic/ppc64el/r-cran-vioplot bionic/ppc64el/openjdk-lts xenial/ppc64el/virtualbox-ext-pack bionic/ppc64el/virtualbox-ext-pack hirsute/ppc64el/rust-onig hirsute/ppc64el/debuerreotype
 
diff --git a/worker-config-production/worker-bos02-s390x.conf b/worker-config-production/worker-bos02-s390x.conf
index 63fce8e..d22b4e6 100644
--- a/worker-config-production/worker-bos02-s390x.conf
+++ b/worker-config-production/worker-bos02-s390x.conf
@@ -16,7 +16,7 @@ releases = trusty xenial bionic focal groovy hirsute
 architectures = s390x
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 samtools satpy python-cffi yt scipy
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 samtools satpy python-cffi yt scipy multipath-tools tgt
 long_tests = gutenprint gmp-ecm open-iscsi diffoscope snapcraft snapd cross-toolchain-base
 blacklist = bionic/s390x/stress-ng bionic/s390x/upstart bionic/s390x/libnih bionic/s390x/r-cran-vioplot bionic/s390x/openjdk-lts xenial/s390x/virtualbox-ext-pack bionic/s390x/virtualbox-ext-pack hirsute/s390x/rust-onig hirsute/s390x/debuerreotype
 
diff --git a/worker-config-production/worker-canonistack.conf b/worker-config-production/worker-canonistack.conf
index 9234935..9f11aae 100644
--- a/worker-config-production/worker-canonistack.conf
+++ b/worker-config-production/worker-canonistack.conf
@@ -17,7 +17,7 @@ releases = trusty xenial
 architectures = i386 amd64
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-cran-igraph botch mathicgb ganeti lttng-modules python2.7 python3.6 python3.7 python3.8 python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 samtools satpy python-cffi yt
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-cran-igraph botch mathicgb ganeti lttng-modules python2.7 python3.6 python3.7 python3.8 python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 samtools satpy python-cffi yt multipath-tools tgt
 long_tests = gutenprint gmp-ecm open-iscsi diffoscope
 
 [virt]
diff --git a/worker-config-production/worker.conf b/worker-config-production/worker.conf
index 6e4acbf..36b807f 100644
--- a/worker-config-production/worker.conf
+++ b/worker-config-production/worker.conf
@@ -16,7 +16,7 @@ releases = precise trusty xenial bionic focal groovy hirsute
 architectures = i386 amd64
 setup_command = $AUTOPKGTEST_CLOUD_DIR/worker-config-production/setup-canonical.sh
 setup_command2 = $CHECKOUTDIR/setup-commands/setup-testbed
-big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python2.7 python3.6 python3.7 python3.8 python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 nodejs cl-ironclad python-scipy scipy cross-toolchain-base-mipsen mkl-dnn samtools satpy python-cffi yt skimage scikit-learn silx statsmodels puma
+big_packages = binutils chromium-browser glibc libreoffice linux linux-* tdb firefox akonadi julia meson python-cryptography python-dmsh pyresample libtext-bidi-perl python-hypothesis nova rocs camitk kineticstools r-bioc-variantannotation r-cran-igraph botch mathicgb ganeti lttng-modules python2.7 python3.6 python3.7 python3.8 python-ruffus openjdk-8 openjdk-lts openjdk-13 openjdk-14 nodejs cl-ironclad python-scipy scipy cross-toolchain-base-mipsen mkl-dnn samtools satpy python-cffi yt skimage scikit-learn silx statsmodels puma multipath-tools tgt
 long_tests = gutenprint gmp-ecm open-iscsi diffoscope snapcraft cross-toolchain-base
 blacklist = bionic/i386/upstart bionic/amd64/upstart bionic/i386/libnih bionic/amd64/libnih bionic/i386/r-cran-vioplot bionic/amd64/r-cran-vioplot bionic/amd64/stress-ng bionic/i386/stress-ng bionic/i386/openjdk-lts xenial/amd64/virtualbox-ext-pack bionic/amd64/virtualbox-ext-pack xenial/i386/virtualbox-ext-pack bionic/i386/virtualbox-ext-pack hirsute/i386/rust-onig hirsute/amd64/rust-onig