Merge ~athos-ribeiro/ubuntu/+source/squid:halt-build-on-test-failures-kinetic into ubuntu/+source/squid:applied/ubuntu/kinetic-devel

[Athos Ribeiro]

As it is being discussed in [1], squid builds will not halt upon upstream unit test failures during dh_auto_test. This could hinder the squid MRE test plan process [2].

This MP proposes a patch set to force squid builds to fail upon test failures. It also includes additional changes to ensure build time and autopkgtests are also passing for those upstream tests.

This is the kinetic SRU for the change applied in lunar in [3]

[1] https://lists.ubuntu.com/archives/ubuntu-release/2023-January/005522.html
[2] https://wiki.ubuntu.com/SquidUpdates
PPA: https://launchpad.net/~athos-ribeiro/+archive/ubuntu/squid-halt-build-on-test-failures/+packages
[3] https://code.launchpad.net/~athos-ribeiro/ubuntu/+source/squid/+git/squid/+merge/436437

autopkgtest run for the ppa above:

* Results:
  - squid/5.6-1ubuntu4~ppa2
    + ✅ squid on kinetic for amd64 @ 31.01.23 14:52:41 Log️ 🗒️
    + ✅ squid on kinetic for arm64 @ 31.01.23 15:18:39 Log️ 🗒️
    + ❌ squid on kinetic for armhf @ 31.01.23 14:28:20 Log️ 🗒️
      • upstream-test-suite PASS 🟩
      • squid FAIL 🟥
    + ✅ squid on kinetic for ppc64el @ 31.01.23 14:36:17 Log️ 🗒️
    + ✅ squid on kinetic for s390x @ 31.01.23 14:26:15 Log️ 🗒️

Do note that the armhf failure is not a regression: https://autopkgtest.ubuntu.com/packages/s/squid/kinetic/armhf

[Athos Ribeiro (athos-ribeiro)]

Note that I already have

- verified that the s390x LTO change is needed here; and
- tested a build without removing the 0003 patch, which did lead to a build failure due to failing tests, as expected.

[Bryce Harrington (bryce)]

Should this be targeting the applied branch? Or am I confused?

With this targeting kinetic, should version number be 5.6-1ubuntu3.1?

review: Needs Fixing

Unmerged commits

ef1d7d1... by Athos Ribeiro on 2023-01-31

Update changelog

a29e530... by Athos Ribeiro on 2023-01-27

    - d/rules: disable LTO for s390x builds.

77e79bd... by Athos Ribeiro on 2023-01-27

    - d/t/upstream-test-suite: use installed squid binary for
      autopkgtest config file checks.

8b054a4... by Athos Ribeiro on 2023-01-27

    - d/rules: do not include additional configuration files during
      build time tests. This would lead to test failures due to missing
      paths.

88d0b52... by Athos Ribeiro on 2023-01-27

    - d/rules: halt build upon test failures.

2149223... by Athos Ribeiro on 2023-01-27

    - d/p/series: do not rely on installed binaries for build time tests.

diff --git a/debian/changelog b/debian/changelog
index 9bd5a20..67a6796 100644
--- a/debian/changelog
+++ b/debian/changelog
@@ -1,3 +1,17 @@
+squid (5.6-1ubuntu4) kinetic; urgency=medium
+
+  * Make builds fail when upstream test suite fails (LP: #2004050):
+    - d/p/series: do not rely on installed binaries for build time tests.
+    - d/rules: halt build upon test failures.
+    - d/rules: do not include additional configuration files during
+      build time tests. This would lead to test failures due to missing
+      paths.
+    - d/t/upstream-test-suite: use installed squid binary for
+      autopkgtest config file checks.
+    - d/rules: disable LTO for s390x builds.
+
+ -- Athos Ribeiro <[e-mail]>  Mon, 30 Jan 2023 20:12:50 -0300
+
 squid (5.6-1ubuntu3) kinetic; urgency=medium
 
   * SECURITY UPDATE: Exposure of Sensitive Information in Cache Manager
diff --git a/debian/patches/series b/debian/patches/series
index 3c055ad..2184d3e 100644
--- a/debian/patches/series
+++ b/debian/patches/series
@@ -1,6 +1,8 @@
 0001-Default-configuration-file-for-debian.patch
 0002-Change-default-file-locations-for-debian.patch
-0003-installed-binary-for-debian-ci.patch
+# Do not use installed binary during build time since they are not yet
+# available. Do not apply the patch below.
+# 0003-installed-binary-for-debian-ci.patch
 0005-Use-RuntimeDirectory-to-create-run-squid.patch
 0006-Fix-build-against-OpenSSL-3-0.patch
 90-cf.data.ubuntu.patch
diff --git a/debian/rules b/debian/rules
index 85d55f3..365a786 100755
--- a/debian/rules
+++ b/debian/rules
@@ -1,6 +1,11 @@
 #! /usr/bin/make -f
 
 export DEB_BUILD_MAINT_OPTIONS = hardening=+all
+
+ifeq ($(DEB_HOST_ARCH), s390x)
+    DEB_BUILD_MAINT_OPTIONS += optimize=-lto
+endif
+
 export DEB_CFLAGS_MAINT_APPEND = -Wno-error=deprecated-declarations
 export DEB_CXXFLAGS_MAINT_APPEND = -Wno-error=deprecated-declarations
 
@@ -89,9 +94,17 @@ override_dh_auto_build:
 	dh_auto_build
 	cd debian/build-openssl && dh_auto_build
 
+execute_before_dh_auto_test:
+	# Do not include additional configuration files during tests. This would lead to failures due to missing paths.
+	sed -i 's|^\(include /etc/squid/conf\.d/\*\.conf\)|# \1|' src/squid.conf.default debian/build-openssl/src/squid.conf.default
+
 override_dh_auto_test:
-	-dh_auto_test
-	-cd debian/build-openssl && dh_auto_test
+	dh_auto_test
+	cd debian/build-openssl && dh_auto_test
+
+execute_after_dh_auto_test:
+	# Restore configuration file to its previous state.
+	sed -i 's|^# \(include /etc/squid/conf\.d/\*\.conf\)|\1|' src/squid.conf.default debian/build-openssl/src/squid.conf.default
 
 override_dh_auto_install:
 	dh_auto_install
diff --git a/debian/tests/upstream-test-suite b/debian/tests/upstream-test-suite
index b6c9495..d503788 100644
--- a/debian/tests/upstream-test-suite
+++ b/debian/tests/upstream-test-suite
@@ -5,6 +5,10 @@ export DEB_CFLAGS_MAINT_APPEND="-Wno-error=deprecated-declarations"
 export DEB_CXXFLAGS_MAINT_APPEND="-Wno-error=deprecated-declarations"
 
 dpkg-source --before-build `pwd`
+
+# Use installed squid binary
+sed -i 's|\$(top_builddir)/src/squid -k parse|/usr/sbin/squid -k parse|' test-suite/Makefile.am test-suite/Makefile.in
+
 dh_update_autotools_config
 dh_autoreconf
 dh_auto_configure -- ${DEB_CONFIGURE_EXTRA_FLAGS} --with-gnutls