lp:~cypressyew/qa-regression-testing

Author: Po-Hsu Lin
Author Date: 2024-02-02 12:11:23 UTC

test-apparmor.py: run just test_utils_testsuite test

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-08-29 09:39:43 UTC

scripts/test-apparmor.py: skip aa-status --json on older releases

This --json flag is not available for apparmor on T/X.
Run this test only for apparmor 2.12-4ubuntu5 (the one in Bionic) and newer.

Bug: https://bugs.launchpad.net/qa-regression-testing/+bug/2033379
Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-05-25 10:14:32 UTC

scripts/test-kernel-security.py: use text mode for config.gz

While testing J-xilinx kernel, all of the KernelSecurityConfigTests
are failing with:

Traceback (most recent call last):
  File "./test-kernel-security.py", line 2215, in test_010_kaslr_config
    self.assertKernelConfig('RANDOMIZE_BASE', expected)
  File "./test-kernel-security.py", line 231, in assertKernelConfig
    self.assertKernelConfigSet(name)
  File "./test-kernel-security.py", line 217, in assertKernelConfigSet
    self.assertTrue(self._test_config(name),
  File "./test-kernel-security.py", line 199, in _test_config
    setting = self._get_config(name)
  File "./test-kernel-security.py", line 193, in _get_config
    if line.startswith('CONFIG_%s=' % (name)):
TypeError: startswith first arg must be bytes or a tuple of bytes, not str

This is because the /proc/config.gz was not opened in text mode with
the python gzip module. Set it to 'rt' (text mode) to fix this issue.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-04-21 10:50:32 UTC

test-kernel-security.py: limit PPC ASLR workaround to < 5.19

The broken aslr when stack is unlimited issue on PowerPC has been fixed
with commit 3ba4289 "powerpc: Simplify and move arch_randomize_brk()"
upstream, and it's been applied to our Kinetic tree as well.

ASLR is now functional on 5.19+, we don't need to expect these test to
fail anymore

Limit this workaround to < 5.19

Bug: https://bugs.launchpad.net/bugs/2017062
Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-03-23 08:20:57 UTC

test-apparmor.py: workaround to fix posix_ipc tests for non-x86 archs on Jammy

With the apparmor package on Jammy updated to 3.0.4-2ubuntu2.2,
non-x86 archs on Jammy are failing with this posix_ipc test as well.

Apply the patch we use for LP: #2000359 to fix it.

Bug: https://bugs.launchpad.net/qa-regression-testing/+bug/2012591
Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2023-01-16 15:00:29 UTC

ulimit_stack_small: use different command for testing 64k pages

With commit 72e44713ab ("ulimit_stack_small: test multiple times for
64k pages") we have modified the command to run it multiple times. But
this should be specific to kernel with 64k pages.

Otherwise it will return 0 and fail with return code mismatch on other
kernels.

Bug: https://bugs.launchpad.net/qa-regression-testing/+bug/2002997
Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2022-12-21 07:59:16 UTC

test-apparmor.py: make sure environment variables are restored after test

BugLink: https://bugs.launchpad.net/bugs/2000233

The python environment variable we set for those python3 related tests
like test_libapparmor_testsuite3() and test_utils_testsuite3() should
be cleared after test if they're not set before.

Otherwise this will make test_utils_testsuite() to be tested with
python3 if we're trying to run the whole test-apparmor.py suite
directly.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2022-11-25 08:14:23 UTC

test-apparmor.py: make it possible to run tests one-by-one

Don't explictly add test classes into unittest.TestSuite() but just
use unittest.main() instead. So that we will be able to run single
test with:
  ./test-apparmor.py -v ApparmorTest.test_aa_status

The whole suite can still be triggered with:
  ./test-apparmor.py -v

See --help for more information for unittests.
And skip test with unittest.skipUnless.

Without the need to run through everything, this change will make it
easier to debug a single failure.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2020-04-14 02:23:49 UTC

test-kernel-panic: remove unnecessary comment

There is a comment that should be removed when re-enabling test_cve_2016_10208.
Fixes: e3a50374636c ("test-kernel-panic: re-enable CVE-2016-10208 test")

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>

Author: Po-Hsu Lin
Author Date: 2018-11-19 06:30:32 UTC

test-kernel-security: /proc/self/stack readable only by root for 4.18

BugLink: https://bugs.launchpad.net/bugs/1803921

Likewise in 4.4 Xenial, 4.18 Cosmic kernel has the upstream commit
f8a00cef17206ecd1b30d3d9f99e10d9fa707aa7 (4.19) applied.

/proc/self/stack is now readable by root only with 4.18.

Signed-off-by: Po-Hsu Lin <po-hsu.lin@canonical.com>