Merge ~canonical-kernel-team/+git/rt-hints:bjamison/mantic-lowlatency-2024.02.05-hints into ~canonical-kernel-team/+git/rt-hints:main

[Bethany Jamison]

Regression Testing hints for Mantic lowlatency cycle 2024.02.05 includes:
1. add hint for openstack cpu2-ram4-disk20.arm64/ubuntu_kselftests, tests failed:
net:tls
sut-test
2. add hint for openstack lowlatency-64k cpu2-ram4-disk20.arm64/ubuntu_kselftests_net, test failed:
net:pmtu.sh
3. modify hint (#6 metal starmie/ubuntu_qrt_apparmor) to apply to openstack lowlatency cup2-ram4-disk20.arm64/ubuntu_kselftests as well, tests failed:
ApparmorTestsuites.test_utils_testsuite
ApparmorTestsuites.test_utils_testsuite3
4. add hint for openstack lowlatency cpu2-ram4-disk20.arm64/ubuntu_ltp, test failed:
irq:irqbalance01
5. add hint for metal lowlatency-64k kopter-kernel/ubuntu_kselftests, test failed:
net:pmtu.sh
6. add hint for metal lowlatency-64k starmie-kernel/ubuntu_qrt_apparmor, tests failed:
ApparmorTestsuites.test_utils_testsuite
ApparmorTestsuites.test_utils_testsuite3
7. add hint for metal lowlatency starmie-kernel/ubuntu_qrt_kernel_aslr_collisions, test failed:
KernelASLRCollisionsTest.test_stack_collision
8. add current version to existing hints:
gcp lowlatency c3a/ubuntu_fan_smoke_test fan-smoke-test
metal lowlatency starmie-kernel/ubuntu_kselftests_net net:gro.sh
metal lowlatency fili-kernel/ubuntu_kvm_unit_tests test_vmwrite_vmread

[Po-Hsu Lin (cypressyew)]

Overall it's looking good, and thank you for the bug reports.
One small place need to be fixed.

review: Needs Fixing

e07c3b8... by Bethany Jamison on 2024-03-04

m/lowlatency modify 2024.02.05 hints according to merge request comments

Signed-off-by: Bethany Jamison <email address hidden>

[Bethany Jamison (bjamison)]

I have:
1. moved the net:gro.sh test from ubuntu_kernel_kselftests to ubuntu_kselftests_net
2. modified the net:tls|sut-test hint to reflect the new bug tracking this error (LP:#2056055) and changed it state to FLAKY

[Po-Hsu Lin (cypressyew)]

Awesome, thank you.

review: Approve

[Po-Hsu Lin (cypressyew)]

Applied and pushed.

diff --git a/mantic-linux-lowlatency.yaml b/mantic-linux-lowlatency.yaml
index 16d5203..80a120a 100644
--- a/mantic-linux-lowlatency.yaml
+++ b/mantic-linux-lowlatency.yaml
@@ -40,7 +40,7 @@ ubuntu_bpf:
         '#125/p, #126/p, #127/p, #128/p, #129/p, #485/p'
 
 ubuntu_fan_smoke_test:
-  - version: 6\.5\.0-(21).*
+  - version: 6\.5\.0-(21|25).*
     test-case: fan-smoke-test
     cloud: gcp
     instance-type: c3a-standard-4
@@ -197,11 +197,17 @@ ubuntu_kselftests_net:
     arch: arm64
     instance-type: scobee-kernel
     comment: 'LP: #2023051 tls - kernel panic on scobee-kernel instance'
+  - version: 6\.5\.0-(25).*
+    test-case: net:tls|sut-test
+    flavour: lowlatency
+    arch: arm64
+    state: FLAKY
+    comment: 'LP: #2056055 - unknown error'
   - version: 6\.5\.0-(7|8|9).*
     test-case: net:rtnetlink.sh
     arch: s390x
     comment: 'LP: #1893921 rtnetlink.sh - ipsec_offload failed on s390x'
-  - version: 6\.5\.0-(7|8|9).*
+  - version: 6\.5\.0-(7|8|9|25).*
     test-case: net:gro.sh
     arch: arm64|s390x|ppc64el
     state: FLAKY
@@ -243,6 +249,17 @@ ubuntu_kselftests_net:
     cloud: metal
     arch: amd64|arm64
     comment: 'LP: #2040957 rps_default_mask.sh - test failed with bare-metals: Illegal number'
+  - version: 6\.5\.0-(25).*
+    test-case: net:pmtu.sh
+    cloud: metal
+    flavour: lowlatency-64k
+    instance-type: kopter-kernel
+    comment: 'LP: #1881643 - can not delete veth device in a timely manner, PMTU dst likely leaked'
+  - version: 6\.5\.0-(25).*
+    test-case: net:pmtu.sh
+    cloud: openstack
+    flavour: lowlatency-64k
+    comment: 'LP: #2055483 - mismatches expected value in locally bridged vxlan test'
 
 ubuntu_kvm_smoke_test:
   - version: 6\.5\.0-(14)\..*
@@ -305,7 +322,7 @@ ubuntu_kvm_unit_tests:
   - version: 6\.5\.0-(7|8|9|14|.*).*
     test-case: test_vmwrite_vmread
     arch: amd64
-    instance-type: amaura|kili|onibi|rizzo|rumford
+    instance-type: amaura|fili|kili|onibi|rizzo|rumford
     comment: 'LP: #1945037 test_vmwrite_vmread - FAIL: VMX_VMCS_ENUM.MAX_INDEX expected: 19, actual: 17'
   - version: 6\.5\.0-(7|8|9).*
     test-case: test_vmxon
@@ -400,6 +417,11 @@ ubuntu_ltp:
     cloud: openstack
     flavour: lowlatency-64k
     comment: 'LP: #1955452 irqbalance01 - Heuristic: Detected 0 irq-cpu pairs have been dissallowed'
+  - version: 6\.5\.0-(25).*
+    test-case: irq:irqbalance01
+    cloud: openstack
+    flavour: lowlatency
+    comment: 'LP: #1955452 irqbalance01 - Heuristic: Detected 0 irq-cpu pairs have been dissallowed'
 
 ubuntu_ltp_controllers:
   - version: 6\.5\.0-(14|17|.*).*
@@ -505,6 +527,10 @@ ubuntu_qrt_apparmor:
     comment: |
         'LP: #1939022 test_utils_testsuite(3) - test_entries_since_login(_verbose) in test-aa-notify.py failed with AppArmor denials string unmatch'
         'Only failing on Oracle instances.'
+  - version: 6\.5\.0-(25).*
+    test-case: ApparmorTestsuites.test_utils_testsuite|ApparmorTestsuites.test_utils_testsuite3
+    cloud: metal|openstack
+    comment: 'LP: #2055458 - utils_testsuite and utils_testsuite3 failed'
   - version: 6\.5\.0-(7|8|9).*
     test-case: ApparmorTestsuites.test_parser_testsuite
     flavour: lowlatency-64k
@@ -512,6 +538,14 @@ ubuntu_qrt_apparmor:
     instance-type: a1.medium
     comment: 'LP: #2009925 test_parser_testsuite - build terminated, test_apport_hooks test killed, instance too small?'
 
+ubuntu_qrt_kernel_aslr_collisions:
+  - version: 6\.5\.0-(25).*
+    test-case: KernelASLRCollisionsTest.test_stack_collision
+    flavour: lowlatency
+    cloud: metal
+    instance-type: starmie-kernel
+    comment: 'LP: #2055449 test_stack_collision failed'
+
 ubuntu_qrt_kernel_security:
   - version: 6\.5\.0-(7|8|9|14|.*).*
     test-case: KernelNonSecurityTest.test_ulimit_stack_small