Code review comment for ~canonical-kernel-team/+git/autotest-client-tests:phlin/fail-cpuset-hotplug

Yes, so the test will be marked as failed directly, without being tested with the `runltp` executable.

One example is the fanotify07 test in ubuntu_ltp_syscalls, which is a test-blocking won't fix issue, the output looks like this:

15:40:54 INFO | START ubuntu_ltp_syscalls.fanotify07 ubuntu_ltp_syscalls.fanotify07 timestamp=1688485254 timeout=900 localtime=Jul 04 15:40:54
15:40:54 DEBUG| Persistent state client._record_indent now set to 2
15:40:54 DEBUG| Persistent state client.unexpected_reboot now set to ('ubuntu_ltp_syscalls.fanotify07', 'ubuntu_ltp_syscalls.fanotify07')
15:40:54 DEBUG| Waiting for pid 14676 for 900 seconds
15:40:54 ERROR| Exception escaping from test:
Traceback (most recent call last):
  File "/home/ubuntu/autotest/client/shared/test.py", line 411, in _exec
    _call_test_function(self.execute, *p_args, **p_dargs)
  File "/home/ubuntu/autotest/client/shared/test.py", line 823, in _call_test_function
    return func(*args, **dargs)
  File "/home/ubuntu/autotest/client/shared/test.py", line 291, in execute
    postprocess_profiled_run, args, dargs)
  File "/home/ubuntu/autotest/client/shared/test.py", line 212, in _call_run_once
    self.run_once(*args, **dargs)
  File "/home/ubuntu/autotest/client/tests/ubuntu_ltp_syscalls/ubuntu_ltp_syscalls.py", line 143, in run_once
    raise error.TestError("fanotify07 (lp:1775165) won't fix on T/X and blocking test to finish properly (lp:1944545), mark it as failed directly")
TestError: fanotify07 (lp:1775165) won't fix on T/X and blocking test to finish properly (lp:1944545), mark it as failed directly
15:40:54 ERROR| child process failed
15:40:54 DEBUG| Traceback (most recent call last):
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/parallel.py", line 25, in fork_start
15:40:54 DEBUG| l()
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/job.py", line 505, in
15:40:54 DEBUG| l = lambda: test.runtest(self, url, tag, args, dargs)
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/test.py", line 125, in runtest
15:40:54 DEBUG| job.sysinfo.log_after_each_iteration)
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/shared/test.py", line 913, in runtest
15:40:54 DEBUG| mytest._exec(args, dargs)
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/shared/test.py", line 411, in _exec
15:40:54 DEBUG| _call_test_function(self.execute, *p_args, **p_dargs)
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/shared/test.py", line 823, in _call_test_function
15:40:54 DEBUG| return func(*args, **dargs)
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/shared/test.py", line 291, in execute
15:40:54 DEBUG| postprocess_profiled_run, args, dargs)
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/shared/test.py", line 212, in _call_run_once
15:40:54 DEBUG| self.run_once(*args, **dargs)
15:40:54 DEBUG| File "/home/ubuntu/autotest/client/tests/ubuntu_ltp_syscalls/ubuntu_ltp_syscalls.py", line 143, in run_once
15:40:54 DEBUG| raise error.TestError("fanotify07 (lp:1775165) won't fix on T/X and blocking test to finish properly (lp:1944545), mark it as failed directly")
15:40:54 DEBUG| TestError: fanotify07 (lp:1775165) won't fix on T/X and blocking test to finish properly (lp:1944545), mark it as failed directly
15:40:56 INFO | ERROR ubuntu_ltp_syscalls.fanotify07 ubuntu_ltp_syscalls.fanotify07 timestamp=1688485256 localtime=Jul 04 15:40:56 fanotify07 (lp:1775165) won't fix on T/X and blocking test to finish properly (lp:1944545), mark it as failed directly
15:40:56 INFO | END ERROR ubuntu_ltp_syscalls.fanotify07 ubuntu_ltp_syscalls.fanotify07 timestamp=1688485256 localtime=Jul 04 15:40:56