Metabox testing for Test Plan Selection (#452)
* Nominal launcher skip plan selection test
* Test that selection from the launcher works as intended
* Allow checking for stderr prints in metabox scenario
* Test that selecting non-existent test errors out
* Test that checkbox quits if promted to test with no unit
Checkbox should quit when asked to test but with no test plan
selected, printing some useful output error.
Minor: This also includes a comment explaining TestSelectionPlanPreselectFailWrongName
* Minor: Fixed typo in test name
* Fixed FailWrongName regex to match logger
The old regex assumed that the logger would print something
before the error message, while it is ok to not do so
* Adds error message for forced tp select no unit
Previously forcing the test plan selection would print a misleading
error message saying that the "unset" unit is not found. Now
it reports that it was not provided with any unit
* Support test plan selection from launcher in remote
Remote did not support test plan selection from the launcher because
it ignored the information, now it uses it
* Report missing selected test plan instead of crashing
Selecting a missing test plan from the launcher would lead to a
crash, now the exception is catched and the program exits with
the same error as legacy
* Added error to tp selection when missing unit in forced run
Added a new error message to avoid printing misleading
"missing unit `unset`" when a launcher forces tp selection
without giving any unit.
* Add tests for tp filtering via launcher
This adds two tests, one that excludes every test
the other excludes "smoke"
* Error reporting is now done in stderr
Remote did not repor this error in stderr via logger
while legacy did, unifying the behaviour in stderr
* Apply new naming as suggested in code review
This refactors TestSelectionPlan... into TestPlan or TestPlanSelection where necessary
Co-authored-by: Sylvain Pineau <email address hidden>
* Inject failing conf to test launcher precedence
* Added Start step after load conf
* Revert "Allow checking for stderr prints in metabox scenario"
This reverts commit 25ff683b6b8ce47c332841d1330ef7c6cca7e3b9.
because the function was implemented in another way in main
* Moved tests from AssertPrintedError to AssertPrinted
---------
Co-authored-by: Sylvain Pineau <email address hidden>
