Dependency is not considered in re-run tests
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Next Generation Checkbox (CLI) |
Confirmed
|
Wishlist
|
Unassigned |
Bug Description
With Plainbox 0.21, we now have the possibility to re-run failed tests at the end of a session (before submitting it).
However, these re-run tests currently do not consider test case dependencies, which causes some problems.
For example:
A tester failed the following cases and is prompted to re-run these cases before submitting report:
- keys/wireless
- suspend/
Expected re-run scenario:
(1) [If possible] Plainbox triggers system to auto reboot to get clean "before s3" state
(2) keys/wireless is run
(3) suspend/
(4) suspend/
Actual re-run scenario:
(1) keys/wireless is run
(2) suspend/
(3) suspend/
description: | updated |
description: | updated |
Changed in checkbox-ng: | |
importance: | Undecided → Wishlist |
milestone: | none → future |
I think we will need to consider if we need to have a clean state for re-run job
e.g. reboot to get a real "before suspend" state.
As bug 1364861 was marked as Won't fix, I will leave this bug here.