The re-run screen should separate jobs thave have been skipped from jobs that have failed
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Next Generation Checkbox (CLI) |
Fix Released
|
Wishlist
|
Pierre Equoy |
Bug Description
Currently, the re-run screen at the end of a testing session displays all the jobs in the same space, whether they've been skipped or they've failed.
The re-run screen currently looks like this:
Select jobs to re-run
┌──────
│ [ ] - Audio tests
│ [ ] audio/playback_auto
│ [ ] - Camera tests
│ [ ] camera/display
│ [ ] camera/
│ [ ] camera/still
│ [ ] - Informational tests
│ [ ] Attach the bto.xml in Dell recovery partition
│ [ ] Check the recovery type is dell or not
│ [ ] Check existence of recovery partition
│ [ ] Attach the contents of /etc/modprobe.*
│ [ ] Attaches json dumps of udev_resource raw dmi devices
│ [ ] Attach the recovery partition versions
│ [ ] - Miscellaneous tests
│ [ ] Device Check
│ [ ] Check that data for a complete result are present
│ [ ] - Optical Drive tests
│ [ ] Displays discovered optical drives
QA team would like to separate this, such as:
Select jobs to re-run
┌──────
│ Failed Tests
│ [ ] - Audio tests
│ [ ] audio/playback_auto
│ [ ] - Miscellaneous tests
│ [ ] Check that data for a complete result are present
│ [ ] - Informational tests
│ [ ] Check the recovery type is dell or not
│ [ ] Check existence of recovery partition
│
│ Skipped Tests
│ [ ] - Camera tests
│ [ ] camera/display
│ [ ] camera/
│ [ ] camera/still
│ [ ] - Informational tests
│ [ ] Attach the bto.xml in Dell recovery partition
│ [ ] Attach the contents of /etc/modprobe.*
│ [ ] Attaches json dumps of udev_resource raw dmi devices
│ [ ] Attach the recovery partition versions
│ [ ] - Miscellaneous tests
│ [ ] Device Check
│ [ ] - Optical Drive tests
│ [ ] Displays discovered optical drives
Note: Some categories (e.g. “Informational tests” in the example above) may appear in both Skipped and Failed sections.
Related branches
- Sylvain Pineau (community): Approve
-
Diff: 163 lines (+96/-3)3 files modifiedcheckbox_ng/launcher/stages.py (+3/-0)
checkbox_ng/launcher/subcommands.py (+55/-2)
docs/launcher-tutorial.rst (+38/-1)
- Pierre Equoy: Approve
-
Diff: 34 lines (+3/-3)3 files modified.bumpversion.cfg (+1/-1)
checkbox_ng/__init__.py (+1/-1)
setup.py (+1/-1)
- Sylvain Pineau (community): Approve
- Pierre Equoy: Needs Resubmitting
- Maciej Kisielewski: Needs Fixing
-
Diff: 77 lines (+38/-2)2 files modifiedcheckbox_ng/launcher/subcommands.py (+2/-2)
checkbox_ng/misc.py (+36/-0)
description: | updated |
Changed in checkbox-ng: | |
assignee: | nobody → Pierre Equoy (pierre-equoy) |
Changed in checkbox-ng: | |
status: | Fix Committed → Fix Released |
A patch was submitted to sort the jobs to rerun according to their outcome (crashed, failed, skipped).
See screenshot.