The test screen, which is one of the most important in checkbox, was confusing to users we spoke to. A few changes are needed in how the controls are arranged:
- The test result buttons should be made into radiobuttons. The user should always have to select the test result from the radio buttons (Yes, No, Skip) and press Next to jump to the next test. Since some of the tests automatically select a radiobutton based on test outcome, the user experience is more consistent; with the old behavior, the test automatically highlights the yes or no buttons, leaving users wondering if they should press the highlighted button, or Next (which always skips and is thus badly named).
- The comments field should always be present, rather than requiring clicking on a button to reveal it. Users also complained that the field was confusing since it just appears out of nowhere.
- Keyboard shortcuts should be added to the controls, so that testing can be driven with the keyboard.
The benefit of these changes is to make the UI clearer and less quirky (highlighting buttons seems to be a bit unreliable in Qt), to encourage users to comment on test results by making the comments field visible at all times, and to make testing faster by returning the keyboard controls (these were present in the old GTK interface but hadn't been reimplemented in the Qt UI).
This is the old test screen:
http://people.canonical.com/~roadmr/test-screen-bad.png
This is how the new screen looks like:
http://people.canonical.com/~roadmr/checkbox4.png
Note that a few strings changed: those for the Yes, No, Skip this Test, Previous and Next controls, mainly due to the addition of the marker (& in the case of Qt) for the keyboard shortcuts.
Build log using sbuild on a quantal target, for amd64.