Ok so this problem has proven a bit more difficult to solve than initially anticipated.
If you don't need the "show tests in job definition order" feature from checkbox rev 1291 and the related fix from rev 1305, a possible workaround is to remove that code from your version of checkbox.
I'll keep looking at this but I don't know when we'll have a viable solution that still maintains the sortkey feature.
Ok so this problem has proven a bit more difficult to solve than initially anticipated.
If you don't need the "show tests in job definition order" feature from checkbox rev 1291 and the related fix from rev 1305, a possible workaround is to remove that code from your version of checkbox.
I'll keep looking at this but I don't know when we'll have a viable solution that still maintains the sortkey feature.