Merge lp:~brendan-donegan/checkbox/bug1093718 into lp:checkbox

Proposed by Brendan Donegan
Status: Merged
Approved by: Zygmunt Krynicki
Approved revision: 2100
Merged at revision: 2100
Proposed branch: lp:~brendan-donegan/checkbox/bug1093718
Merge into: lp:checkbox
Diff against target: 42 lines (+8/-2)
3 files modified
debian/changelog (+6/-0)
jobs/rendercheck.txt.in (+1/-1)
scripts/rendercheck_test (+1/-1)
To merge this branch: bzr merge lp:~brendan-donegan/checkbox/bug1093718
Reviewer Review Type Date Requested Status
Zygmunt Krynicki (community) Approve
Review via email: mp+162325@code.launchpad.net

Description of the change

Based on https://bugs.launchpad.net/checkbox/+bug/1093718/comments/4 from Brian Sullivan and also the feedback from Alberto Milone on the same, the rendercheck gradients test generates false positives. This merge proposal fixes the rendercheck_test script so that multiple tests can be blacklisted, and adds gradients to the list of blacklisted tests in the rendercheck job.

To post a comment you must log in.
Revision history for this message
Zygmunt Krynicki (zyga) wrote :

+1

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
=== modified file 'debian/changelog'
--- debian/changelog 2013-05-02 22:35:51 +0000
+++ debian/changelog 2013-05-03 10:49:26 +0000
@@ -16,6 +16,12 @@
16 with the root user, restore the workspaces switch and the HTML5 video16 with the root user, restore the workspaces switch and the HTML5 video
17 playback ; remove the extra suspend/resume (LP: #1172851)17 playback ; remove the extra suspend/resume (LP: #1172851)
1818
19 [ Brendan Donegan ]
20 * scripts/rendercheck_test - change nargs='+' to action='append' for blacklist
21 option so it works as expected.
22 jobs/rendercheck.txt.in - blacklist gradients test as it is known to produce
23 false positives. (LP: #1093718)
24
19 -- Brendan Donegan <brendan.donegan@canonical.com> Fri, 26 Apr 2013 18:23:03 +010025 -- Brendan Donegan <brendan.donegan@canonical.com> Fri, 26 Apr 2013 18:23:03 +0100
2026
21checkbox (0.16) raring; urgency=low27checkbox (0.16) raring; urgency=low
2228
=== modified file 'jobs/rendercheck.txt.in'
--- jobs/rendercheck.txt.in 2013-04-04 16:06:42 +0000
+++ jobs/rendercheck.txt.in 2013-05-03 10:49:26 +0000
@@ -2,7 +2,7 @@
2name: rendercheck/tests2name: rendercheck/tests
3requires:3requires:
4 package.name == 'x11-apps'4 package.name == 'x11-apps'
5command: ( rendercheck_test -b repeat -d -o $CHECKBOX_DATA/rendercheck-results && echo "Rendercheck tests completed successfully" ) || ( echo "Error running rendercheck. Please see the log $CHECKBOX_DATA/rendercheck-results for details" >&2 && false )5command: ( rendercheck_test -b repeat -b gradients -d -o $CHECKBOX_DATA/rendercheck-results && echo "Rendercheck tests completed successfully" ) || ( echo "Error running rendercheck. Please see the log $CHECKBOX_DATA/rendercheck-results for details" >&2 && false )
6_description:6_description:
7 Runs all of the rendercheck test suites. This test can take a few minutes.7 Runs all of the rendercheck test suites. This test can take a few minutes.
88
99
=== modified file 'scripts/rendercheck_test'
--- scripts/rendercheck_test 2013-04-04 16:06:42 +0000
+++ scripts/rendercheck_test 2013-05-03 10:49:26 +0000
@@ -178,7 +178,7 @@
178 %s. \178 %s. \
179 Default is all' % (', '.join(all_tests)))179 Default is all' % (', '.join(all_tests)))
180 parser.add_argument('-b', '--blacklist',180 parser.add_argument('-b', '--blacklist',
181 nargs='+',181 action='append',
182 help='The name of a test which should not be run.')182 help='The name of a test which should not be run.')
183 parser.add_argument('-d', '--debug',183 parser.add_argument('-d', '--debug',
184 action='store_true',184 action='store_true',

Subscribers

People subscribed via source and target branches