Merge lp:~zorba-coders/zorba/bump_FOTS_snapshot_May_22nd into lp:zorba

Proposed by Sorin Marian Nasoi
Status: Merged
Approved by: Chris Hillery
Approved revision: 11470
Merged at revision: 11475
Proposed branch: lp:~zorba-coders/zorba/bump_FOTS_snapshot_May_22nd
Merge into: lp:zorba
Diff against target: 238 lines (+133/-10)
3 files modified
test/fots/CMakeLists.txt (+125/-6)
test/fots/ImportFOTS.cmake (+1/-1)
test/fots_driver/tools/process.xq (+7/-3)
To merge this branch: bzr merge lp:~zorba-coders/zorba/bump_FOTS_snapshot_May_22nd
Reviewer Review Type Date Requested Status
Chris Hillery Approve
Sorin Marian Nasoi Approve
Review via email: mp+165162@code.launchpad.net

Commit message

- bumped FOTS snapshot to May 22nd and updated failures accordingly
- fixed query and added some useful trace info

To post a comment you must log in.
Revision history for this message
Sorin Marian Nasoi (sorin.marian.nasoi) :
review: Approve
Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :
Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :

The attempt to merge lp:~zorba-coders/zorba/bump_FOTS_snapshot_May_22nd into lp:zorba failed. Below is the output from the failed tests.

CMake Error at /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake:275 (message):
  Validation queue job bump_FOTS_snapshot_May_22nd-2013-05-22T14-24-42.615Z
  is finished. The final status was:

  6 tests did not succeed - changes not commited.

Error in read script: /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake

Revision history for this message
Sorin Marian Nasoi (sorin.marian.nasoi) :
review: Approve
Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :
Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :

The attempt to merge lp:~zorba-coders/zorba/bump_FOTS_snapshot_May_22nd into lp:zorba failed. Below is the output from the failed tests.

CMake Error at /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake:275 (message):
  Validation queue job bump_FOTS_snapshot_May_22nd-2013-05-22T15-04-39.849Z
  is finished. The final status was:

  1 tests did not succeed - changes not commited.

Error in read script: /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake

Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :
Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :

Validation queue job bump_FOTS_snapshot_May_22nd-2013-05-22T22-44-45.681Z is finished. The final status was:

All tests succeeded!

Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :

Voting does not meet specified criteria. Required: Approve > 1, Disapprove < 1, Needs Fixing < 1, Pending < 1, Needs Information < 1, Resubmit < 1. Got: 1 Approve, 1 Pending.

Revision history for this message
Chris Hillery (ceejatec) wrote :

Whoa... why such a large number of new failures? Those don't all look like new test cases.

review: Needs Information
Revision history for this message
Sorin Marian Nasoi (sorin.marian.nasoi) wrote :
Revision history for this message
Sorin Marian Nasoi (sorin.marian.nasoi) wrote :

> Whoa... why such a large number of new failures? Those don't all look like new
> test cases.
Mostly due to:
https://bugs.launchpad.net/zorba/+bug/1182910
and
W3C bug #21868

Revision history for this message
Chris Hillery (ceejatec) :
review: Approve
Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :
Revision history for this message
Zorba Build Bot (zorba-buildbot) wrote :

Validation queue job bump_FOTS_snapshot_May_22nd-2013-05-27T08-16-01.474Z is finished. The final status was:

All tests succeeded!

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1=== modified file 'test/fots/CMakeLists.txt'
2--- test/fots/CMakeLists.txt 2013-05-21 21:47:40 +0000
3+++ test/fots/CMakeLists.txt 2013-05-22 15:05:31 +0000
4@@ -114,6 +114,13 @@
5 EXPECTED_FOTS_FAILURE (CRASH fn-matches.re re00975 1070533)
6 EXPECTED_FOTS_FAILURE (CRASH fn-matches.re re00976 1070533)
7 EXPECTED_FOTS_FAILURE (CRASH fn-matches.re re00976a 1070533)
8+# This test-cases SEG FAULT on Fedora x64 bit
9+#EXPECTED_FOTS_FAILURE (CRASH prod-TryCatchExpr try-011 0)
10+#EXPECTED_FOTS_FAILURE (CRASH prod-TryCatchExpr try-catch-optimizations-1 0)
11+#EXPECTED_FOTS_FAILURE (CRASH prod-TryCatchExpr try-catch-optimizations-2 0)
12+#EXPECTED_FOTS_FAILURE (CRASH prod-TryCatchExpr try-catch-spec-example-4 0)
13+#EXPECTED_FOTS_FAILURE (CRASH prod-TryCatchExpr try-catch-nest-1 0)
14+#EXPECTED_FOTS_FAILURE (CRASH prod-TryCatchExpr try-catch-nest-2 0)
15
16 #"disputed" tests. These test are run but marked as 'pass' by FOTS driver.
17 #All these entries should have a *valid* opened bug number from W3C bugzilla.
18@@ -124,8 +131,28 @@
19 EXPECTED_FOTS_FAILURE (DISPUTED prod-OptionDecl.serialization Serialization-028 21868)
20 EXPECTED_FOTS_FAILURE (DISPUTED prod-OptionDecl.serialization Serialization-031 21868)
21 EXPECTED_FOTS_FAILURE (DISPUTED prod-OptionDecl.serialization Serialization-032 21868)
22-EXPECTED_FOTS_FAILURE (DISPUTED fn-id K2-SeqIDFunc-11 21414)
23-EXPECTED_FOTS_FAILURE (DISPUTED fn-id K2-SeqIDFunc-12 21414)
24+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-1 21868)
25+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-2 21868)
26+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-4 21868)
27+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-18 21868)
28+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-19a 21868)
29+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-19b 21868)
30+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-19c 21868)
31+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-22 21868)
32+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-25 21868)
33+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-26 21868)
34+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-27 21868)
35+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-28 21868)
36+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-29 21868)
37+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-30 21868)
38+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-33 21868)
39+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-34 21868)
40+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-35 21868)
41+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-36 21868)
42+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-37 21868)
43+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-38 21868)
44+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-39 21868)
45+EXPECTED_FOTS_FAILURE (DISPUTED misc-Serialization Serialization-html-40 21868)
46 EXPECTED_FOTS_FAILURE (DISPUTED prod-VarDecl.external K2-ExternalVariablesWith-22 21960)
47
48 # Next three possibly unique to old RQ machine, but they need to be
49@@ -136,12 +163,16 @@
50 # This test passes on the old and new RQ machines, but fails for Sorin.
51 #EXPECTED_FOTS_FAILURE (fn-normalize-unicode fn-normalize-unicode-11 0)
52 EXPECTED_FOTS_FAILURE (app-CatalogCheck Catalog002 1172273)
53+EXPECTED_FOTS_FAILURE (app-CatalogCheck Catalog004 1172273)
54 EXPECTED_FOTS_FAILURE (app-CatalogCheck Catalog010 1172273)
55 EXPECTED_FOTS_FAILURE (app-CatalogCheck Catalog011 1172273)
56+EXPECTED_FOTS_FAILURE (app-CatalogCheck Catalog013 1172273)
57+EXPECTED_FOTS_FAILURE (app-CatalogCheck Catalog014 1172273)
58 EXPECTED_FOTS_FAILURE (fn-available-environment-variables fn-available-environment-variables-011 0)
59 EXPECTED_FOTS_FAILURE (fn-environment-variable environment-variable-005 0)
60 EXPECTED_FOTS_FAILURE (fn-environment-variable environment-variable-006 0)
61 EXPECTED_FOTS_FAILURE (fn-environment-variable environment-variable-007 0)
62+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-009 0)
63 EXPECTED_FOTS_FAILURE (fn-format-dateTime format-dateTime-006 0)
64 EXPECTED_FOTS_FAILURE (fn-format-integer format-integer-044 21448)
65 EXPECTED_FOTS_FAILURE (fn-format-number numberformat41 1167427)
66@@ -274,6 +305,8 @@
67 EXPECTED_FOTS_FAILURE (prod-FunctionDecl function-decl-reserved-function-names-029 1147547)
68 EXPECTED_FOTS_FAILURE (prod-FunctionDecl function-decl-reserved-function-names-031 1147547)
69 EXPECTED_FOTS_FAILURE (prod-InstanceofExpr instanceof113 0)
70+EXPECTED_FOTS_FAILURE (prod-InstanceofExpr instanceof132 0)
71+EXPECTED_FOTS_FAILURE (prod-InstanceofExpr instanceof133 0)
72 EXPECTED_FOTS_FAILURE (prod-InstanceofExpr instanceof139 1160559)
73 EXPECTED_FOTS_FAILURE (prod-InstanceofExpr instanceof140 0)
74 EXPECTED_FOTS_FAILURE (prod-InstanceofExpr cbcl-instance-of-001 0)
75@@ -325,6 +358,20 @@
76 EXPECTED_FOTS_FAILURE (prod-SchemaImport cbcl-validated-schema-element-1 0)
77 EXPECTED_FOTS_FAILURE (prod-SchemaImport cbcl-validated-schema-element-3 0)
78 EXPECTED_FOTS_FAILURE (prod-SchemaImport cbcl-validated-schema-element-4 0)
79+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-001 0)
80+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-005 0)
81+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-006 0)
82+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-007 0)
83+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-015 0)
84+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-016 0)
85+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-020 0)
86+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-028 0)
87+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-034 0)
88+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-035 0)
89+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-037 0)
90+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-041 0)
91+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-042 0)
92+EXPECTED_FOTS_FAILURE (prod-SchemaImport empty-union-049 0)
93 EXPECTED_FOTS_FAILURE (prod-TypeswitchExpr typeswitch-113 0)
94 EXPECTED_FOTS_FAILURE (prod-ValidateExpr validateexpr-41 0)
95 EXPECTED_FOTS_FAILURE (prod-VersionDecl VersionDecl-v1-processor-and-v3-query 0)
96@@ -332,11 +379,8 @@
97 EXPECTED_FOTS_FAILURE (xs-anyURI cbcl-anyURI-002 0)
98 EXPECTED_FOTS_FAILURE (xs-anyURI cbcl-anyURI-006 0)
99 EXPECTED_FOTS_FAILURE (xs-base64Binary base64-115 0)
100-EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-009 0)
101 EXPECTED_FOTS_FAILURE (fn-function-lookup fn-function-lookup-062 0)
102-EXPECTED_FOTS_FAILURE (fn-map-pairs fn-map-pairs-026 0)
103 EXPECTED_FOTS_FAILURE (misc-HigherOrderFunctions xqhof12 0)
104-EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-062 0)
105 EXPECTED_FOTS_FAILURE (xs-error xs-error-005 1170470)
106 EXPECTED_FOTS_FAILURE (xs-error xs-error-006 1170470)
107 EXPECTED_FOTS_FAILURE (xs-error xs-error-007 1170470)
108@@ -350,7 +394,82 @@
109 EXPECTED_FOTS_FAILURE (xs-error xs-error-041 1170470)
110 EXPECTED_FOTS_FAILURE (xs-error xs-error-042 1170470)
111 EXPECTED_FOTS_FAILURE (xs-error xs-error-049 1170470)
112-
113+EXPECTED_FOTS_FAILURE (fn-filter filter-001 1182910) #Changes in F&O spec
114+EXPECTED_FOTS_FAILURE (fn-filter filter-002 1182910)
115+EXPECTED_FOTS_FAILURE (fn-filter filter-003 1182910)
116+EXPECTED_FOTS_FAILURE (fn-filter filter-004 1182910)
117+EXPECTED_FOTS_FAILURE (fn-filter filter-005 1182910)
118+EXPECTED_FOTS_FAILURE (fn-filter fn-filter-013 1182910)
119+EXPECTED_FOTS_FAILURE (fn-filter fn-filter-014 1182910)
120+EXPECTED_FOTS_FAILURE (fn-filter fn-filter-017 1182910)
121+EXPECTED_FOTS_FAILURE (fn-filter fn-filter-020 1182910)
122+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-001 1182910)
123+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-002 1182910)
124+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-003 1182910)
125+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-004 1182910)
126+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-005 1182910)
127+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-006 1182910)
128+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-007 1182910)
129+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-008 1182910)
130+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-015 1182910)
131+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-016 1182910)
132+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-017 1182910)
133+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-018 1182910)
134+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-019 1182910)
135+EXPECTED_FOTS_FAILURE (fn-fold-left fold-left-020 1182910)
136+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-001 1182910)
137+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-002 1182910)
138+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-003 1182910)
139+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-004 1182910)
140+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-005 1182910)
141+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-006 1182910)
142+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-007 1182910)
143+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-013 1182910)
144+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-014 1182910)
145+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-015 1182910)
146+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-016 1182910)
147+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-017 1182910)
148+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-018 1182910)
149+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-019 1182910)
150+EXPECTED_FOTS_FAILURE (fn-fold-right fold-right-020 1182910)
151+EXPECTED_FOTS_FAILURE (fn-for-each for-each-001 1182910)
152+EXPECTED_FOTS_FAILURE (fn-for-each for-each-002 1182910)
153+EXPECTED_FOTS_FAILURE (fn-for-each for-each-003 1182910)
154+EXPECTED_FOTS_FAILURE (fn-for-each for-each-004 1182910)
155+EXPECTED_FOTS_FAILURE (fn-for-each for-each-005 1182910)
156+EXPECTED_FOTS_FAILURE (fn-for-each for-each-006 1182910)
157+EXPECTED_FOTS_FAILURE (fn-for-each for-each-007 1182910)
158+EXPECTED_FOTS_FAILURE (fn-for-each for-each-008 1182910)
159+EXPECTED_FOTS_FAILURE (fn-function-lookup fn-function-lookup-423 1182910)
160+EXPECTED_FOTS_FAILURE (fn-function-lookup fn-function-lookup-424 1182910)
161+EXPECTED_FOTS_FAILURE (fn-function-lookup fn-function-lookup-426 1182910)
162+EXPECTED_FOTS_FAILURE (fn-function-lookup fn-function-lookup-428 1182910)
163+EXPECTED_FOTS_FAILURE (fn-function-lookup fn-function-lookup-430 1182910)
164+EXPECTED_FOTS_FAILURE (fn-function-lookup fn-function-lookup-431 1182910)
165+EXPECTED_FOTS_FAILURE (fn-function-lookup fn-function-lookup-432 1182910)
166+EXPECTED_FOTS_FAILURE (fn-for-each-pair for-each-pair-001 1182910)
167+EXPECTED_FOTS_FAILURE (fn-for-each-pair for-each-pair-002 1182910)
168+EXPECTED_FOTS_FAILURE (fn-for-each-pair for-each-pair-003 1182910)
169+EXPECTED_FOTS_FAILURE (fn-for-each-pair for-each-pair-004 1182910)
170+EXPECTED_FOTS_FAILURE (fn-for-each-pair for-each-pair-005 1182910)
171+EXPECTED_FOTS_FAILURE (fn-for-each-pair for-each-pair-006 1182910)
172+EXPECTED_FOTS_FAILURE (fn-for-each-pair for-each-pair-007 1182910)
173+EXPECTED_FOTS_FAILURE (fn-for-each-pair for-each-pair-008 1182910)
174+EXPECTED_FOTS_FAILURE (fn-for-each-pair fn-for-each-pair-008 1182910)
175+EXPECTED_FOTS_FAILURE (fn-for-each-pair fn-for-each-pair-017 1182910)
176+EXPECTED_FOTS_FAILURE (fn-for-each-pair fn-for-each-pair-025 1182910)
177+EXPECTED_FOTS_FAILURE (fn-for-each-pair fn-for-each-pair-026 1182910)
178+EXPECTED_FOTS_FAILURE (fn-for-each-pair fn-for-each-pair-027 1182910)
179+EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-062 1182910)
180+EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-423 1182910)
181+EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-424 1182910)
182+EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-426 1182910)
183+EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-428 1182910)
184+EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-430 1182910)
185+EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-431 1182910)
186+EXPECTED_FOTS_FAILURE (prod-NamedFunctionRef function-literal-432 1182910)
187+EXPECTED_FOTS_FAILURE (misc-HigherOrderFunctions xqhof3 0) #this is a test-case that was updated in FOTS
188+EXPECTED_FOTS_FAILURE (prod-CompNamespaceConstructor nscons-042 0)
189
190 # Initialize FOTSExpectedFailures.xml
191 SET (fots_expected_failures_file "${CMAKE_BINARY_DIR}/FOTSExpectedFailures.xml")
192
193=== modified file 'test/fots/ImportFOTS.cmake'
194--- test/fots/ImportFOTS.cmake 2013-05-08 10:14:19 +0000
195+++ test/fots/ImportFOTS.cmake 2013-05-22 15:05:31 +0000
196@@ -19,7 +19,7 @@
197
198
199 # Change this to publish updated FOTS archives
200-SET (FOTS_ARCHIVE "FOTS_080513.tgz")
201+SET (FOTS_ARCHIVE "FOTS_220513.tgz")
202
203 # Change this to modify which elements in FOTS driver results are output
204 # as CDATA
205
206=== modified file 'test/fots_driver/tools/process.xq'
207--- test/fots_driver/tools/process.xq 2013-05-16 11:47:06 +0000
208+++ test/fots_driver/tools/process.xq 2013-05-22 15:05:31 +0000
209@@ -36,8 +36,7 @@
210 declare namespace fots =
211 "http://www.w3.org/2010/09/qt-fots-catalog";
212
213-declare variable $fotsPath as xs:string external :=
214- "../../../build/test/fots/2011/QT3-test-suite/catalog.xml";
215+declare variable $fotsPath as xs:string external := "";
216 declare variable $dependency as xs:string external := "";
217 declare variable $testSetPrefixes as xs:string external := "";
218
219@@ -71,7 +70,8 @@
220 let $testSetDoc := doc(resolve-uri($testSet/@file, $baseUri))
221 let $testSetName := xs:string($testSet/@name)
222 let $testCaseNames as xs:string* := d:list-test-cases($testSetDoc,
223- $dependency)
224+ $dependency,
225+ ())
226 return
227 for $testCaseName in $testCaseNames
228 let $exit-code :=
229@@ -97,6 +97,10 @@
230 $testSetPrefixes as xs:string*,
231 $dependency as xs:string*
232 ) as xs:string* {
233+ trace($fotsPath, "fotsPath was set to:");
234+ trace($dependency, "dependency ");
235+ trace($testSetPrefixes, "testSetPrefixes ");
236+
237 variable $doc := doc(resolve-uri($fotsPath)),
238 $baseUri:= resolve-uri(util:parent-folder($fotsPath));
239

Subscribers

People subscribed via source and target branches