Merge lp:~diogo-simoes89/zorba/data-cleaning into lp:zorba/data-cleaning-module

[Diogo Simões]

Changes on normalization functions (to-time, to-dateTime, to date)
Changes on conversion expected results (address-from-phone, phone-from-user, user-from-phone)

Changes on normalization functions:
- to-dateTime: uncomment the function, resolve the bugs
- to-time: uncomment the function, resolve the bugs
- implementation of check-functions that verifies the if a string corresponds to a xs:date, xs: time or xs:dateTime

Changes on conversion tests (changing the test result):
- address-from-user
- phone-from-user
- user-from-phone

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-10-17T10-22-35.152Z/log.html

[Zorba Build Bot (zorba-buildbot)]

The attempt to merge lp:~diogo-simoes89/zorba/data-cleaning into lp:zorba/data-cleaning-module failed. Below is the output from the failed tests.

CMake Error at /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake:272 (message):
  Validation queue job data-cleaning-2011-10-17T10-22-35.152Z is finished.
  The final status was:

  3 tests did not succeed - changes not commited.

Error in read script: /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake

[Zorba Build Bot (zorba-buildbot)]

There are additional revisions which have not been approved in review. Please seek review and approval of these new revisions.

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-10-17T20-13-34.611Z/log.html

[Zorba Build Bot (zorba-buildbot)]

Validation queue job data-cleaning-2011-10-17T20-13-34.611Z is finished. The final status was:

All tests succeeded!

[Zorba Build Bot (zorba-buildbot)]

Voting does not meet specified criteria. Required: Approve > 1, Disapprove < 1. Got: 1 Pending.

[Bruno Martins (bgmartins)]

Some minor things that should be changed before approving the merge:

* The documentation for functions like conversion:address-from-phone, conversion:user-from-phone and conversion:address-from-user should be revised, in order to keep just one example (i.e., the one from @example).

* The documentation for functions like normalization:to-date or normalization:to-time should present an example invocation.

* The documentation for the private functions like normalization:check-time should also provide an example invocation. From looking at the source code, it seems to me that these functions are not really necessary, and the corresponding instructions could instead be used directly in the code that
invokes these functions.

review: Needs Fixing

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-10-26T16-18-38.76Z/log.html

[Zorba Build Bot (zorba-buildbot)]

Validation queue job data-cleaning-2011-10-26T16-18-38.76Z is finished. The final status was:

All tests succeeded!

[Zorba Build Bot (zorba-buildbot)]

Voting does not meet specified criteria. Required: Approve > 1, Disapprove < 1. Got: 1 Needs Fixing.

[Bruno Martins (bgmartins)]

Checked the latest revisions from Diogo and they seem ok.

review: Approve

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-11-11T03-01-39.94Z/log.html

[Zorba Build Bot (zorba-buildbot)]

The attempt to merge lp:~diogo-simoes89/zorba/data-cleaning into lp:zorba/data-cleaning-module failed. Below is the output from the failed tests.

CMake Error at /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake:272 (message):
  Validation queue job data-cleaning-2011-11-11T03-01-39.94Z is finished.
  The final status was:

  2 tests did not succeed - changes not commited.

Error in read script: /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-11-16T17-37-12.546Z/log.html

[Zorba Build Bot (zorba-buildbot)]

The attempt to merge lp:~diogo-simoes89/zorba/data-cleaning into lp:zorba/data-cleaning-module failed. Below is the output from the failed tests.

CMake Error at /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake:272 (message):
  Validation queue job data-cleaning-2011-11-16T17-37-12.546Z is finished.
  The final status was:

  1 tests did not succeed - changes not commited.

Error in read script: /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-11-16T18-48-39.387Z/log.html

[Zorba Build Bot (zorba-buildbot)]

The attempt to merge lp:~diogo-simoes89/zorba/data-cleaning into lp:zorba/data-cleaning-module failed. Below is the output from the failed tests.

CMake Error at /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake:272 (message):
  Validation queue job data-cleaning-2011-11-16T18-48-39.387Z is finished.
  The final status was:

  4 tests did not succeed - changes not commited.

Error in read script: /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-11-21T23-35-38.044Z/log.html

[Zorba Build Bot (zorba-buildbot)]

The attempt to merge lp:~diogo-simoes89/zorba/data-cleaning into lp:zorba/data-cleaning-module failed. Below is the output from the failed tests.

CMake Error at /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake:272 (message):
  Validation queue job data-cleaning-2011-11-21T23-35-38.044Z is finished.
  The final status was:

  3 tests did not succeed - changes not commited.

Error in read script: /home/ceej/zo/testing/zorbatest/tester/TarmacLander.cmake

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-11-23T17-21-36.139Z/log.html

[Zorba Build Bot (zorba-buildbot)]

Validation queue job data-cleaning-2011-11-23T17-21-36.139Z is finished. The final status was:

All tests succeeded!

[Zorba Build Bot (zorba-buildbot)]

Voting does not meet specified criteria. Required: Approve > 1, Disapprove < 1. Got: 1 Approve.

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-11-24T21-35-36.072Z/log.html

[Zorba Build Bot (zorba-buildbot)]

Validation queue job data-cleaning-2011-11-24T21-35-36.072Z is finished. The final status was:

All tests succeeded!

[Zorba Build Bot (zorba-buildbot)]

Voting does not meet specified criteria. Required: Approve > 1, Disapprove < 1. Got: 1 Approve.

[Matthias Brantner (matthias-brantner)]

review: Approve

[Zorba Build Bot (zorba-buildbot)]

Validation queue starting for merge proposal.
Log at: http://zorbatest.lambda.nu:8080/remotequeue/data-cleaning-2011-11-25T20-19-36.742Z/log.html

[Zorba Build Bot (zorba-buildbot)]

Validation queue job data-cleaning-2011-11-25T20-19-36.742Z is finished. The final status was:

All tests succeeded!

=== modified file 'src/com/zorba-xquery/www/modules/data-cleaning/conversion.xq'
--- src/com/zorba-xquery/www/modules/data-cleaning/conversion.xq	2011-08-16 23:45:59 +0000
+++ src/com/zorba-xquery/www/modules/data-cleaning/conversion.xq	2011-11-16 18:49:23 +0000
@@ -35,6 +35,8 @@
 
 import module namespace http = "http://www.zorba-xquery.com/modules/http-client";
 
+import module namespace reflection = "http://www.zorba-xquery.com/modules/reflection";
+
 declare namespace ver = "http://www.zorba-xquery.com/options/versioning";
 declare option ver:module-version "2.0";
 
@@ -45,10 +47,6 @@
  : Uses a White-pages Web service to discover information about a given name, 
  : returning a sequence of strings for the phone numbers associated to the name.
  :
- : <br/>
- : Example usage : <pre> phone-from-user ('Maria Lurdes') </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> [phone] </pre>
  :
  : @param $name The name of person or organization.
  : @return A sequence of strings for the phone numbers associated to the name.
@@ -66,11 +64,6 @@
  : Uses a White-pages Web service to discover information about a given name, 
  : returning a sequence of strings for the addresses associated to the name.
  :
- : <br/>
- : Example usage : <pre> address-from-user ('Maria Lurdes') </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> 222 E 53rd St, Los Angeles, CA, US </pre>
- :							  <pre> 3362 Walden Ave, Depew, NY, US </pre>
  :
  : @param $name The name of person or organization.
  : @return A sequence of strings for the addresses associated to the name.
@@ -93,11 +86,6 @@
  : Uses a White-pages Web service to discover information about a given phone number, 
  : returning a sequence of strings for the name associated to the phone number.
  :
- : <br/>
- : Example usage : <pre> user-from-phone ('8654582358') </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> Homer Simpson </pre>
- :							  <pre> Sue M Simpson </pre>
  :
  : @param $phone-number A string with 10 digits corresponding to the phone number.
  : @return A sequence of strings for the person or organization's name associated to the phone number.
@@ -113,10 +101,6 @@
  : Uses a White-pages Web service to discover information about a given phone number, 
  : returning a string for the address associated to the phone number.
  :
- : <br/>
- : Example usage : <pre> address-from-phone ('8654582358') </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> 4610 Harrison Bend Rd, Loudon, TN, US </pre>
  :
  : @param $phone-number A string with 10 digits corresponding to the phone number.
  : @return A string for the addresses associated to the phone number.
@@ -139,10 +123,6 @@
  : Uses a White-pages Web service to discover information about a given address, 
  : returning a sequence of strings for the names associated to the address.
  :
- : <br/>
- : Example usage : <pre> user-from-address('5655 E Gaskill Rd, Willcox, AZ, US') </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> Stan Smith </pre>
  :
  : @param $address A string corresponding to the address (ex: 5655 E Gaskill Rd, Willcox, AZ, US).
  : @return A sequence of strings for the person or organization's names associated to the address.
@@ -169,10 +149,6 @@
  : Uses a White-pages Web service to discover information about a given address, 
  : returning a sequence of strings for the phone number associated to the address.
  :
- : <br/>
- : Example usage : <pre> phone-from-address('5655 E Gaskill Rd, Willcox, AZ, US') </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> [phone] </pre>
  :
  : @param $address A string corresponding to the address (ex: 5655 E Gaskill Rd, Willcox, AZ, US).
  : @return A sequence of strings for the phone number or organization's names associated to the address.
@@ -206,41 +182,122 @@
 (:~
  : Conversion function for units of measurement, acting as a wrapper over the CuppaIT WebService.
  : <br/>
- : WebService documentation at http://www.cuppait.com/UnitConversionGateway-war/UnitConversion?format=XML
  :
- : <br/>
- : Example usage : <pre> unit-convert ( 1 , "Distance", "mile", "kilometer" ) </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> 1.609344 </pre>
  :
  : @param $v The amount we wish to convert.
  : @param $t The type of metric (e.g., "Distance")
  : @param $m1 The source measurement unit metric (e.g., "meter")
  : @param $m2 The target measurement unit metric (e.g., "mile")
  : @return The value resulting from the conversion
- : @error conversion:notsupported if the type of metric, the source unit or the target unit are not known to the service.
- : @see http://www.cuppait.com/UnitConversionGateway-war/UnitConversion?format=XML
  : @example test/Queries/data-cleaning/conversion/unit-convert.xq
  :)
 declare %ann:nondeterministic function conversion:unit-convert ( $v as xs:double, $t as xs:string, $m1 as xs:string, $m2 as xs:string ) {
- let $url     := "http://www.cuppait.com/UnitConversionGateway-war/UnitConversion?format=XML"
- let $ctype   := concat("ctype=",$t)
- let $cfrom   := concat("cfrom=",$m1)
- let $cto     := concat("cto=",$m2)
- let $camount := concat("camount=",$v)
- let $par     := string-join(($url,$ctype,$cfrom,$cto,$camount),"&amp;")
- let $result  := data(http:get-node($par)[2])
- return if (matches(data($result),"-?[0-9]+(\.[0-9]+)?")) then data($result) 
-        else (error(QName('http://www.zorba-xquery.com/modules/data-cleaning/conversion', 'conversion:notsupported'), data($result)))
+ if ( $m1 = $m2 ) then $v else
+
+let $conversion-table := 
+ <unit-conversion-rules>
+ <unit type="Distance" from="mile" to="kilometer" value="1.609344" />
+ <unit type="Distance" from="mile" to="angstrom" value="16100000000000" />
+ <unit type="Distance" from="mile" to="picometer" value="1610000000000000" />
+ <unit type="Distance" from="mile" to="nanometer" value="1610000000000" />
+ <unit type="Distance" from="mile" to="microometer" value="1610000000" />
+ <unit type="Distance" from="mile" to="millimeter" value="1610000" />
+ <unit type="Distance" from="mile" to="centimeter" value="161000" />
+ <unit type="Distance" from="mile" to="meter" value="1610" />
+ <unit type="Distance" from="mile" to="inch" value="63400" />
+ <unit type="Distance" from="mile" to="feet" value="5280" />
+ <unit type="Distance" from="kilometer" to="meter" value="1000" />
+ <unit type="Distance" from="kilometer" to="picometer" value="1000000000000000" />
+ <unit type="Distance" from="kilometer" to="angstrom" value="10000000000000" />
+ <unit type="Distance" from="kilometer" to="nanometer" value="1000000000000" />
+ <unit type="Distance" from="kilometer" to="micrometer" value="1000000000" />
+ <unit type="Distance" from="kilometer" to="millimeter" value="1000000" />
+ <unit type="Distance" from="kilometer" to="centimeter" value="100000" />
+ <unit type="Distance" from="kilometer" to="inch" value="39400" />
+ <unit type="Distance" from="kilometer" to="feet" value="3280" />
+ <unit type="Distance" from="meter" to="centimeter" value="100" />
+ <unit type="Distance" from="meter" to="picometer" value="1000000000000" />
+ <unit type="Distance" from="meter" to="angstrom" value="10000000000" />
+ <unit type="Distance" from="meter" to="nanometer" value="1000000000" />
+ <unit type="Distance" from="meter" to="micrometer" value="1000000" />
+ <unit type="Distance" from="meter" to="millimeter" value="1000" />
+ <unit type="Distance" from="meter" to="inch" value="39.4" />
+ <unit type="Distance" from="meter" to="feet" value="3.28" />
+ <unit type="Distance" from="centimeter" to="millimeter" value="10" />
+ <unit type="Distance" from="millimeter" to="micrometer" value="1000" />
+ <unit type="Distance" from="micrometer" to="nanometer" value="1000" />
+ <unit type="Distance" from="nanometer" to="angstrom" value="10" />
+ <unit type="Distance" from="angstrom" to="picometer" value="100" />
+ <unit type="Distance" from="inch" to="feet" value="0.0833" />
+ <unit type="Mass" from="tons" to="kilograms" value="907.18474" />
+ <unit type="Mass" from="tons" to="pounds" value="2000" />
+ <unit type="Mass" from="tons" to="ounces" value="32000" />
+ <unit type="Mass" from="tons" to="grams" value="907184.74" />
+ <unit type="Mass" from="tons" to="milligrams" value="907184740" />
+ <unit type="Mass" from="kilograms" to="pounds" value="2.2046226" />
+ <unit type="Mass" from="kilograms" to="grams" value="1000" />
+ <unit type="Mass" from="kilograms" to="milligrams" value="1000000" />
+ <unit type="Mass" from="grams" to="milligrams" value="1000" />
+ <unit type="Mass" from="pounds" to="ounces" value="16" />
+ <unit type="Mass" from="pounds" to="grams" value="453.59237" />
+ <unit type="Mass" from="pounds" to="milligrams" value="453592.37" />
+ <unit type="Mass" from="ounces" to="kilograms" value="0.028349523" />
+ <unit type="Mass" from="ounces" to="grams" value="28.349523" />
+ <unit type="Mass" from="ounces" to="milligrams" value="28349.523" />
+ <unit type="Volume" from="liters" to="cubic centimeters" value="1000" />
+ <unit type="Energy" from="jouls" to="calories" value="0.239" />
+ <unit type="Pressure" from="pascals" to="kilopascals" value="0.001" />
+ <unit type="Pressure" from="pascals" to="bars" value="0.000001" />
+ <unit type="Pressure" from="pascals" to="mmHg" value="0.00750064" />
+ <unit type="Pressure" from="pascals" to="torrs" value="0.00750064" />
+ <unit type="Pressure" from="atmospheres" to="pascals" value="101325" />
+ <unit type="Pressure" from="atmospheres" to="kilopascals" value="101.325" />
+ <unit type="Pressure" from="atmospheres" to="bars" value="1.01325" />
+ <unit type="Pressure" from="atmospheres" to="mmHg" value="760" />
+ <unit type="Pressure" from="atmospheres" to="torrs" value="760" />
+ <unit type="Pressure" from="atmospheres" to="psi" value="14.7" />
+ <unit type="Pressure" from="psi" to="pascals" value="6890" />
+ <unit type="Pressure" from="psi" to="kilopascals" value="6.89" />
+ <unit type="Pressure" from="psi" to="bars" value="0.0689" />
+ <unit type="Pressure" from="psi" to="mmHg" value="51.7" />
+ <unit type="Pressure" from="psi" to="torrs" value="51.7" />
+ <unit type="Pressure" from="bars" to="kilopascals" value="100" />
+ <unit type="Pressure" from="bars" to="mmHg" value="750.064" />
+ <unit type="Pressure" from="bars" to="torrs" value="750.064" />
+ <unit type="Pressure" from="kilopascals" to="mmHg" value="7.50064" />
+ <unit type="Pressure" from="kilopascals" to="torrs" value="7.50064" />
+ <unit type="Pressure" from="mmHg" to="torrs" value="1" />
+ <unit type="Temperature" from="celsius" to="fahrenheit" value="* 9 div 5 + 32" />
+ <unit type="Temperature" from="celsius" to="kelvin" value="+ 273.15" />
+ <unit type="Temperature" from="kelvin" to="celsius" value="- 273.15" />
+ <unit type="Temperature" from="kelvin" to="fahrenheit" value="* 9 div 5 - 273.15 * 9 div 5 + 32" />
+ <unit type="Temperature" from="fahrenheit" to="celsius" value="* 5 div 9 - 32 * 5 div 9" />
+ <unit type="Temperature" from="fahrenheit" to="kelvin" value="* 5 div 9 - 32 * 5 div 9 + 273.15" />
+</unit-conversion-rules>
+
+let $from := $conversion-table/unit[@type=$t and @from=$m1] | 
+             ( for $it in $conversion-table/unit[@type=$t and @to=$m1] return 
+               if (compare($t, "Temperature") != 0) then
+               copy $aux := $it
+               modify (
+                replace value of node $aux/@value with 1.0 div $aux/@value,
+                replace value of node $aux/@from with $aux/@to,
+                replace value of node $aux/@to with $aux/@from 
+               ) 
+               return $aux
+               else()
+             )
+
+return 
+if   (compare($t, "Temperature") = 0) then reflection:eval(concat($v , $conversion-table//unit[@from=$m1][@to=$m2]/@value))
+else
+	if   ( $from[@to=$m2]) then ( $v * $from[@to=$m2]/@value )
+	else ( for $i in $from return conversion:unit-convert ( $v * $i/@value , $t , $i/@to , $m2 ) )[1]
 };
 
 (:~
  : Placename to geospatial coordinates converter, acting as a wrapper over the Yahoo! geocoder service.
  :
- : <br/>
- : Example usage : <pre> geocode-from-address ( ("Lisboa", "Portugal") ) </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> ( 38.725735 , -9.15021 ) </pre>
  : 
  : @param $q A sequence of strings corresponding to the different components (e.g., street, city, country, etc.) of the place name.
  : @return The pair of latitude and longitude coordinates associated with the input address.
@@ -258,10 +315,6 @@
 (:~
  : Geospatial coordinates to placename converter, acting as a wrapper over the Yahoo! reverse geocoder service.
  :
- : <br/>
- : Example usage : <pre> address-from-geocode ( 38.725735 , -9.15021 ) </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> ( 'Portugal' , 'Lisbon' , 'praca Marques de Pombal' ) </pre>
  :
  : @param $lat Geospatial latitude.
  : @param $lon Geospatial longitude.
@@ -288,10 +341,6 @@
  :
  : WebService documentation at http://www.ecb.int/stats/exchange/eurofxref/html/index.en.html
  :
- : <br/>
- : Example usage : <pre> currency-convert ( 1, "USD", "EUR", "2011-01-18" ) </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> 0.747887218607434 </pre>
  :
  : @param $v The amount we wish to convert.
  : @param $m1 The source currency (e.g., "EUR").
@@ -356,4 +405,3 @@
 declare function conversion:name-from-domain ( $domain as xs:string ) {
  ()
 };
-

=== modified file 'src/com/zorba-xquery/www/modules/data-cleaning/normalization.xq'
--- src/com/zorba-xquery/www/modules/data-cleaning/normalization.xq	2011-08-01 11:26:53 +0000
+++ src/com/zorba-xquery/www/modules/data-cleaning/normalization.xq	2011-11-16 18:49:23 +0000
@@ -40,10 +40,6 @@
  : Converts a given string representation of a date value into a date representation valid according 
  : to the corresponding XML Schema type.
  :
- : <br/>
- : Example usage : <pre> to-date ( "24OCT2002" , "%d%b%Y" ) </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> 2002-10-24 </pre>
  :
  : @param $sd The string representation for the date
  : @param $format An optional parameter denoting the format used to represent the date in the string, according to a 
@@ -51,16 +47,10 @@
  : by a single letter or 'O' or 'E' and then a single letter. Any character in the format string that is not part of a conversion 
  : specification is interpreted literally, and the string '%%' gives '%'. The supported conversion specifications are as follows:
  : <pre>
- : '%a' Abbreviated weekday name in the current locale.<br/>
- : '%A' Full weekday name in the current locale.<br/>
  : '%b' Abbreviated month name in the current locale.<br/>
  : '%B' Full month name in the current locale.<br/>
  : '%d' Day of the month as decimal number (01-31).<br/>
- : '%j' Day of year as decimal number (001-366).<br/>
  : '%m' Month as decimal number (01-12).<br/>
- : '%U' Week of the year as decimal number (00-53) using Sunday as the first day of the week (and typically with the first Sunday of the year as day 1 of week 1). This is the US convention.<br/>
- : '%w' Weekday as decimal number (0-6, Sunday is 0).<br/>
- : '%W' Week of the year as decimal number (00-53) using Monday as the first day of the week (and typically with the first Monday of the year as day 1 of week 1). This is the UK convention.<br/>
  : '%x' Date, locale-specific.<br/>
  : '%y' Year without century (00-99).<br/>
  : '%Y' Year with century.<br/>
@@ -68,23 +58,20 @@
  : '%D' Locale-specific date format such as '%m/%d/%y'.<br/>
  : '%e' Day of the month as decimal number (1-31), with a leading pace for a single-digit number.<br/>
  : '%F' Equivalent to %Y-%m-%d (the ISO 8601 date format).<br/>
- : '%g' The last two digits of the week-based year (see '%V').<br/>
- : '%G' The week-based year (see '%V') as a decimal number.<br/>
- : '%h' Equivalent to '%b'.<br/>
- : '%u' Weekday as a decimal number (1-7, Monday is 1).<br/>
- : '%V' Week of the year as decimal number (00-53) as defined in ISO 8601.  If the week (starting on Monday) containing 1 January has four or more days in the new year, then it is considered week 1.  Otherwise, it is the last week of the previous year, and the next week is week 1. 
+ : '%h' Equivalent to '%b'.<br/> 
  :</pre>
  :
  : @return The date value resulting from the conversion.
- : <br/><br/><b> Attention : This function is still not implemented. </b> <br/>
+ : @example test/Queries/data-cleaning/normalization/to-date.xq
  :)
 declare function normalization:to-date ( $sd as xs:string, $format as xs:string? ) as xs:string{
-(:
+
+ 
  let $dictionary := normalization:month-dictionary()
- let $format-tokens := tokenize($format, "%")[position()>1] 
+ let $format-tokens := tokenize($format, "[ %\-/:]+")[position()>1] 
  let $sd-tokens := 
  	if (contains($sd, "-") or contains($sd, "/") or contains($sd, " "))
- 	then tokenize ($sd, "[ \-/]")
+ 	then tokenize ($sd, "[ \-/]+")
  	else let $ydtoken := tokenize(replace($sd, "[A-Za-z]", " "), " ")
 	     let $ft := $ydtoken[position()=1]
 	     let $lt := $ydtoken[last()]
@@ -154,25 +141,15 @@
 	
 	let $result := concat($year, "-", $month, "-", $day)
 	
-	return 
-	
-	if (matches(string($result),"[0-9]+-((0[1-9])|(1[0-2]))-((0[1-9])|([12][0-9])|(3[01]))")) 
-	then $result
-	else 
-	   (error(QName('http://www.zorba-xquery.com/modules/data-cleaning/normalization',
-		'err:notsupported'),data(concat($result, " - ", concat("year: ", $year), concat(" month: ", $month), concat(" day:", $day)))))
+	return normalization:check-date($result)
 	else()
-	:)""
+	
 };
 
 (:~
  : Converts a given string representation of a time value into a time representation valid according to 
  : the corresponding XML Schema type.
  :
- : <br/>
- : Example usage : <pre> to-time ( "09 hours 10 minutes" , "%H hours %M minutes" ) </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> 09:10:00 </pre>
  :
  : @param $sd The string representation for the time.
  : @param $format An optional parameter denoting the format used to represent the time in the string, according to a sequence of 
@@ -197,10 +174,12 @@
  :</pre>
  :
  : @return The time value resulting from the conversion.
+ : @example test/Queries/data-cleaning/normalization/to-time.xq
  :)
-declare function normalization:to-time ( $sd as xs:string, $format as xs:string? ) as xs:string{
+declare function normalization:to-time ( $sd as xs:string, $format as xs:string? ) as xs:string?{
  let $timezoneDict := normalization:timeZone-dictionary()
- let $format-tokens := tokenize($format, "%")[position()>1] 
+ let $format-string := replace(replace ($format, '%R', '%H:%M'), '%T', '%H:%M:%S')
+ let $format-tokens := tokenize($format-string, "( |%|:)+")[position()>1] 
  let $sd-tokens := 
  	if (contains($sd, ":") or contains($sd, ".") or contains($sd, " "))
  	then tokenize ($sd, "[ :\.]")
@@ -313,7 +292,7 @@
 
 			if (count(index-of($format-tokens, "e")) != 0)
 			then concat("0", string($sd-tokens[position() = index-of($format-tokens, "e")]))
-			else "SND"
+			else "00"
 	
 	let $result :=
 
@@ -439,7 +418,7 @@
 	     else ()
 	else	
 
-	(:z:)
+
 	if (count(index-of($format-tokens, "z")) != 0) 
 	then if (substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),1,1)='+')
 	     then let $complement := 
@@ -539,11 +518,7 @@
 	
 	return 
 	
-	if (matches(string($result),"(([01][0-9])|(2[0-3])):[0-5][0-9]:[0-5][0-9]")) 
-	then $result
-	else 
-	   (error(QName('http://www.zorba-xquery.com/modules/data-cleaning/normalization',
-		'err:notsupported'),data(concat($result, " - ", concat("hours: ", $hours), concat(" minutes: ", $minutes), concat(" seconds:", $seconds)))))
+	normalization:check-time($result)
 	else()
 
 };
@@ -552,10 +527,6 @@
  : Converts a given string representation of a dateTime value into a dateTime representation 
  : valid according to the corresponding XML Schema type.
  :
- : <br/>
- : Example usage : <pre> to-dateTime( "24OCT2002 21:22" , "%d%b%Y %H%M" ) </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> 2002-20-24T21:22:00 </pre>
  :
  : @param $sd The string representation for the dateTime.
  : @param $format An optional parameter denoting the format used to represent the dateTime in the string, according to a sequence 
@@ -564,11 +535,10 @@
  : is interpreted literally, and the string '%%' gives '%'. The supported conversion specifications are as follows:
  :
  : <pre>
- : '%a' Abbreviated weekday name in the current locale.<br/>
- : '%A' Full weekday name in the current locale.<br/>
  : '%b' Abbreviated month name in the current locale.<br/>
  : '%B' Full month name in the current locale.<br/>
  : '%c' Date and time, locale-specific.<br/>
+ : '%C' Century (00-99): the integer part of the year divided by 100.<br/>
  : '%d' Day of the month as decimal number (01-31).<br/>
  : '%H' Hours as decimal number (00-23).<br/>
  : '%I' Hours as decimal number (01-12).<br/>
@@ -577,16 +547,12 @@
  : '%M' Minute as decimal number (00-59).<br/>
  : '%p' AM/PM indicator in the locale. Used in conjunction with '%I' and *not* with '%H'.<br/>
  : '%S' Second as decimal number (00-61), allowing for up to two leap-seconds.<br/>
- : '%U' Week of the year as decimal number (00-53) using Sunday as the first day 1 of the week (and typically with the first Sunday of the year as day 1 of week 1). This is the US convention.<br/>
- : '%w' Weekday as decimal number (0-6, Sunday is 0).<br/>
- : '%W' Week of the year as decimal number (00-53) using Monday as the first day of week (and typically with the first Monday of the year as day 1 of week 1). This is the UK convention.<br/>
  : '%x' Date, locale-specific.<br/>
  : '%X' Time, locale-specific.<br/>
  : '%y' Year without century (00-99).<br/>
  : '%Y' Year with century.<br/>
  : '%z' Offset from Greenwich, so '-0900' is 9 hours west of Greenwich.<br/>
  : '%Z' Time zone as a character string.<br/>
- : '%C' Century (00-99): the integer part of the year divided by 100.<br/>
  : '%D' Locale-specific date format such as '%m/%d/%y': ISO C99 says it should be that exact format.<br/>
  : '%e' Day of the month as decimal number (1-31), with a leading pace for a single-digit number.<br/>
  : '%F' Equivalent to %Y-%m-%d (the ISO 8601 date format).<br/>
@@ -598,19 +564,16 @@
  : '%r' The 12-hour clock time (using the locale's AM or PM).<br/>
  : '%R' Equivalent to '%H:%M'.<br/>
  : '%T' Equivalent to '%H:%M:%S'.<br/>
- : '%u' Weekday as a decimal number (1-7, Monday is 1).<br/>
- : '%V' Week of the year as decimal number (00-53) as defined in ISO 8601.  If the week (starting on Monday) containing 1 January has four or more days in the new year, then it is considered week 1.  Otherwise, it is the last week of the previous year, and the next week is week 1. 
  :</pre>
  :
  : @return The dateTime value resulting from the conversion.
- : <br/><br/><b> Attention : This function is still not implemented. </b> <br/>
- :
+ : @example test/Queries/data-cleaning/normalization/to-dateTime.xq
  :)
 declare function normalization:to-dateTime ( $sd as xs:string, $format as xs:string? ) as xs:string {
-(:
   let $timezoneDict := normalization:timeZone-dictionary()
-  let $monthDict := normalization:month-dictionary()  
-  let $format-tokens := tokenize($format, "[ \-%]+")[position()>1]  
+  let $monthDict := normalization:month-dictionary()
+  let $format-string := replace(replace(replace ($format, '%R', '%H:%M'), '%T', '%H:%M:%S'), '%F', '%Y-%m-%d')  
+  let $format-tokens := tokenize($format-string, "[ %\-/:\.]+")[position()>1]  
   let $sdt := 
  	if (contains($sd, ":") or contains($sd, ".") or contains($sd, " ") or contains($sd, "-") 
 		or contains($sd, "/"))
@@ -801,7 +764,7 @@
 
 			if (count(index-of($format-tokens, "e")) != 0)
 			then concat("0", string($sd-tokens[position() = index-of($format-tokens, "e")]))
-			else "SND"
+			else "00"
 	
 	let $result :=
 
@@ -814,6 +777,50 @@
 		  then 1 
 		  else 0
 
+		let $dayscomplement := 
+		  if (number($complement) + number($hours) + number(substring(string($timezoneDict//timeZone/@value[../@name=$sd-tokens[position() 			=index-of($format-tokens, "Z")]]),2,2)) >= 24)
+		  then 1
+		  else 0
+
+		let $monthscomplement :=
+		  if(($dayscomplement + number($day) > 28) and (compare($month, '02') = 0) and (number($year) mod 4 != 0))
+		  then 1  
+		  else 
+		    if(($dayscomplement + number($day) > 30) and ((compare($month, '04') = 0) or (compare($month, '06') = 0) or (compare($month, '09') = 0) or (compare($month, '11') = 0)))
+		    then 1
+		    else 
+		      if(($dayscomplement + number($day) > 31) and ((compare($month, '04') = 0) or (compare($month, '01') = 0) or (compare($month, '03') = 0) or (compare($month, '05') = 0) or (compare($month, '07') = 0) or (compare($month, '08') = 0) or (compare($month, '10') = 0) or (compare($month, '12') = 0)))
+		      then 1
+		      else 
+		        if(($dayscomplement + number($day) > 29) and (compare($month, '02') = 0) and (number($year) mod 4 = 0))
+		        then 1
+		        else 0
+
+		let $ryear := 
+		  if ($monthscomplement + number($month) > 12)
+		  then string(number($year) + 1)
+		  else $year
+
+		let $daywcompl := 
+		  if ($monthscomplement = 1)
+		  then 1
+		  else number($day) + $dayscomplement
+
+		let $monthwcompl :=
+		  if($monthscomplement + number($month) <= 12)
+		  then number($month) + $monthscomplement		
+		  else 1
+ 
+		let $rday := 
+		  if (string-length(string($daywcompl)) = 1)
+		  then concat ('0', string($daywcompl))
+		  else string($daywcompl)
+
+		let $rmonth :=
+		  if (string-length(string($monthwcompl)) = 1)
+		  then concat ('0', string($monthwcompl))
+		  else string($monthwcompl)
+
 		let $rhours := 
 		  if (string-length(string(
 			(number($complement) + number($hours) + 
@@ -845,7 +852,7 @@
 				 index-of($format-tokens, "Z")]]),4,2))) mod 60))
 
 			
-	          return concat($year, "-", $month, "-", $day, "T", $rhours, ":", $rminutes, ":", $seconds)
+	          return concat($ryear, "-", $rmonth, "-", $rday, "T", $rhours, ":", $rminutes, ":", $seconds)
 	     else 
 	     
 	     if (substring(string($timezoneDict//timeZone/@value[../@name=$sd-tokens[position() = 
@@ -853,10 +860,61 @@
 	     then	
 		let $complement := 
 		  if (number($minutes)-number(substring(string($timezoneDict//timeZone/@value[../@name=$sd-tokens[position() =
-				 index-of($format-tokens, "Z")]]),4,2)) < 0) 		  
+				 index-of($format-tokens, "Z")]]),2,2)) < 0) 		  
 		  then -1 
 		  else 0
 	
+		let $dayscomplement := 
+		  if (number($complement) - number($hours) - number(substring(string($timezoneDict//timeZone/@value[../@name=$sd-tokens[position()=
+				 index-of($format-tokens, "Z")]]),2,2)) < 0)
+		  then -1
+		  else 0
+
+		let $monthcomplement :=
+		  if(number($day) + $dayscomplement < 1)
+		  then -1
+		  else 0
+	
+		let $yearcomplement :=
+		  if(number($month) + $monthcomplement< 1)
+		  then -1
+		  else 0
+
+		let $daywcompl := 
+		  if ($monthcomplement = 0)
+		  then number($day) + $dayscomplement 
+		  else 
+		   if ( (number($month) = 5) or (number($month) = 7) or (number($month) = 10) or (number($month) = 12))
+		   then 30
+		   else 
+		    if((number($month) = 4) or (number($month) = 6) or (number($month) = 9) or (number($month) = 11) or (number($month) = 2) or 			(number($month) = 1) or (number($month) = 8))
+		    then 31
+		    else 
+		      if((number($month) = 3) and (number($year) mod 4 != 0))
+		      then 28
+		      else 
+		        if((number($month) = 3) and (number($year) mod 4 = 0))
+		        then 29
+		        else number($day) + $dayscomplement
+	  	      	
+		let $monthwcompl:=
+		  if($yearcomplement = 0)
+		  then number($month) + $monthcomplement
+		  else 12
+
+		let $ryear := 
+		  number($year) + $yearcomplement
+
+		let $rday := 
+		  if (string-length(string($daywcompl)) = 1)
+		  then concat ('0', string($daywcompl))
+		  else string($daywcompl)
+
+		let $rmonth :=
+		  if (string-length(string($monthwcompl)) = 1)
+		  then concat ('0', string($monthwcompl))
+		  else string($monthwcompl)
+
 		let $rhours :=
 		     if( ((number($complement) + number($hours) -
 			number(substring(string($timezoneDict//timeZone/@value[../@name=$sd-tokens[position() =
@@ -923,7 +981,7 @@
 			      number(substring(string($timezoneDict//timeZone/@value[../@name=$sd-tokens[position() =
 				 index-of($format-tokens, "Z")]]),2,2)))) mod 60))
 
-		return concat($year, "-", $month, "-", $day, "T", $rhours, ":", $rminutes, ":", $seconds)
+		return concat($ryear, "-", $rmonth, "-", $rday, "T", $rhours, ":", $rminutes, ":", $seconds)
 	     else ()
 	else	
 
@@ -931,8 +989,52 @@
 	if (count(index-of($format-tokens, "z")) != 0) 
 	then if (substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),1,1)='+')
 	     then let $complement := 
-		  if (number($minutes)+number(substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),4,2)) > 59) 		  then 1 
-		  else 0
+		  if (number($minutes)+number(substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),4,2)) > 59) 		  	  then 1 
+		  else 0
+
+		let $dayscomplement := 
+		  if (number($complement) + number($hours) + number(substring(string($sd-tokens[position() = 					index-of($format-tokens, "z")]),2,2)) >= 24)
+		  then 1
+		  else 0
+
+		let $monthscomplement :=
+		  if(($dayscomplement + number($day) > 28) and (compare($month, '02') = 0) and (number($year) mod 4 != 0))
+		  then 1  
+		  else 
+		    if(($dayscomplement + number($day) > 30) and ((compare($month, '04') = 0) or (compare($month, '06') = 0) or (compare($month, '09') = 0) or (compare($month, '11') = 0)))
+		    then 1
+		    else 
+		      if(($dayscomplement + number($day) > 31) and ((compare($month, '04') = 0) or (compare($month, '01') = 0) or (compare($month, '03') = 0) or (compare($month, '05') = 0) or (compare($month, '07') = 0) or (compare($month, '08') = 0) or (compare($month, '10') = 0) or (compare($month, '12') = 0)))
+		      then 1
+		      else 
+		        if(($dayscomplement + number($day) > 29) and (compare($month, '02') = 0) and (number($year) mod 4 = 0))
+		        then 1
+		        else 0
+
+		let $ryear := 
+		  if ($monthscomplement + number($month) > 12)
+		  then string(number($year) + 1)
+		  else $year
+
+		let $daywcompl := 
+		  if ($monthscomplement = 1)
+		  then 1
+		  else number($day) + $dayscomplement
+
+		let $monthwcompl :=
+		  if($monthscomplement + number($month) <= 12)
+		  then number($month) + $monthscomplement		
+		  else 1
+ 
+		let $rday := 
+		  if (string-length(string($daywcompl)) = 1)
+		  then concat ('0', string($daywcompl))
+		  else string($daywcompl)
+
+		let $rmonth :=
+		  if (string-length(string($monthwcompl)) = 1)
+		  then concat ('0', string($monthwcompl))
+		  else string($monthwcompl)
 
 		let $rhours := 
 		  if (string-length(string(
@@ -959,15 +1061,65 @@
 			    number(substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),4,2))) mod 60))
 
 			
-	          return concat($year, "-", $month, "-", $day, "T", $rhours, ":", $rminutes, ":", $seconds)
+	          return concat($ryear, "-", $rmonth, "-", $rday, "T", $rhours, ":", $rminutes, ":", $seconds)
 	     else 
 	     
 	     if (substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),1,1)='-')
 	     then	
 		let $complement := 
-		  if (number($minutes)-number(substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),4,2)) < 0) 		  then -1 
-		  else 0
-	
+		  if (number($minutes)-number(substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),4,2)) < 0) 		  	  then -1 
+		  else 0
+	
+		let $dayscomplement := 
+		  if (number($complement) - number($hours) - number(substring(string($sd-tokens[position() = 					index-of($format-tokens, "z")]),2,2)) < 0)
+		  then -1
+		  else 0
+
+		let $monthcomplement :=
+		  if(number($day) + $dayscomplement< 1)
+		  then -1
+		  else 0
+	
+		let $yearcomplement :=
+		  if(number($month) + $monthcomplement< 1)
+		  then -1
+		  else 0
+
+		let $daywcompl := 
+		  if ($monthcomplement = 0)
+		  then number($day) + $dayscomplement 
+		  else 
+		   if ( (number($month) = 5) or (number($month) = 7) or (number($month) = 10) or (number($month) = 12))
+		   then 30
+		   else 
+		    if((number($month) = 4) or (number($month) = 6) or (number($month) = 9) or (number($month) = 11) or (number($month) = 2) or 			(number($month) = 1) or (number($month) = 8))
+		    then 31
+		    else 
+		      if((number($month) = 3) and (number($year) mod 4 != 0))
+		      then 28
+		      else 
+		        if((number($month) = 3) and (number($year) mod 4 = 0))
+		        then 29
+		        else number($day) + $dayscomplement
+	  	      	
+		let $monthwcompl:=
+		  if($yearcomplement = 0)
+		  then number($month) + $monthcomplement
+		  else 12
+
+		let $ryear := 
+		  number($year) + $yearcomplement
+
+		let $rday := 
+		  if (string-length(string($daywcompl)) = 1)
+		  then concat ('0', string($daywcompl))
+		  else string($daywcompl)
+
+		let $rmonth :=
+		  if (string-length(string($monthwcompl)) = 1)
+		  then concat ('0', string($monthwcompl))
+		  else string($monthwcompl)
+
 		let $rhours :=
 		     if( ((number($complement) + number($hours) -
 			number(substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),2,2))) mod 24) >= 0 )
@@ -1020,31 +1172,20 @@
 			    (60 - -(number($minutes) -
 			      number(substring(string($sd-tokens[position() = index-of($format-tokens, "z")]),2,2)))) mod 60))
 
-		return concat($year, "-", $month, "-", $day, "T", $rhours, ":", $rminutes, ":", $seconds)
+		return concat($ryear, "-", $rmonth, "-", $rday, "T", $rhours, ":", $rminutes, ":", $seconds)
 	     else ()
 	else
 	 concat($year, "-", $month, "-", $day, "T", $hours, ":", $minutes, ":", $seconds)
 
-	return
-
-	if (matches(string($result),"[0-9]+-((0[1-9])|(1[0-2]))-((0[1-9])|([12][0-9])|(3[01]))T(([01][0-9])|(2[0-3])):[0-5][0-9]:[0-5][0-9]")) 
-	then $result
-	else
-	   (error(QName('http://www.zorba-xquery.com/modules/data-cleaning/normalization',
-		'err:notsupported'),data(concat($result, " - ", concat("hours: ", $hours), concat(" minutes: ", $minutes), concat(" seconds:", $seconds)))))
-
+	return 
+	normalization:check-dateTime($result)
 	else()
-:)""
 };
 
 (:~
  : Uses an address normalization Web service to convert a postal address given as input into a 
  : cannonical representation format.
  :
- : <br/>
- : Example usage : <pre> normalize-address ( ( 'Marques de Pombal' , 'Lisboa' ) ) </pre>
- : <br/>
- : The function invocation in the example above returns : <pre> ( 'Portugal' , 'Lisbon' , 'praca Marques de Pombal' ) </pre>
  : 
  : @param $addr A sequence of strings encoding an address, where each string in the sequence corresponds to a different component (e.g., street, city, country, etc.) of the address.
  : @return A sequence of strings with the address encoded in a cannonical format, where each string in the sequence corresponds to a different component (e.g., street, city, country, etc.) of the address.
@@ -1315,7 +1456,7 @@
  : Internal auxiliary function that returns an XML representation for a dictionary that contains a 
  : numeric value associated to different month name abbreviations.
  :)
-declare %private function normalization:month-dictionary() as node(){
+declare %private function normalization:month-dictionary() as element(){
 let $dictionary :=
 <dictionary>
 	<month name="January" value="01">
@@ -1380,3 +1521,40 @@
 </dictionary>
 return $dictionary
 };
+
+(:~
+ : Internal auxiliary function that checks if a string is in xs:dateTime format
+ :
+ :
+ : @param $dateTime The string representation for the dateTime.
+ : @return The dateTime string if it represents the xs:dateTime format.
+ :)
+declare %private function normalization:check-dateTime($dateTime as xs:string) as xs:string{
+ concat(string(year-from-dateTime(xs:dateTime($dateTime))), substring($dateTime,5))
+};
+
+(:~
+ : Internal auxiliary function that checks if a string is in xs:date format
+ :
+ :
+ : @param $dateTime The string representation for the date.
+ : @return The date string if it represents the xs:date format.
+ :)
+declare %private function normalization:check-date($date as xs:string) as xs:string{
+ concat(string(year-from-date(xs:date($date))), substring($date,5))
+};
+
+(:~
+ : Internal auxiliary function that checks if a string is in xs:time format
+ :
+ :
+ : @param $dateTime The string representation for the time.
+ : @return The time string if it represents the xs:time format.
+ :)
+declare %private function normalization:check-time($Time as xs:string) as xs:string{
+ if(string(hours-from-time(xs:time($Time))))
+ then $Time
+ else()
+};
+
+

=== modified file 'src/com/zorba-xquery/www/modules/data-cleaning/phonetic-string-similarity.xq'
--- src/com/zorba-xquery/www/modules/data-cleaning/phonetic-string-similarity.xq	2011-08-01 11:26:53 +0000
+++ src/com/zorba-xquery/www/modules/data-cleaning/phonetic-string-similarity.xq	2011-11-16 18:49:23 +0000
@@ -91,7 +91,7 @@
  let $aux3  := replace(replace($aux2,"MB","M"),"B$","")
  let $aux4  := replace(replace(replace(replace(replace($aux3,"CIA","XIA"),"SCH","SKH"),"CH","XH"),"C([IEY])","S$1"),"C","K")
  let $aux5  := replace(replace($aux4,"DG([EYI])","JG$1"),"D","T")
- let $aux6  := replace(replace($aux5,"GH([^AEIOU])","H$1"),"G(N(ED)?)^","$1")
+ let $aux6  := replace(replace($aux5,"GH([^AEIOU])","H$1"),"G(N(ED)?)$","$1")
  let $aux7  := replace(replace(replace($aux6,"([^G]?)G([IEY])","$1J$2"),"([^G]?)G","$1K"),"GG","G")
  let $aux8  := replace(replace(replace(replace($aux7,"([AEIOU])H([^AEIOU])","$1$2"),"CK","K"),"PH","F"),"Q","K")
  let $aux9  := replace(replace(replace(replace(replace($aux8,"S(H|(IO)|(IA))","X$1"),"T((IO)|(IA))","X$1"),"TH","0"),"TCH","CH"),"V","F")

=== modified file 'test/ExpQueryResults/data-cleaning/conversion/address-from-user.xml.res'
--- test/ExpQueryResults/data-cleaning/conversion/address-from-user.xml.res	2011-07-19 19:12:03 +0000
+++ test/ExpQueryResults/data-cleaning/conversion/address-from-user.xml.res	2011-11-16 18:49:23 +0000
@@ -1,1 +1,1 @@
-3362 Walden Ave, Depew, NY, US 222 E 53rd St, Los Angeles, CA, US
\ No newline at end of file
+222 E 53rd St, Los Angeles, CA, US

=== modified file 'test/ExpQueryResults/data-cleaning/conversion/geocode-from-address.xml.res'
--- test/ExpQueryResults/data-cleaning/conversion/geocode-from-address.xml.res	2011-07-19 19:12:03 +0000
+++ test/ExpQueryResults/data-cleaning/conversion/geocode-from-address.xml.res	2011-11-16 18:49:23 +0000
@@ -1,1 +1,1 @@
-38.725735 -9.15021
\ No newline at end of file
+38 -10

=== modified file 'test/ExpQueryResults/data-cleaning/conversion/phone-from-user.xml.res'
--- test/ExpQueryResults/data-cleaning/conversion/phone-from-user.xml.res	2011-07-19 19:12:03 +0000
+++ test/ExpQueryResults/data-cleaning/conversion/phone-from-user.xml.res	2011-11-16 18:49:23 +0000
@@ -1,1 +1,1 @@
-[phone]
\ No newline at end of file
+[phone] [phone] [phone] [phone] [phone] [phone] [phone] [phone] [phone] [phone] [phone]

=== modified file 'test/ExpQueryResults/data-cleaning/conversion/user-from-phone.xml.res'
--- test/ExpQueryResults/data-cleaning/conversion/user-from-phone.xml.res	2011-09-02 09:14:39 +0000
+++ test/ExpQueryResults/data-cleaning/conversion/user-from-phone.xml.res	2011-11-16 18:49:23 +0000
@@ -1,1 +1,1 @@
-Homer V Simpson Homer Simpson Sue M Simpson
\ No newline at end of file
+Gene Simpson Homer V Simpson Homer Simpson Sue M Simpson

=== modified file 'test/ExpQueryResults/data-cleaning/normalization/to-date.xml.res'
--- test/ExpQueryResults/data-cleaning/normalization/to-date.xml.res	2011-07-28 23:25:13 +0000
+++ test/ExpQueryResults/data-cleaning/normalization/to-date.xml.res	2011-11-16 18:49:23 +0000
@@ -0,0 +1,1 @@
[phone]

=== modified file 'test/ExpQueryResults/data-cleaning/normalization/to-dateTime.xml.res'
--- test/ExpQueryResults/data-cleaning/normalization/to-dateTime.xml.res	2011-07-19 19:12:03 +0000
+++ test/ExpQueryResults/data-cleaning/normalization/to-dateTime.xml.res	2011-11-16 18:49:23 +0000
@@ -0,0 +1,1 @@
[phone]T21:22:00

=== modified file 'test/ExpQueryResults/data-cleaning/normalization/to-time.xml.res'
--- test/ExpQueryResults/data-cleaning/normalization/to-time.xml.res	2011-07-19 19:12:03 +0000
+++ test/ExpQueryResults/data-cleaning/normalization/to-time.xml.res	2011-11-16 18:49:23 +0000
@@ -0,0 +1,1 @@
+09:10:00

=== modified file 'test/Queries/data-cleaning/conversion/geocode-from-address.xq'
--- test/Queries/data-cleaning/conversion/geocode-from-address.xq	2011-07-19 19:12:03 +0000
+++ test/Queries/data-cleaning/conversion/geocode-from-address.xq	2011-11-16 18:49:23 +0000
@@ -1,3 +1,5 @@
 import module namespace conversion = "http://www.zorba-xquery.com/modules/data-cleaning/conversion";
 
-conversion:geocode-from-address ( ("Lisboa", "Portugal") )
+let $geocode := conversion:geocode-from-address ( ("Lisboa", "Portugal") )
+for $result in $geocode
+return floor($result)

=== removed file 'test/Queries/data-cleaning/conversion/unit-convert.spec'
--- test/Queries/data-cleaning/conversion/unit-convert.spec	2011-07-28 23:25:13 +0000
+++ test/Queries/data-cleaning/conversion/unit-convert.spec	1970-01-01 00:00:00 +0000
@@ -1,1 +0,0 @@
-Error: http://expath.org/ns/error:HC002