Asian languages not supported by text index

Bug #610477 reported by Wichert Akkerman
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
zope.index
New
Undecided
Unassigned

Bug Description

The pipeline used by the text index does not support Asian languages: it fails to split asian text and can not find stopwords. The result is that a query will never return a result. You can specify an alternative pipeline, but there are no components available to support any of the asian languages.

I tried to drop the splitter from http://www.zope.org/Members/panjunyong/CJKSplitter in. This worked a bit better in that I got search results, but there seems to be little relation between my query and the result.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.