Binary package “ucto” in ubuntu lunar
Unicode Tokenizer
Ucto can tokenize UTF-8 encoded text files (i.e. separate words from
punctuation, split sentences, generate n-grams), and offers several other
basic preprocessing steps that make your text suited for further processing
such as indexing, part-of-speech tagging, or machine translation.
.
This package provides the command-line tool itself.
.
Ucto was written by Maarten van Gompel and Ko van der Sloot. Work on Ucto
was funded by NWO, the Netherlands Organisation for Scientific Research,
under the Implicit Linguistics project, the CLARIN-NL program, and the
CLARIAH project.
.
Ucto is a product of the Centre of Language and Speech Technology (Radboud
University Nijmegen), and previously the ILK Research Group
(Tilburg University, The Netherlands).
.
If you are interested in machine parsing of UTF-8 encoded text files, e.g. to
do scientific research in natural language processing, ucto will likely be of
use to you.
Source package
Published versions
- ucto 0.21.1-2build4 in amd64 (Proposed)
- ucto 0.21.1-2build4 in amd64 (Release)
- ucto 0.21.1-2build4 in arm64 (Proposed)
- ucto 0.21.1-2build4 in arm64 (Release)
- ucto 0.21.1-2build4 in armhf (Proposed)
- ucto 0.21.1-2build4 in armhf (Release)
- ucto 0.21.1-2build4 in ppc64el (Proposed)
- ucto 0.21.1-2build4 in ppc64el (Release)
- ucto 0.21.1-2build4 in riscv64 (Proposed)
- ucto 0.21.1-2build4 in riscv64 (Release)
- ucto 0.21.1-2build4 in s390x (Proposed)
- ucto 0.21.1-2build4 in s390x (Release)