1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
|
---
title: 'pyuca: a Python implementation of the Unicode Collation Algorithm'
authors:
- name: J. K. Tauber
orcid: 0000-0001-6534-8866
date: 18 May 2016
---
# Summary
Collation, the sorting of strings, is an important part of computational work
in corpus linguistics and digital humanities. Lexicographical sorting, however,
is rarely appropriate for languages other than English. The Unicode Consortium
has developed the Unicode Collation Algorithm (UCA) to solve this problem.
pyuca is a Python implementation of the Unicode Collation Algorithm suitable
for researchers doing text processing in Python. It passes 100% of the UCA
conformance tests for Unicode 5.2.0 (Python 2.7) and 6.3.0 (Python 3.3+) with a variable-weighting setting of Non-ignorable.
pyuca includes the Default Unicode Collation Element Table (DUCET) which
provides a default collation suitable for many of the world's scripts.
# References
The Unicode Consortium. Unicode Collation Algorithm (Unicode Technical Standard
#10) http://unicode.org/reports/tr10/
|
