Testing for Unicode entities from certain blocks

Texts in CroALa sometimes come from OCR (e. g. done by Google Books). Such texts may include unwanted homographs, or homoglyphs — Cyrillic a instead of Latin a, with further problems in searching, parsing, lemmatizing etc. To clean this up, an XSL stylesheet testing for Unicode blocks comes handy. See the Github Gist of the XSL.

Homoglyphs

The XSL led to Commit 21 in our Github repository.



Cite this blog post
Neven Jovanović (2016, May 1). Testing for Unicode entities from certain blocks. Croatica et Tyrolensia. Retrieved June 15, 2024, from https://doi.org/10.58079/ne7v

Search OpenEdition Search

You will be redirected to OpenEdition Search