Digital resources in the Social Sciences and Humanities OpenEdition Our platforms OpenEdition Books OpenEdition Journals Hypotheses Calenda Libraries OpenEdition Freemium Follow us

Testing for Unicode entities from certain blocks

Texts in CroALa sometimes come from OCR (e. g. done by Google Books). Such texts may include unwanted homographs, or homoglyphs — Cyrillic a instead of Latin a, with further problems in searching, parsing, lemmatizing etc. To clean this up, an XSL stylesheet testing for Unicode blocks comes handy. See the Github Gist of the XSL.

Homoglyphs

The XSL led to Commit 21 in our Github repository.


OpenEdition suggests that you cite this post as follows:
Neven Jovanović (May 1, 2016). Testing for Unicode entities from certain blocks. Croatica et Tyrolensia. Retrieved April 26, 2025 from https://doi.org/10.58079/ne7v